-- Logs begin at Sat 2022-06-04 20:01:18 UTC, end at Sat 2022-06-04 22:16:44 UTC. -- Jun 04 20:34:39.033882 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jun 04 20:34:39.043487 ncdv-master-1 devstack@keystone.service[97793]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 20:34:39 2022] *** Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: nodename: ncdv-master-1 Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: machine: x86_64 Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: clock source: unix Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: pcre jit disabled Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: detected number of CPU cores: 4 Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: current working directory: / Jun 04 20:34:39.045502 ncdv-master-1 devstack@keystone.service[97793]: detected binary path: /usr/bin/uwsgi-core Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: your processes number limit is 47680 Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: your memory page size is 4096 bytes Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: detected max file descriptor number: 2048 Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: lock engine: pthread robust mutexes Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: thunder lock: enabled Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 04 20:34:39.046151 ncdv-master-1 devstack@keystone.service[97793]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 20:34:39.095806 ncdv-master-1 devstack@keystone.service[97793]: Python main interpreter initialized at 0x5632789c69c0 Jun 04 20:34:39.095806 ncdv-master-1 devstack@keystone.service[97793]: python threads support enabled Jun 04 20:34:39.095806 ncdv-master-1 devstack@keystone.service[97793]: your server socket listen backlog is limited to 100 connections Jun 04 20:34:39.095806 ncdv-master-1 devstack@keystone.service[97793]: your mercy for graceful operations on workers is 90 seconds Jun 04 20:34:39.096226 ncdv-master-1 devstack@keystone.service[97793]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 20:34:39.096226 ncdv-master-1 devstack@keystone.service[97793]: *** Operational MODE: preforking *** Jun 04 20:34:39.096522 ncdv-master-1 devstack@keystone.service[97793]: *** uWSGI is running in multiple interpreter mode *** Jun 04 20:34:39.096522 ncdv-master-1 devstack@keystone.service[97793]: spawned uWSGI master process (pid: 97793) Jun 04 20:34:39.096704 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jun 04 20:34:39.097832 ncdv-master-1 devstack@keystone.service[97793]: spawned uWSGI worker 1 (pid: 97803, cores: 1) Jun 04 20:34:39.097832 ncdv-master-1 devstack@keystone.service[97793]: spawned uWSGI worker 2 (pid: 97804, cores: 1) Jun 04 20:34:39.097832 ncdv-master-1 devstack@keystone.service[97793]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 20:34:44.906289 ncdv-master-1 devstack@keystone.service[97803]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:44.906289 ncdv-master-1 devstack@keystone.service[97803]: from cryptography.utils import int_from_bytes Jun 04 20:34:44.907213 ncdv-master-1 devstack@keystone.service[97804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:44.907213 ncdv-master-1 devstack@keystone.service[97804]: from cryptography.utils import int_from_bytes Jun 04 20:34:44.907925 ncdv-master-1 devstack@keystone.service[97803]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:44.907925 ncdv-master-1 devstack@keystone.service[97803]: from cryptography.utils import int_from_bytes Jun 04 20:34:44.908159 ncdv-master-1 devstack@keystone.service[97804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:44.908159 ncdv-master-1 devstack@keystone.service[97804]: from cryptography.utils import int_from_bytes Jun 04 20:34:44.958105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:34:44.958369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:34:44.958497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:34:44.958668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:34:44.958788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] command line args: [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:34:44.958897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] command line args: [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:34:44.958997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:34:44.959106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:34:44.959215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ================================================================================ {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:34:44.959337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ================================================================================ {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:34:44.959452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] admin_token = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.959662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] admin_token = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.959784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] config_dir = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.959905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] config_dir = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.960015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.960144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.960250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] config_source = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.960720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] config_source = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.960887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] debug = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.961037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] debug = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.961202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.962709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.962709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.963975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_config_append = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_config_append = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_dir = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.964938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_dir = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_file = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_file = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.965999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.966933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.967915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.968473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.968573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.968674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.968798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.968912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.969899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] publish_errors = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] publish_errors = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.970940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] standard_threads = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] standard_threads = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.971944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] use_journal = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] use_journal = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] use_json = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] use_json = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] use_stderr = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.972980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] use_stderr = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.973091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] use_syslog = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.973210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] use_syslog = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.973317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.973428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:44.973603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.973718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.973826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.973943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.974062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.974232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.974366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.974470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.974587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.975273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.975388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.975576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.975776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.975887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.976868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.977950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.978994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.979920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.980917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.981863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.982926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.983961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.984973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.985928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.986949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.987967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.988996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.989979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.990372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.990928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.991884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.992917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.993935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.994967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.995902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.996988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.997938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.998910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:44.999934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.000972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.external = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.001905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.external = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.password = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] auth.token = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.002884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.password = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] auth.token = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.003999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.004941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.005052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.005163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.005282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.005410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.005606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.006997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.007917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.008887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.009839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.010894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.011992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.012953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.013909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.014801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.015774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.016912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.017991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.018951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.019947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.020952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.021360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.021613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.021722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.021845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.021967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.022941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.023994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.024941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.025901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.026846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.027913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.028876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.029964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.030952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.031951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.032898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.033957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.034966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.035944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] role.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.036863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.037170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] role.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.037774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.037895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] role.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] role.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.038884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.039875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.040951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.041888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.042945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.043922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.044912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.045985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.046960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.047897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.048995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.049947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.connection = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.050979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.connection = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.051888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.052779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.053935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.054944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:34:45.055647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:45.055647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:34:45.073243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.073467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.073467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.073696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.073849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.073965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.082511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.082670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.111253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.111582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.111716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.111844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.168395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.168773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.217837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.218137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.218698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.218920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.287996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.288066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.288130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.288329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.288455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.288524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.313641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.314920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.315710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.327343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.327638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.341373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.341617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.341738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.341866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.341978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.342978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97804) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.343092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97803) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:45.361323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.361568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.361750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:45.361876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:45.361996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:45.362352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:45.362480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.362934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.363063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.363179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.363286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.374625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.374853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.375660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.383957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.384195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.387293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.387461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.387617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.387775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.387891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.388881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.389973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.390091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.390219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.417523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.417777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.419273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.419426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.419594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.419711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.425035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.425262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.425410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.425527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.425643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.425776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.433425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.433674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.433816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.434044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.438397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.438561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.438712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.438832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.438961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.439882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.440007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.440159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.440296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.440411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.440530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.459253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.459720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.459909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.460074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.464549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.464837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.468198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.468501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.468651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.468787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.473502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.473713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.477462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.477836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.481100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.481401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.481551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.481788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.481907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.482058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.483701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.484005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.484183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.484313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.484437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.484602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.503570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.503865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.504125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.504275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.504413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.504599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.504725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.505036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.512861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.513408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.514623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.514871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.515226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.515502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.518007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.518289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.518567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.518718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.518875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.518997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.519126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.519247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.519399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.519726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.533208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.533452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.533639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.533802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.533921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.534940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.535063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.535325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.553158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.553664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.556913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.557315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.560425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.560798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.562111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.562479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.563792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.564071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.564251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.564377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.564505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.564640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.571982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.572155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.573602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.573756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.576877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.577843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.587150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.587406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.587552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.587684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.587814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.587944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.595911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97803) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.596126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97804) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:45.596198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.596352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.596527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.596774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.596914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.597877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.598935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97803) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.599865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97804) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:45.638124 ncdv-master-1 devstack@keystone.service[97803]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632789c69c0 pid: 97803 (default app) Jun 04 20:34:45.638348 ncdv-master-1 devstack@keystone.service[97804]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632789c69c0 pid: 97804 (default app) Jun 04 20:34:45.641642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35862-a85b-447a-a053-4215c372e653 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.641929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35862-a85b-447a-a053-4215c372e653 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.642208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d35862-a85b-447a-a053-4215c372e653 None None] PATH_INFO: `/v3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.646621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sat Jun 4 20:34:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.531210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.531884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.531884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.537534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:34:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:54.544016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581543c-b940-4949-a874-b79f12b37588 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.544661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581543c-b940-4949-a874-b79f12b37588 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.544661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581543c-b940-4949-a874-b79f12b37588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.621353 ncdv-master-1 devstack@keystone.service[97803]: INFO dbcounter [None req-9581543c-b940-4949-a874-b79f12b37588 None None] Registered counter for database keystone Jun 04 20:34:54.645228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG oslo_db.sqlalchemy.engines [None req-9581543c-b940-4949-a874-b79f12b37588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:34:54.656693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writer thread running {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:34:55.133038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG passlib.handlers.bcrypt [None req-9581543c-b940-4949-a874-b79f12b37588 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97803) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 20:34:55.133469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG passlib.handlers.bcrypt [None req-9581543c-b940-4949-a874-b79f12b37588 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97803) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 20:34:55.194726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9581543c-b940-4949-a874-b79f12b37588 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:55.196421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9581543c-b940-4949-a874-b79f12b37588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:55.346836 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 804 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 20:34:55.396853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:55.472288 ncdv-master-1 devstack@keystone.service[97804]: INFO dbcounter [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] Registered counter for database keystone Jun 04 20:34:55.493325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG oslo_db.sqlalchemy.engines [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:34:55.504283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writer thread running {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:34:55.895380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75043c5-c912-429f-8432-465d2a720bdc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:55.903944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:55.905079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.905571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.906051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.922249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.034277 ncdv-master-1 devstack@keystone.service[97804]: WARNING keystone.common.rbac_enforcer.enforcer [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 20:34:56.034863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099aaf5d-2786-4a6e-ab38-f66c4cd7c678 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.053600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Jun 4 20:34:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 20:34:56.062956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581543c-b940-4949-a874-b79f12b37588 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:56.078920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581543c-b940-4949-a874-b79f12b37588 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:56.085052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:56.086283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:56.086607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:56.086931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] PATH_INFO: `/v3/projects/598115c278dc4440816e2bfd4030f050` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.088769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] RBAC: Authorizing `identity:get_project(project_id=598115c278dc4440816e2bfd4030f050)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.140648 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 20:34:56.140993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3a3e-7e07-44c2-ba69-eb76d2dad6fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.146397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sat Jun 4 20:34:56 2022] GET /identity/v3/projects/598115c278dc4440816e2bfd4030f050 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:58.577519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e99d-844e-4123-b8e0-997f3c5d5d19 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.578117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e99d-844e-4123-b8e0-997f3c5d5d19 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.578117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e99d-844e-4123-b8e0-997f3c5d5d19 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.582345 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:34:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:58.589392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd423-7607-401f-a46b-2659fede799d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.589974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd423-7607-401f-a46b-2659fede799d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.590091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd423-7607-401f-a46b-2659fede799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.611923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5afcd423-7607-401f-a46b-2659fede799d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:58.613544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5afcd423-7607-401f-a46b-2659fede799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:58.622635 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 20:34:58.648345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e99d-844e-4123-b8e0-997f3c5d5d19 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.662007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e99d-844e-4123-b8e0-997f3c5d5d19 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.666522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.667191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.667480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.667791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.676988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:58.678938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b0717-9e2b-42c4-abd8-a610ad1af51b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:58.689243 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Jun 4 20:34:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 20:34:58.695726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcd423-7607-401f-a46b-2659fede799d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.706047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcd423-7607-401f-a46b-2659fede799d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.711419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.712368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.712653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.712931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.714487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:58.716419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f2076-2f75-47e0-9d46-411382b7a59d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:58.718100 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Jun 4 20:34:58 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:01.213199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b54c6a-8e40-477b-b485-aa249b40cb87 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.214029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b54c6a-8e40-477b-b485-aa249b40cb87 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.214029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b54c6a-8e40-477b-b485-aa249b40cb87 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.215433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:01.223126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b491c8-9028-483f-a7e9-1acc3b4f5303 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.223827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b491c8-9028-483f-a7e9-1acc3b4f5303 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.224157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b491c8-9028-483f-a7e9-1acc3b4f5303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.253508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-37b491c8-9028-483f-a7e9-1acc3b4f5303 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:01.256625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-37b491c8-9028-483f-a7e9-1acc3b4f5303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:01.399585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:01.425240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b54c6a-8e40-477b-b485-aa249b40cb87 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.597269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b54c6a-8e40-477b-b485-aa249b40cb87 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.639778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.640723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.641098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.641466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.657005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:01.668926 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:01.670815 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:01.672501 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 6/12] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:01.677881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056782d-8a25-4fd4-9c4b-f742c2d3e576 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.678380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056782d-8a25-4fd4-9c4b-f742c2d3e576 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.679067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056782d-8a25-4fd4-9c4b-f742c2d3e576 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.680571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.681224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:01.687433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.687870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.688233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.707325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:01.708829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:01.723356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.732036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.816245 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 8/14] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:01.835453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6accc-9fbc-46b1-9064-5b61cf4a6ac8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.851098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.887669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.888388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.888665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.888948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.889734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:01.890049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:01.891604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:01.907500 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:01.913613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.993945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381306-012c-4153-88e6-d39f6c8db875 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.049171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9289901-502b-4194-b058-99c504928618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.050158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9289901-502b-4194-b058-99c504928618 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.050609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9289901-502b-4194-b058-99c504928618 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.051058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9289901-502b-4194-b058-99c504928618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.068708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.078148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ec3d-93a1-4a2d-bd9b-6413ef975c1e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.086514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.125903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.127029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.127308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.127787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.129621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.131132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.132889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.138770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.147661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9289901-502b-4194-b058-99c504928618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.149618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9289901-502b-4194-b058-99c504928618 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.280087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb2c8-67df-4a46-9a47-2109f850f78f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.292478 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:02.299179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9289901-502b-4194-b058-99c504928618 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.338240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.339551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.339837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.340111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.341654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.343224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.345068 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.359031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.377962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.404265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.456821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9289901-502b-4194-b058-99c504928618 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.500272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.501157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.501507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.501851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.504317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06f03-cbad-4c16-aeac-f8a12882a2dc None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.514244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.515932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:02.539587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:02.541097 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:02.542329 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:02.542329 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:02.542329 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:02.542329 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:02.542329 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:02.547176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.550418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.551104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.551382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.551752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.553297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.domain.id=default, user.id=6a435d18d74943c3a8e7cee442315d79) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:02.553615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.555124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eafcf-5e31-4f88-835f-0bff5aa6403c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.564534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/role_assignments?user.id=6a435d18d74943c3a8e7cee442315d79&scope.domain.id=default&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 233 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:02.698602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25770-7dc0-41d0-a1d8-f74007c704e4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.701477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.754943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.755935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.756352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.756719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.757609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:02.758005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.759722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c362de3-e810-4173-ad42-0d68d4d3f022 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.783404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:05.218824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea0a-fb3a-4ab8-b1eb-cbccf5de0b9d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.219359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea0a-fb3a-4ab8-b1eb-cbccf5de0b9d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.219359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ea0a-fb3a-4ab8-b1eb-cbccf5de0b9d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.220849 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:05.232770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.233327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.233327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.260717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:05.261964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:05.423537 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:05.471209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ea0a-fb3a-4ab8-b1eb-cbccf5de0b9d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:05.636908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:05.647017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ea0a-fb3a-4ab8-b1eb-cbccf5de0b9d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:05.709310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:05.710142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.710498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.710773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.730062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:05.738016 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:05.739838 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:05.741627 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 12/24] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:05.748742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:05.936356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:05.944560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006d008-4cf2-414d-93aa-5eae699d0122 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:05.997999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:05.998591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.998888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.999176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.999997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:06.000319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.001785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca92b1-f1a6-4eac-bc65-f07d800d5e7d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.022655 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 13/25] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:06.028750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.190855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796dea-eb00-4a81-8c8d-95f9fb1000a5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:06.225375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf5c8-ac47-417b-9bca-76543685fe35 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.226044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf5c8-ac47-417b-9bca-76543685fe35 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.226547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf5c8-ac47-417b-9bca-76543685fe35 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.232438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:06.256175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.257222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.257727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.260443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:06.262167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.262640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.263121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.266877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.268837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.272676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 13/27] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:06 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:06.279418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.287684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:06.289451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:06.339830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:06.381927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:06.466173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.529751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aac0f5-2048-4883-8f0f-381152b77eaa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:06.619015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:06.620451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.620913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.621399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.629139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.632068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f513977-ec1f-40ba-b270-93236ea0f5f0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.639546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:06.639546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d857b-6d40-4a25-9eba-eae328a7374a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.639546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d857b-6d40-4a25-9eba-eae328a7374a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.639546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d857b-6d40-4a25-9eba-eae328a7374a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.648074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:06.649153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:06.649837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d857b-6d40-4a25-9eba-eae328a7374a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.674250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde310dc-3cda-471b-a6cf-ec0e7de15881 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:06.728160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:06.729006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.729361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.729644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.730445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.732014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f988bd-8453-4096-bb5b-27a5974c33ff None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.785956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:06.797759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d857b-6d40-4a25-9eba-eae328a7374a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:06.838610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:06.839538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.839825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.840109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] PATH_INFO: `/v3/domains/default/users/6a435d18d74943c3a8e7cee442315d79/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.842437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a435d18d74943c3a8e7cee442315d79, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.844046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfad32-09b2-46e1-b65c-616457bc8917 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.870111 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 16/31] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jun 4 20:35:06 2022] POST /identity/v3/roles => generated 219 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:06.872140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f093d-d101-4a88-937f-7696e303d22c None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.872669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f093d-d101-4a88-937f-7696e303d22c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.873431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f093d-d101-4a88-937f-7696e303d22c None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.879745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 17/32] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:06.881855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.882388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.882883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.918822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:06.923885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:07.072420 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 16/33] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jun 4 20:35:06 2022] PUT /identity/v3/domains/default/users/6a435d18d74943c3a8e7cee442315d79/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:07.075354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.075894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.076395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.093149 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:07.108289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG passlib.handlers.bcrypt [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=97804) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 20:35:07.109089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG passlib.handlers.bcrypt [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97804) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 20:35:07.165761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:07.167870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:07.171352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.350287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.379769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:07.408440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.415814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920a7ef-8ed2-484b-933a-e15c558ddda4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.514230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.516266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.517147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.517946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.524082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.545009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.552309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.554147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068406-ed3c-44fa-a8b6-9e8779d446d9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:07.593831 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:07.595391 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:07.597054 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:07.597054 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:07.597054 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:07.597054 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:07.600599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.601274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:07.601617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.601952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.602235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.603314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.605131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.618342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.636385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jun 4 20:35:07 2022] POST /identity/v3/roles => generated 225 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:07.935837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a31371-0fce-4c93-9fe3-e055b45404b7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.966839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.982923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.984033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.984570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.985032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.985986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:07.986504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.988201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d000e87-6f71-403e-a6e6-338061c63f0e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:08.004692 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:08.014463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:08.157218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262150b2-db4a-4fd4-abba-2e7e70f855ec None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.157962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262150b2-db4a-4fd4-abba-2e7e70f855ec None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.158458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262150b2-db4a-4fd4-abba-2e7e70f855ec None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.160153 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 21/39] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:08.166533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.167183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.167727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.196562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446f2f8-e0c0-4763-9d60-6de9d4595694 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:08.203277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:08.205921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:08.245554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:08.247213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.247501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.247804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.249405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:08.250782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:08.281377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:08.322851 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 19/40] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:08.328391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:08.354587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:08.486590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01c7a-001b-49dd-b9eb-a2f7eb0d4b22 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:08.531343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:08.532255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.532545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.532830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.534288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:08.536113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab901bc4-9420-4545-b4e6-0f497c80a9e8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:08.538719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 20/42] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:08.544541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:08.669560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a84ca-5175-4202-8104-a0cd8cec45d4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:08.691320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:08.712398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:08.713097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.713385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.713670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.714483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:08.716047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b9525-0fc5-4726-9ef2-598e854f0fcd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:08.759400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 23/43] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/projects => generated 312 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:08.789229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34990c1-55d3-4ca8-bb92-0d264b105406 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.789706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34990c1-55d3-4ca8-bb92-0d264b105406 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.790176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34990c1-55d3-4ca8-bb92-0d264b105406 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.792278 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 21/44] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:08.799211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac6ca-103a-41aa-8e8d-9cb7561e8538 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.799659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac6ca-103a-41aa-8e8d-9cb7561e8538 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.799882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ac6ca-103a-41aa-8e8d-9cb7561e8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.819788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ab2ac6ca-103a-41aa-8e8d-9cb7561e8538 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:08.821119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab2ac6ca-103a-41aa-8e8d-9cb7561e8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:08.902267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 24/45] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:08.927170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34990c1-55d3-4ca8-bb92-0d264b105406 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.010252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:09.062048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34990c1-55d3-4ca8-bb92-0d264b105406 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.115060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.116314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.116803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.117274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.118400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:09.120465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56604c24-a58d-42ba-bb73-c79c0defce3c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:09.141608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:10.139474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4aabd-0d9a-48e3-bdb3-5e9e26fa3dd2 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.140026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4aabd-0d9a-48e3-bdb3-5e9e26fa3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.140532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4aabd-0d9a-48e3-bdb3-5e9e26fa3dd2 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.143039 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:10.151334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.152215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.152402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.171153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:10.172450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:10.246268 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:10.271725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4aabd-0d9a-48e3-bdb3-5e9e26fa3dd2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.401575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.409143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4aabd-0d9a-48e3-bdb3-5e9e26fa3dd2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.472537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.474437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.474950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.475449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.495773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:10.509807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:10.511537 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:10.512970 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:10.520219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.589708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.682872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f9a03-0eb5-4773-ba01-4f75d483b481 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.752101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.753274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.753764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.754262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.756596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:10.757198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.759901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.778077 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 24/50] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:10.787756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.915859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95491-77e8-40de-922f-04c3a1732aa6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.955064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.956014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.956284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.956532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.958187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.960245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.962000 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 27/51] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:10.970739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.097364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87111b-16dd-4fa6-b051-a05dadea3370 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.113958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.143300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.144688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.145274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.145766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.147918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.150636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac981f-1bb3-4050-b76b-2f6869821fa9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.161589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 25/52] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:11.164624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.235376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.397451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4780-7f94-4d15-9a16-436b0cb9a789 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.462929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248dcf-aeae-452b-88f9-cb9a75838aee None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.463367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248dcf-aeae-452b-88f9-cb9a75838aee None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.463544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.463847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82248dcf-aeae-452b-88f9-cb9a75838aee None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.464596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.465043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.465522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.466262 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 26/53] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:11.466778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.domain.id=default, user.id=6a435d18d74943c3a8e7cee442315d79) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:11.467175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.468955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.474980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.475389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.475766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.478841 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/role_assignments?user.id=6a435d18d74943c3a8e7cee442315d79&scope.domain.id=default&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 530 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:11.495985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:11.497298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:11.584506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 27/55] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:11.610000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.727939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.740365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9bf6-ce40-4d90-92b3-4e5add293bb5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.789803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.790813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.791192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.791532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.793359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.794966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ceffb-0855-4470-8a49-a945a65214a0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.797484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:11.803685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.914617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2e7d7-e4c8-41c0-a469-b6a9105c84b4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.930237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.955298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.955971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.956259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.956563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.957349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.959866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7004218-2e3c-4e9b-9c18-1b43b1738e77 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.988681 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Jun 4 20:35:11 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:14.825392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69480-d048-420c-ac3e-70ef8b6c6719 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.825966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69480-d048-420c-ac3e-70ef8b6c6719 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.826369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba69480-d048-420c-ac3e-70ef8b6c6719 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.828959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:14.835455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.836057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.836057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.856176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:14.857438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:14.933125 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:14.959894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69480-d048-420c-ac3e-70ef8b6c6719 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.077258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba69480-d048-420c-ac3e-70ef8b6c6719 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.115381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.116237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.116526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.116802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.118101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:15.119658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4551093-83c0-40e9-b228-7d739eef0517 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:15.121362 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:15.127787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.238056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.247590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5db3-1fb6-41ff-93b8-752dbf1c771c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.313141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.314278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.314795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.315261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.316676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:15.319555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40716427-f2a1-4fe9-8a03-24efd6da67bb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:15.359955 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:15 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:19.186489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1f8e-29a6-4014-91e4-7954f80961b9 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.187123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1f8e-29a6-4014-91e4-7954f80961b9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.187123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c1f8e-29a6-4014-91e4-7954f80961b9 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.188496 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:19.195932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.196462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.196937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.236566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:19.239121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:19.418962 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:19.465809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c1f8e-29a6-4014-91e4-7954f80961b9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:19.510309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:19.623805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c1f8e-29a6-4014-91e4-7954f80961b9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:19.676484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:19.677444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.677736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.678071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.689921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0665eaa7-6fc1-48cf-8436-ed8b9d125c9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:19.702241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:19.704052 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:19.705625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 33/64] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:19.713410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:19.772150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851725aa-e163-4a86-b28b-155121ee2e18 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.772777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851725aa-e163-4a86-b28b-155121ee2e18 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.773309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851725aa-e163-4a86-b28b-155121ee2e18 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.775025 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 34/65] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:19.807030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.807796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.808398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.849149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:19.850396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:19.936036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:19.958686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 35/66] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:20.006661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01d05-ffc0-403f-b011-293e4f298fbf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.010471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.048244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.094426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.095551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.096062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.096554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.097548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:20.098116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.099806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.110479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 32/67] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:20.116381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.273957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d6e23-72ad-4c61-87db-ecab1fcafac5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.359844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.361090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.361599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.362083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.368421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc96d-5492-4a7b-b968-cfa8516878d0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.376294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:20.395148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:20.396161 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:20.396925 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:20.398006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 36/68] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:20.413314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.452111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.453455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.453794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.454050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.455789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.457431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804c67d-d8ef-4eea-9c85-ff7c9314dd20 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.459567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 33/69] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:20.460718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeced9f-7d52-4928-8f81-a8bc88a846b2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.460999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeced9f-7d52-4928-8f81-a8bc88a846b2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.461287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeced9f-7d52-4928-8f81-a8bc88a846b2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.462982 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 34/70] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:20.464071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79090-d630-4b35-a49a-5e7fafe4de3a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.464403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79090-d630-4b35-a49a-5e7fafe4de3a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.464750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79090-d630-4b35-a49a-5e7fafe4de3a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.466524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 35/71] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:20.467969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac79090-d630-4b35-a49a-5e7fafe4de3a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.485580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.581130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.611365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f8d1-9d44-4839-9cf7-b52cb8099baa None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.616337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac79090-d630-4b35-a49a-5e7fafe4de3a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.661908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.662721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.663079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.663481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.664460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:20.664944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.666560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8ff73-103d-4aad-b830-2a1f070f4f2e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.669027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.669922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.670298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.670646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.678263 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:20.679853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb6f-11ea-400e-ba8a-f8681a6778f0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.680269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb6f-11ea-400e-ba8a-f8681a6778f0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.680679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fb6f-11ea-400e-ba8a-f8681a6778f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.704879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-97c6fb6f-11ea-400e-ba8a-f8681a6778f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:20.706668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-97c6fb6f-11ea-400e-ba8a-f8681a6778f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:20.770943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.772787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618a1ed-bdf7-4b14-aeef-97ef8329eb0e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.786589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.796477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 38/73] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:20.806042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.806556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.807056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.841717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:20.843169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:20.903862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 36/74] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:20.906085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4948bf-bf6b-4c33-b847-5ba99e6f260d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.906544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4948bf-bf6b-4c33-b847-5ba99e6f260d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.906985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4948bf-bf6b-4c33-b847-5ba99e6f260d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.911385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 37/75] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:20.912642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4948bf-bf6b-4c33-b847-5ba99e6f260d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.929881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.939750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 39/76] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:20.941192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.044670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4948bf-bf6b-4c33-b847-5ba99e6f260d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.058210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.075792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba228106-d776-4b69-ba11-5d96413a1fc4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.091730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.093143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.093602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.094061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.114361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.117418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.120702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:21.122077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.127273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.128370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.128822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.129665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.142712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-999f8ddc-0756-4197-8400-982b08893c73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:21.153059 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:21.154972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:21.156876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:21.158126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.158126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.158126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.179946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:21.181470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:21.263284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.272509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd16d2-f111-4ec6-bbe3-da79e0bb1578 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.279860 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 41/79] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:21.281235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.331617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.333095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.333567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.334040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.336073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.338189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.341402 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 39/80] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:21.342685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.397330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.422866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9651-4dce-4154-801a-b58c8e8d3a57 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.462085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.462919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.463198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.463480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.476108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:21.476915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e544404-733f-4eba-a2ce-8cb7c00bcb1a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:21.484309 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:21.485973 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:21.487234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.529760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.530803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.531263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.531766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.555926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.629634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0267f5-16bb-4c09-a8e2-9af815c608f2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.655079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.657088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.685956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.686779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.687147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.687544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.688420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:21.688893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.690772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.703689 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 43/82] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:21.704793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.713571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.798887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 40/83] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:21.801239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.832087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa11e-124b-4cb7-9217-deb8a535e3bc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.848548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.876103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.876920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.877205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.877481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.878778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.880814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.883175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 44/84] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:21.884256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.949764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a77e48-2a1c-4c96-9561-a5e4124c8022 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.998761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90754171-ee05-4dcd-9a67-5253b4b63e1c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.000310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.001483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.002036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.002543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.005109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=6a435d18d74943c3a8e7cee442315d79) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:22.005705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.008667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.014334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.021003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 41/85] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/role_assignments?user.id=6a435d18d74943c3a8e7cee442315d79&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.022670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.058415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.059309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.059824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.060271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.061574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:22.062066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.064584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.079168 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 45/86] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.080488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.140551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.202807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2950ae7-ce47-4b8e-9147-a8ff3a065378 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.246343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc8f1-021f-453e-b6e7-5162c84251ed None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.258432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.259919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.260298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.260982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.262950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.265146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.273533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 42/87] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.273533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.318445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.319997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.320478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.320946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.323128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.325778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.329144 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 46/88] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.330535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.355378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.422875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973a360-55c3-4777-bab4-3f9f4f8d12a0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.482929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.484054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.484389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.484895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.486274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.489009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.518992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291eca1-c1d1-4386-874c-f8a6275eecc1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.527999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 43/89] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:22 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:22.527999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.550175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.601680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.603388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.603980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.604506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.606942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.609793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.612709 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.615500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.739150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdf86-13b2-4ad3-8090-092ac345b7ff None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.813911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.814965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.815420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.815862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.824073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.836316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39011baf-0ab2-4e5f-8363-ddf9111a67e0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.915744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.917667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.918513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.919468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.921491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:22.922351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.925692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.937953 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 48/91] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.939729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.967726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.970303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.042634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.193518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9429bf-dba9-44e1-894c-5f6afc5f6a98 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.219276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:23.230999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.296224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.305872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.308925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.309706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.310271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.491095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:23.494063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.505181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fefcf-ef3b-43f3-ba1f-14983576cc1b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.580077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.589630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.592234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.593099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.593873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.597315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:23.601923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.606854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 45/93] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:23.617974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.812217 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 873 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:23.815882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.928416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.953155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07c97-6d7d-4777-8833-c003758bfbfc None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.088782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.089965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.090489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.090938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.092676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:24.093252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.096116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.112566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 259 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:24.168205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adcf25-546f-4ca3-a690-32675c21dad6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.252814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.254842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.255439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.255981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] PATH_INFO: `/v3/projects/90508332447c40769ff82768dc67343f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.260971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] RBAC: Authorizing `identity:get_project(project_id=90508332447c40769ff82768dc67343f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.263786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61443103-aa30-450f-ad95-c60a2641e94e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.267705 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/projects/90508332447c40769ff82768dc67343f => generated 312 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:24.274860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:24.489509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f5a50-9936-40c5-b543-51a2b45a98ba None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.564006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.565008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.565008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.565254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.566512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=90508332447c40769ff82768dc67343f, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:24.566512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.568351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8b247-707e-45f8-aa8c-f69d262fb1d3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.575111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:24 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=90508332447c40769ff82768dc67343f&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:26.465635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89980-3a11-4566-9af3-46562a712b21 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.466432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89980-3a11-4566-9af3-46562a712b21 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.466753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89980-3a11-4566-9af3-46562a712b21 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.469270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 51/98] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:26.488465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.490103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.490947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.530007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:26.532514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:26.561916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.664947 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 48/99] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:26.748114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89980-3a11-4566-9af3-46562a712b21 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.778568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.998148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89980-3a11-4566-9af3-46562a712b21 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.088905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.090816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.091607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.092403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.122054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:27.142071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:27.143826 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:27.145583 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:27.150162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 52/100] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:27.159675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:27.372867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0a0f-6980-499f-832e-5485599f4d60 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.446740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.448440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.449245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.450000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.451748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:27.452595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.455745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.474183 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 49/101] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:27.483089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:27.668682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:27.739082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67ad6b-0026-47d1-afdd-31f4a694b4cb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.804657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.806237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.806737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.807251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.809858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.812837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19024913-d97a-4313-9a89-da9fa1978e2a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.816118 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 53/102] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:27 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:27.825556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:27.856082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:27.938369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700dfa-47b7-41e2-9bed-8caefa6631ef None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.938835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700dfa-47b7-41e2-9bed-8caefa6631ef None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.939332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df700dfa-47b7-41e2-9bed-8caefa6631ef None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.942956 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 54/103] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:27.954609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448580-cf33-4e91-bd70-f07701d78e53 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.955466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448580-cf33-4e91-bd70-f07701d78e53 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.956002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448580-cf33-4e91-bd70-f07701d78e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.005531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-58448580-cf33-4e91-bd70-f07701d78e53 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:28.008287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-58448580-cf33-4e91-bd70-f07701d78e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:28.066962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed006-e09f-4bc8-b56e-67f0579541ec None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.162089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.167535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.167535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.167535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.167983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:28.170431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:28.182716 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 50/104] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:27 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:28.190146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.283397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 55/105] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:28.288603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a416-f8e5-498b-8cb5-f44a66a7ac9d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.289566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a416-f8e5-498b-8cb5-f44a66a7ac9d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.290290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699a416-f8e5-498b-8cb5-f44a66a7ac9d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.293441 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 56/106] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:28.302895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd816-2586-487c-9155-bf73018b6ee4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.303995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd816-2586-487c-9155-bf73018b6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.304726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fd816-2586-487c-9155-bf73018b6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.360021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-832fd816-2586-487c-9155-bf73018b6ee4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:28.362387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-832fd816-2586-487c-9155-bf73018b6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:28.380517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:28.413703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d5ca6-abf0-402d-8407-6b5cbe09e197 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.464060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:28.471281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 57/107] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:28.473019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc063c-83eb-4c4e-b402-2c0b4a0d335e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.473381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc063c-83eb-4c4e-b402-2c0b4a0d335e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.473726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc063c-83eb-4c4e-b402-2c0b4a0d335e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.475752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 58/108] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:28.476725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc063c-83eb-4c4e-b402-2c0b4a0d335e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.499409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.501631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.501862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.502285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/6a435d18d74943c3a8e7cee442315d79/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.506650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, user_id=6a435d18d74943c3a8e7cee442315d79, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:28.509835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9a646-9aad-4158-9791-083268bc2b41 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:28.538182 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 51/109] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:28 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/6a435d18d74943c3a8e7cee442315d79/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:28.546410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.547069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.547604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.603383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:28.605883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:28.606195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc063c-83eb-4c4e-b402-2c0b4a0d335e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.650192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.653196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.653196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.653196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.666954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:28.675379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:28.679868 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 59/110] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:28.682805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.823331 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 52/111] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:28.823987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:28.824228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.883452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdd53d-1cd2-47e9-9dc3-c5e1b3d24c7c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.925420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.926850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.926850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.927471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.940454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:28.949702 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:28.952926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 60/112] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:28.955757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.096658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.133662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afd3cd-a363-48fb-b4cc-87a2786befe1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.165724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fde5-bcda-4558-9490-34287b29f108 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.176294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.216218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.219382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.219751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.220280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.220577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.220862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.221745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:29.221854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.222174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.222649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.224153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.225146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.228221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.232563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 61/113] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.234143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.235296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 53/114] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.240990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.441237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a487579-45dd-48cc-9b37-f1c0a8c2a228 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.483816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.484515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.484803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.485087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.485881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:29.486196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.487313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9efb-22b5-4a95-8fcc-2f0ac6084f07 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.488104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.501073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 62/115] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.501697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.542627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.552358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.553555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.554056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.555272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.556273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.559161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d761-bd60-4f72-b130-9586e1da1a2c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.600410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.607764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 54/116] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:35:29 2022] POST /identity/v3/projects => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:29.610462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c13-f9c3-4604-a704-a50fccbb834a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.611004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c13-f9c3-4604-a704-a50fccbb834a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.611650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c13-f9c3-4604-a704-a50fccbb834a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.618993 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 55/117] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:29.618993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195c13-f9c3-4604-a704-a50fccbb834a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.721508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5d8fb-236d-4fa4-a23a-61ae22fa1e0b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.767182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195c13-f9c3-4604-a704-a50fccbb834a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.798341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.799955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.800549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.801101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.818909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.824703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f7550-aba8-4e06-84ef-63819edbf3b8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.827027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.829073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 63/118] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.829667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.830495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.831329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] PATH_INFO: `/v3/users/3da36e24391c46c092a75c6a3d93ba02` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.836169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.836712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.837132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.857429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=3da36e24391c46c092a75c6a3d93ba02)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.859348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.861643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 56/119] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/users/3da36e24391c46c092a75c6a3d93ba02 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.862829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.876574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:29.882586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:29.974901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.042575 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 64/120] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:30.048659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.099044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9434c-019a-4f61-95c5-add390a7c4a9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.127635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.152632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.153636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.153922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.154211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.155719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.157255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc75b1-dc59-44af-89a7-73242c44d85e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.161224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 57/121] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:30.162770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57c23-52ce-428f-ba66-ead7647b4745 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.163069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57c23-52ce-428f-ba66-ead7647b4745 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.163354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec57c23-52ce-428f-ba66-ead7647b4745 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.164948 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 58/122] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:30.165831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec57c23-52ce-428f-ba66-ead7647b4745 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.207807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a1216-8412-4da5-900b-9a5277e4512b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.265858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.267579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.267579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.267579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.301801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec57c23-52ce-428f-ba66-ead7647b4745 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.315697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.345497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.346634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.347065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.347490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.366139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:30.373392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.373392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71caa46-aee1-497f-a29e-ece1c03e2fd1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:30.380562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:30.381586 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:30.382390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:30.389380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 59/123] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:30.390631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.430147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.493638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 65/124] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:30.495434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.495590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.495869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.505299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc5b07-2fa1-4560-b5ed-1ab43c38983e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.514762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:30.516531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:30.545836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.547052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.547495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.548040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/a53dae70db28467caf7de0ef4bf03539/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.550423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, user_id=a53dae70db28467caf7de0ef4bf03539, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.552367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.573422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 60/125] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:30 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/a53dae70db28467caf7de0ef4bf03539/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:30.575107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.600002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 66/126] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:30.600941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.618643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.703318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.724429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62377d94-1525-4f5f-b797-75a746952c94 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.732921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dd6fd-29e2-4161-9312-3dbb9360eca0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.779645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.779645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.779645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.779645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.780029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.780029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.780918 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 67/127] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:30.781867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.796395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.797102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.797393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.797669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.798447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:30.798783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.800223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.817600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 61/128] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:30.817600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.958355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.970441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692199a5-c33f-4a16-a47f-05d15b507fe4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.017434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.018232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.018592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.018940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.020751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=3da36e24391c46c092a75c6a3d93ba02) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:31.021160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.022685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.025329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d32e38-490d-44d6-813a-8831dfed7ce0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.031148 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 62/129] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/role_assignments?user.id=3da36e24391c46c092a75c6a3d93ba02&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:31.035966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.098293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.099606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.100188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.100692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.131204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:31.140125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:31.141061 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:31.141832 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:31.149763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 68/130] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:31.158747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.167117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.185787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2b5d6-1ddb-465d-9ad0-4b4bd4d52f92 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.245825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42651-e145-4668-933d-51df98991933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.248105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42651-e145-4668-933d-51df98991933 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.249214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42651-e145-4668-933d-51df98991933 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.252297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b42651-e145-4668-933d-51df98991933 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.255489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b42651-e145-4668-933d-51df98991933 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.263955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b42651-e145-4668-933d-51df98991933 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.273658 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 63/131] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:31.299167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42651-e145-4668-933d-51df98991933 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.390808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.435777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e2f66-ddc4-4899-9df0-59aed4c208d1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.486930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.488032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.488582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.489063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.490057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:31.490602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.492297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.512802 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 69/132] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:31.521392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.665792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b42651-e145-4668-933d-51df98991933 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.705048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.764535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.765985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.766449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.766913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.770832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.773607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.777337 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 64/133] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:31.794579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.843375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd87f10-407e-4e07-8c13-ac21aeaff5c9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.936489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.938143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.938634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.939109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.955105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.955105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.955930 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 70/134] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:31.965095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.075526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.103178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7683bf-ef19-495b-acd4-93806122f91e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.187302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.188761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.189255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.189740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/a53dae70db28467caf7de0ef4bf03539/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.198816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, user_id=a53dae70db28467caf7de0ef4bf03539, role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.210106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.265369 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 65/135] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:31 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/a53dae70db28467caf7de0ef4bf03539/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:32.299209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248df7c6-21b9-411e-8c2e-84b24319f171 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.388897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.390510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.390997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.391479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] PATH_INFO: `/v3/projects/90508332447c40769ff82768dc67343f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.393887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] RBAC: Authorizing `identity:get_project(project_id=90508332447c40769ff82768dc67343f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.397041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ceebd6-dceb-46c6-b16d-922cdaee6ccf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.400713 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 71/136] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/projects/90508332447c40769ff82768dc67343f => generated 312 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:32.409834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.670475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eae7c-456e-4363-b048-3db46f2629fc None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.750016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.751484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.751994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.752483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] PATH_INFO: `/v3/projects/90508332447c40769ff82768dc67343f/users/a53dae70db28467caf7de0ef4bf03539/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.760010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] RBAC: Authorizing `identity:create_grant(project_id=90508332447c40769ff82768dc67343f, user_id=a53dae70db28467caf7de0ef4bf03539, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.762787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad05c22-47d2-41e0-9183-2889dfc13253 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.795283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 66/137] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:32 2022] PUT /identity/v3/projects/90508332447c40769ff82768dc67343f/users/a53dae70db28467caf7de0ef4bf03539/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:35:33.597005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431f9d-4b04-4fee-9a3e-2edda28c8e76 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.597839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431f9d-4b04-4fee-9a3e-2edda28c8e76 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.597967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431f9d-4b04-4fee-9a3e-2edda28c8e76 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.600480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 72/138] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:33.610009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.610805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.610932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.650582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:33.652895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:33.671933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.782060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:33.850872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba431f9d-4b04-4fee-9a3e-2edda28c8e76 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.856076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.116522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba431f9d-4b04-4fee-9a3e-2edda28c8e76 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.191455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.192859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.193360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.193856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.218696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-aec5afcd-0fec-4c34-8642-3fa69dd609ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:34.234378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:34.236085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:34.237543 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:34.245692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.389554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54e9a5-cf3e-4361-940c-d462dba7f548 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.430072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7bdf5-2737-42af-92b9-d84909776471 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.430532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7bdf5-2737-42af-92b9-d84909776471 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.431020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7bdf5-2737-42af-92b9-d84909776471 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.433840 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 74/141] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:34.439180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.439919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.440212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.440502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.441739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:34.442126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.443922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.446204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.446700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.447190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.455137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 68/142] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.464302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.478927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.516550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:34.518670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:34.691907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.739548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348b23b-1e9d-40c2-8eca-f0f4cbc541dd None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.751551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 75/143] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:34.835838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.864877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.866497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.867002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.867485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] PATH_INFO: `/v3/users/6a435d18d74943c3a8e7cee442315d79` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.873096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] RBAC: Authorizing `identity:get_user(user_id=6a435d18d74943c3a8e7cee442315d79)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.875967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.879353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 69/144] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/users/6a435d18d74943c3a8e7cee442315d79 => generated 247 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.889489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:35.094318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:35.102932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07f27e-cc88-4d75-95a3-cbacb36089c8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:35.195488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9b668-7632-4af7-96f5-0e44786afbdb None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:35.212469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:35.213314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.213607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.213889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.215306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:35.216890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:35.219248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 76/145] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:35.227251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:35.309567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:35.311154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.311994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.312728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.404795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:35.473140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0bd4e-b400-4c6e-9b71-da4ea35b71d8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:35.537375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:35.538179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.538467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.538741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.539494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:35.541053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ccd6-349a-4418-a6d6-88ded34feb69 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:35.587066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:35.595648 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 77/146] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:35 2022] POST /identity/v3/users => generated 283 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:35.598225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab5a3-544f-47f3-84a7-76ee9d292845 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:35.745252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595510b-18b0-4484-9974-e1574907331d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.745758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595510b-18b0-4484-9974-e1574907331d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.745829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595510b-18b0-4484-9974-e1574907331d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.747195 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 78/147] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:35.757125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea607a-af6b-487d-b617-0127fe60da49 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.757503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea607a-af6b-487d-b617-0127fe60da49 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.757713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea607a-af6b-487d-b617-0127fe60da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.776179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:35.809076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c0ea607a-af6b-487d-b617-0127fe60da49 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:35.810491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c0ea607a-af6b-487d-b617-0127fe60da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:35.845907 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 70/148] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 958 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:35.848574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30e3d-a6c1-488e-b460-cdd3d843d5d6 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.849072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30e3d-a6c1-488e-b460-cdd3d843d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.849550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30e3d-a6c1-488e-b460-cdd3d843d5d6 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.852915 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 71/149] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:35.854438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30e3d-a6c1-488e-b460-cdd3d843d5d6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.024873 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 79/150] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:36.026174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.026806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.027087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.039249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30e3d-a6c1-488e-b460-cdd3d843d5d6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.060258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:36.061470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:36.109106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.109998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.110287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.110552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.111811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.113595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:36.115908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 72/151] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:35 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:36.116747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.148631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.176011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.200784 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 80/152] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:36.202108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.257276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa6ee-e887-4609-bdf9-568eda58345d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.319686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.320487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.320771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.321051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.334403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:36.343471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:36.345184 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:36.346543 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 73/153] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:36.349723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.452206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86136b5d-eec5-47b6-964f-ffae303b8ddd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.503159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.503992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.504472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.504936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.505981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=6a435d18d74943c3a8e7cee442315d79) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:36.506299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.507897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:36.523490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 81/154] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/role_assignments?user.id=6a435d18d74943c3a8e7cee442315d79&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:36.525326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.568131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.575529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc263-7af5-4783-92b4-475cf5b395c4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.655794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.699045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.700441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.700907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.701782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.748696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:36.764692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:36.766628 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:36.768141 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 74/155] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:36.779915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.836336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103a707-40fc-4155-9423-9744d6a97d76 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.981896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.982957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.983433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.983923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.985343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:36.985868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.988546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.028396 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 82/156] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:37.041117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:37.079228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8761c4d-1ba4-46c9-9277-35147ba8739f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.146829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.147438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.147860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.148144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.148943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:37.149266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:37.151947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.167216 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 75/157] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:37.174053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:37.232090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:37.267099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b04a3-ab25-431b-8606-8cd1b0bdd632 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.271638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:37.360400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.361713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.362220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.362685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] PATH_INFO: `/v3/users/3da36e24391c46c092a75c6a3d93ba02` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.366530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] RBAC: Authorizing `identity:get_user(user_id=3da36e24391c46c092a75c6a3d93ba02)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:37.368429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.372035 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 83/158] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:37 2022] GET /identity/v3/users/3da36e24391c46c092a75c6a3d93ba02 => generated 289 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:37.390256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:37.421610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ade30a-fbb5-4a8c-888e-37fcd5361fcf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.500490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.502097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.504036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.505049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.508227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:37.510276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.517328 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 76/159] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:37 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:37.522791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:37.606906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a207e-5318-47c7-b2e5-87e6a507f97d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.684040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.685340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.685880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.686436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.687939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:37.689713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43549fa-85d2-4708-9b20-adc1bcfaf421 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.692713 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 84/160] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:37 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:37.694438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc562-0407-409b-87b7-c040f720dd35 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.694933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc562-0407-409b-87b7-c040f720dd35 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.695452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc562-0407-409b-87b7-c040f720dd35 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.697101 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 85/161] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:37.698430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837ae7-426c-4ddf-a73a-45215f483115 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.699172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837ae7-426c-4ddf-a73a-45215f483115 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.699739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b837ae7-426c-4ddf-a73a-45215f483115 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.701274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 86/162] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:37.704957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.705542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.706009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.734344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:37.736384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:37.764706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:37.778194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19689-20a5-4e57-8850-c2636772938c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.802405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:37.876386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.877636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.878119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.878629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.914029 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 87/163] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:37.914799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.042500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:38.044191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9c53d-1994-44cc-97b0-6cff595b3bdb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:38.161512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc673b9-ddba-427b-a8ee-b96cec27e881 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:38.185739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:38.220270 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 77/164] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:38.221355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.221636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.221915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.247657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:38.255269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.256259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.257035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/3da36e24391c46c092a75c6a3d93ba02/roles/3c3fb75f2d874cd5856bea2f44fc1786` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.264424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, user_id=3da36e24391c46c092a75c6a3d93ba02, role_id=3c3fb75f2d874cd5856bea2f44fc1786)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:38.265963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:38.275760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:38.278928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:38.301929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 88/165] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:37 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/users/3da36e24391c46c092a75c6a3d93ba02/roles/3c3fb75f2d874cd5856bea2f44fc1786 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:38.302769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.391944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:38.495826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 78/166] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:38.496792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.638130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5e52-554d-47cb-987f-fbb503c8af20 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:38.721362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62700a-1f48-4cca-bfe6-fada138ff059 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:38.722114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:38.723305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.723937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.724223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.756930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:38.772195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:38.775090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:38.777365 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 89/167] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:38.781296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.808107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:38.808107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.812643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.812643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.813269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:38.816418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:38.820303 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 79/168] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:38.824043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.981561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.008355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcfa7-159f-44b6-a0f0-fef723dad9eb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.034101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf18119-4c73-478e-ad7e-e34f14d13cdb None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.079795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.080639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.080914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.081193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.103366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:39.111858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:39.114370 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:39.117390 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:39.120077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.120358 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 90/169] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:39.120690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.120690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.120690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.121332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.121563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:39.121563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.121563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.133479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 80/170] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.136595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.249160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.323788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f595a-bf31-4ffa-94bd-6cb5312fd240 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.340301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e59b9-06f5-44b4-8e6e-e06e9660f800 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.392302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.392988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.393267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.393535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.394496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:39.394814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.396337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.403262 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 91/171] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.405246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.406408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.406901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.407395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.408606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:39.409159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.412068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.412360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.429645 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 81/172] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.437494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.444909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.637295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d4f9e-eaf0-467d-a9d5-9d83f401fd46 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.676697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8b26-1121-436a-8b16-b31a465f4916 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.723960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.757982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.759776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.760502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.762531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.764715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.775763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.778870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 92/173] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.784523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.809716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.811465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.812325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.813110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] PATH_INFO: `/v3/users/a53dae70db28467caf7de0ef4bf03539` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.819542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] RBAC: Authorizing `identity:get_user(user_id=a53dae70db28467caf7de0ef4bf03539)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.823047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.827074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 82/174] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/users/a53dae70db28467caf7de0ef4bf03539 => generated 275 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.836858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.995719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.058606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe189ce6-48d4-4eca-90a7-d839c1e2c489 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.101372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bbc61-423b-4b41-9864-0693dddbda3a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.160684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.164475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.167677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.168463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.221057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.223250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.224069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.227477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.322056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.348567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.349791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.350125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.351804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.468514 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 83/175] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:40.474960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.524039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.568362 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 93/176] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:40.577617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.619810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.642224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5aa9-3a40-4762-887f-82078d6ec585 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.685744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.686942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.687324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.687734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.689440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.691341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac110b1-d502-47e1-b70c-3f2fd384622b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.694676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 84/177] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:40.699562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9650-c64e-47ce-ae22-330558eded46 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.699562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9650-c64e-47ce-ae22-330558eded46 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.699562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9650-c64e-47ce-ae22-330558eded46 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.699562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 85/178] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:40.706276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.707004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.707004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.732034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:40.733289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:40.839745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 86/179] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:40.840432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.863009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8ae3-a645-4711-bbf8-99de445efa15 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.934683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.935612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.935899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.936182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] PATH_INFO: `/v3/projects/90508332447c40769ff82768dc67343f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.937528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=90508332447c40769ff82768dc67343f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.939083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732a977-6214-4738-8c22-d84028661ea6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.941027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 94/180] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/projects/90508332447c40769ff82768dc67343f => generated 312 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:40.942380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148c32a-0713-4929-9cfa-9dee3773b589 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.942666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148c32a-0713-4929-9cfa-9dee3773b589 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.942946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148c32a-0713-4929-9cfa-9dee3773b589 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.943328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.944903 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 95/181] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:40.950203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148c32a-0713-4929-9cfa-9dee3773b589 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.980987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b812d87-42b4-44ff-82e9-44ddc5c5548e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.014286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.039901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.040599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.040880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.041153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.042023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:41.042343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.044026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851e7ac-7495-4af8-a290-1baefcb52b5a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.051476 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 87/182] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.052866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a3-2ae5-48d5-bfe6-937d628dcee9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.053154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a3-2ae5-48d5-bfe6-937d628dcee9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.053429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dc8a3-2ae5-48d5-bfe6-937d628dcee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.072877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7f7dc8a3-2ae5-48d5-bfe6-937d628dcee9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:41.074182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7f7dc8a3-2ae5-48d5-bfe6-937d628dcee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:41.082576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148c32a-0713-4929-9cfa-9dee3773b589 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.124702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.125488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.125774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.126053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.139808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:41.148559 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:41.149509 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:41.150299 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 96/183] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:41.156268 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 88/184] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:41.156855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.165448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92198e8-a48c-4fa4-bb38-1f7ea9ab319d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.166083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92198e8-a48c-4fa4-bb38-1f7ea9ab319d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.166558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92198e8-a48c-4fa4-bb38-1f7ea9ab319d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.168627 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 89/185] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:41.174120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92198e8-a48c-4fa4-bb38-1f7ea9ab319d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.304135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ef62-5705-402f-afbc-512fb817315a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.324008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.352777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.353828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.354399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.354870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.356004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.363969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=90508332447c40769ff82768dc67343f, user.id=a53dae70db28467caf7de0ef4bf03539) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:41.364717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.366497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126795-dbab-4d9f-b2ac-7609766d032b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.380497 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 97/186] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/role_assignments?user.id=a53dae70db28467caf7de0ef4bf03539&scope.project.id=90508332447c40769ff82768dc67343f&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.382766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.383605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.384356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.396761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92198e8-a48c-4fa4-bb38-1f7ea9ab319d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.413678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:41.416174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:41.475749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.476810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.477261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.477729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.479141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:41.479751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.482553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.500542 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 90/187] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.501499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.586001 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 98/188] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:41.589133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.733695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1aada-80d0-4672-8f99-7f5d91998004 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.763069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ded3e-1d50-46bd-9d6c-1a25052077ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.765532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.804411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.805725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.806164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.806582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.808849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.811349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.812006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.812571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.812852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.813120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.815048 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 91/189] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.816181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.820510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.836110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.837941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4c9b4-89ff-4f8a-9914-8b9c07ce0d58 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.840020 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 99/190] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.843801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77d83-b261-45c5-892d-b07fb314aada None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.844383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77d83-b261-45c5-892d-b07fb314aada None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.844909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77d83-b261-45c5-892d-b07fb314aada None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.847617 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 100/191] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:41.848899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77d83-b261-45c5-892d-b07fb314aada None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.941768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee5c8-ef66-4254-930e-d0b1848d4e37 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.962647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77d83-b261-45c5-892d-b07fb314aada None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.980743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.981581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.981865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.982148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.994761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:42.000832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.001517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.001793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.002064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.002783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:42.003134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:42.005068 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:42.007237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:42.008644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236c4f0-a423-43a2-aefb-5e0bbeb49c94 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.008788 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 92/192] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:42.008788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.028325 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 101/193] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:41 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:42.029667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.029953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.030228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.062833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:42.065061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:42.086376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.113994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.186639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c07bd-9fd5-4d1e-bf29-333dc8c60da1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.201329 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 102/194] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:42.201329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.254182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.255247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.255746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.256193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.384296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.386854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.400708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b578e3-ffd5-46eb-8965-a37ee140e9f8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.473091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.474211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.474708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.475411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.477468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:42.478090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.480395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.481271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.499642 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 103/195] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:42.501780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.527873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.564503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 93/196] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:42.566385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.724134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378639ac-dc13-4265-920b-6c03e1b4e80f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.797847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23137d82-7696-406a-835c-d83bbcc43eee None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.798045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.799443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.799996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.800538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.820188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:42.835975 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:42.836976 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:42.837836 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:42.840173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 104/197] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:42.841572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.885978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.887770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.888317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.888779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.891023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.894059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.897573 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 94/198] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:42.903899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.963094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.997017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:43.077547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171699-1ea4-46b8-b142-288b61930cb7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.110104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72508f-a6ef-4e77-8c99-495e54406092 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.144348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.146343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.147087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.147839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.150455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.154003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.158036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 105/199] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.159768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.189879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.191297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.191907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.192445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.194337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:43.194550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.197206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.214436 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 95/200] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.220758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.336582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:43.349332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add87e-9b30-4215-b3df-587151ed33f3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.361366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587b6d-46b8-4038-ace5-bb95894fd257 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.398044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.398732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.399019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.399292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.400216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=63f1db70c8574344bdb5069f6a6acf7e) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:43.400529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.402400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.414417 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 96/201] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/role_assignments?user.id=63f1db70c8574344bdb5069f6a6acf7e&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.415490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.432794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.433904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.434379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.434856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.442112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:43.584452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.587674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.722672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7685a2-ed1b-4150-b13f-409524fc56e8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.774088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.775136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.775431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.775745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] PATH_INFO: `/v3/users/3da36e24391c46c092a75c6a3d93ba02` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.784681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] RBAC: Authorizing `identity:get_user(user_id=3da36e24391c46c092a75c6a3d93ba02)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.786396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.789338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 97/202] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/users/3da36e24391c46c092a75c6a3d93ba02 => generated 289 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.796478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.798285 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 106/203] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:43.807947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.848915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:43.886264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.010809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d234cd-5f77-4268-b2b8-87bf0f7c7b2d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.017713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55345c08-7a2b-4ed2-8ebb-6af1122ce904 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.059244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.060178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.060466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.060746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.062036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.063563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.065746 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 107/204] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:44.076712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.113660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.114266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.114558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.114843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.276842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aaee8-c66f-406c-b620-7a9ba28e4989 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.280544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.286112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.288877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.334340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.340605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.341607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.342255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.342676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.343708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=63f1db70c8574344bdb5069f6a6acf7e) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:44.344605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.346671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.368686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 108/205] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/role_assignments?user.id=63f1db70c8574344bdb5069f6a6acf7e&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:44.548139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 98/206] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:44.555128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.764407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690796f-3a9d-411f-958b-dbe2cb3f6b1e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.826590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.828177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.828626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.829072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.831331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.834116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39066e-f23e-45cd-bbf1-eb8fc82575f0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.837381 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 109/207] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:44.844503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.040294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8f85d-3437-4a7e-b0f8-d6fda829af44 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.089476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.108176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.109994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.110475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.110955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.112555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b, user.id=3da36e24391c46c092a75c6a3d93ba02) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:45.113270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.116069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912e3cc-70da-4949-94ba-23c0f140f074 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.128107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 99/208] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/role_assignments?user.id=3da36e24391c46c092a75c6a3d93ba02&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:45.155687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35903f56-9c5f-4641-ba38-8b95dad8113a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.155977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35903f56-9c5f-4641-ba38-8b95dad8113a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.156255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35903f56-9c5f-4641-ba38-8b95dad8113a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.157984 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 110/209] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:45.165551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.166042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.166529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.195926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:45.198059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:45.320750 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 100/210] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:45.397140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35903f56-9c5f-4641-ba38-8b95dad8113a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.485892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.612928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35903f56-9c5f-4641-ba38-8b95dad8113a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.677914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.679202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.679682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.680146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.700645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c350a2c8-e9c7-492f-b14b-d5a7691bb66f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:45.716121 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:45.717108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:45.717913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:45.718530 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 111/211] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:45.727755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.890089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d9b8-481c-420c-8cb7-a3980e864310 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.890404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d9b8-481c-420c-8cb7-a3980e864310 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.891149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d9b8-481c-420c-8cb7-a3980e864310 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.894517 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 112/212] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:45.902604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.903266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.903867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.928405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:45.930967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:45.936681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386b3a-f61e-4403-a5e0-427b20da667a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.970650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.001810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.002997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.003491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.004016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.005450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:46.006004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.008811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.025634 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 101/213] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.032134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.039163 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 113/214] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:46.088846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.125930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.179077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dd3d4-406c-40dd-9c96-a466f2d1dcf0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.234648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.235937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.236428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.236848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] PATH_INFO: `/v3/users/677ded1f13184922a78ef382d42f3124` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.238959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05c58-7501-4eec-8cd7-05b1f275a19b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.253506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] RBAC: Authorizing `identity:get_user(user_id=677ded1f13184922a78ef382d42f3124)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.255293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.257534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 102/215] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/users/677ded1f13184922a78ef382d42f3124 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:46.264408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.286909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.288259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.288259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.288556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.290122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.292855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.295098 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 114/216] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.301154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.352973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.447381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.457584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399e3-037d-4561-a176-d720c705bf93 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.461693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d58af-1caf-4f50-938d-ddcc7aff6dda None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.505378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.506988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.507496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.508632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.510358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.515139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.518424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.520143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.520605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.521024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.563685 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 115/217] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:46 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:46.637475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.639379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.693721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.788833 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 103/218] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:46.796977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.916357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563580bd-49c9-47ec-9fc7-7239c316544b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.957155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.958065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.958349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.958628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.959996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.961789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8feaf8-e97b-498d-bb12-9655ff681862 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.964120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 116/219] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.970823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.107625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556e871-c4bc-4498-a608-078a9d9c3fde None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.145269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b2e-1c12-4c7d-9d6d-bd1c0a724e9a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.145579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b2e-1c12-4c7d-9d6d-bd1c0a724e9a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.145907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b2e-1c12-4c7d-9d6d-bd1c0a724e9a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.151648 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 117/220] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:47.151869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.152046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.152747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.152747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.154087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e4d7-4f1b-4141-8c79-be45badeae19 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.154377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e4d7-4f1b-4141-8c79-be45badeae19 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.154653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e4d7-4f1b-4141-8c79-be45badeae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.167677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=677ded1f13184922a78ef382d42f3124) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:47.168091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.169520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.177035 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 104/221] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/role_assignments?user.id=677ded1f13184922a78ef382d42f3124&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:47.192235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4f37e4d7-4f1b-4141-8c79-be45badeae19 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:47.193525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4f37e4d7-4f1b-4141-8c79-be45badeae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:47.210450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.298856 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 118/222] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:47.342037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.345453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.534474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844aa4-fe27-4987-a5d8-bdd69a3f2bf0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.536836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732979c-989e-4ee8-b422-cf6b1478bf83 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.537341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732979c-989e-4ee8-b422-cf6b1478bf83 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.537831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732979c-989e-4ee8-b422-cf6b1478bf83 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.544229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 119/223] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:47.552995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.553489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.554809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.578680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:47.580464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:47.607111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.608359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.608858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.609332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.634036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:47.642342 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:47.643282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:47.644405 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:47.647653 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 105/224] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:47.656880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.672952 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 120/225] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:47.693442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.771562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.791368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.818056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877afbc1-987c-4657-848c-5ba8f66a61b8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.860203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.861509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.861799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.862075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.864560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc02d8-4d7e-4450-a450-1803068cac33 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.877642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:47.886788 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:47.887744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:47.888549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 121/226] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:47.900118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.941183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.941963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.942260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.942541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.943322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:47.945205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.947625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.970769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 106/227] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:47.975930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.119456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44f9a-0fa3-4b6a-a6cf-293b42a74161 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.187712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.188401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.188679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.188951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.189729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:48.190034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.191634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.199522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3849-86e2-44e1-a384-0225146dbd2a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.210517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:48.218536 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 122/228] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:48.228799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.266205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:48.290472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.291373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.291682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.291956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.295307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.296809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.306919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 107/229] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:48.311344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.430516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1b28d-cef8-415b-b853-6cd8dc4877fc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.491641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.492821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.493280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.493719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.495630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.497406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.499323 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 123/230] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:48 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:48.506795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.526919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7c8f-f100-4523-818e-621159c27d47 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.606359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.608426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.608919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.609413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.612422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.614652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.618704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 108/231] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:48 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:48.628795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.670864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:48.673603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63155ab-346f-4e90-a27a-9975ea91698f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.721956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.726433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.726999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.730413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.732733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.735680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.745056 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 124/232] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:48 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:48.752114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:48.805341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:48.894312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8c3a-0ca8-45f4-9af9-c2d05183d07a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.914115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387a2b-9da0-4057-b77c-af651667c3ed None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:48.955552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.956978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.957460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.957928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/63f1db70c8574344bdb5069f6a6acf7e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.961979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, user_id=63f1db70c8574344bdb5069f6a6acf7e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.965103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d9a0-e810-48e7-b301-9005dd0d5a1a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:48.982374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:48.983901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:48.984364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:48.984837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/63f1db70c8574344bdb5069f6a6acf7e/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:48.987664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, user_id=63f1db70c8574344bdb5069f6a6acf7e, role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:48.997956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 109/233] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:48 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/63f1db70c8574344bdb5069f6a6acf7e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:49.003650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30178fd2-7a34-4a6a-ae0d-a6ab007ff0cf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:49.014145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:49.040834 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 125/234] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:48 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/63f1db70c8574344bdb5069f6a6acf7e/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:49.714474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aec06-8d33-4715-9465-1aa9376e844d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:49.715063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aec06-8d33-4715-9465-1aa9376e844d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:49.715712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aec06-8d33-4715-9465-1aa9376e844d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:49.718761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 110/235] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:49.725692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:49.726242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:49.726664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:49.773493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:49.775471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:49.823587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f26-1eae-4708-bcd7-b46c75466129 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:49.824127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f26-1eae-4708-bcd7-b46c75466129 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:49.824529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733f26-1eae-4708-bcd7-b46c75466129 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:49.827353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 111/236] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:49.846010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:49.846478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:49.846944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:49.891032 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 126/237] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:49.897814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:49.899835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:49.935891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.075522 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 112/238] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:50.181539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.217930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b557e-ced7-4035-b2a6-01b21048671b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.239722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:50.267316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:50.286762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:50.288088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.288546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.288980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.291103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:50.293877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ffcb5-3156-4f0a-ba4c-9782d4b34e9a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:50.297413 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 127/239] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:50.299738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4d29-005c-4b35-9d28-963906a261d3 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.300228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4d29-005c-4b35-9d28-963906a261d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.300702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4d29-005c-4b35-9d28-963906a261d3 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.304684 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 128/240] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:50.309780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4d29-005c-4b35-9d28-963906a261d3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.313999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb3fe3-d203-41cf-a66f-3e64d48d3159 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.358909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:50.360476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.360985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.361463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.387360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-81283c82-4844-49d1-8609-c5bbbeed6372 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:50.400911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:50.402859 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:50.404305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:50.408312 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 113/241] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:50.418327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.419194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.419972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.448947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:50.451432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:50.466057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4d29-005c-4b35-9d28-963906a261d3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.511750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:50.512502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.512781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.513109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.513859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:50.515650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:50.551556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 129/242] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:50 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:50.551556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.619696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:50.625990 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 114/243] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:50.679129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.689054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036773f-3447-4142-b01f-3e35a4b4e894 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.730929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:50.732007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.732007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.732501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.733252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:50.733567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:50.735044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:50.745378 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 130/244] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:50.751543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:50.839305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:50.873350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa79d5-725b-4606-a0f2-4bd5fabfd2fc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.889015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:50.913710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:50.914618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:50.914908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:50.915186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] PATH_INFO: `/v3/users/19ecd6d8217d4b36b6f68f46c780b656` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:50.953802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f853a-04d4-4bc1-aab1-0ec2a42a4b64 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:50.957392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] RBAC: Authorizing `identity:get_user(user_id=19ecd6d8217d4b36b6f68f46c780b656)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:50.961138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:50.965632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 131/245] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:50 2022] GET /identity/v3/users/19ecd6d8217d4b36b6f68f46c780b656 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:50.975002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.003147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.004417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.004750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.005086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.017454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:51.027757 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:51.029508 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:51.031094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 115/246] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:51.036305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.158673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.163891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbacd5-0b8d-4379-b173-92c245b2f8e5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.182337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2ffd-fb33-4f54-9018-9c431cf271e4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.200303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.200985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.201267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.201548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.202309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:51.202615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.204071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.213184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 116/247] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:51.219248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.222978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.223771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.224052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.224324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.273218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.306464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.308222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.343445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb59bdf-8fc5-417c-bc24-ada18c7a66ad None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.450826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.452957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.453765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.454532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] PATH_INFO: `/v3/users/677ded1f13184922a78ef382d42f3124` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.460796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] RBAC: Authorizing `identity:get_user(user_id=677ded1f13184922a78ef382d42f3124)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.463947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.478648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 117/248] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/users/677ded1f13184922a78ef382d42f3124 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:51.482718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.539341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 132/249] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:51.545339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.586536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.690771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.798493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46429-359c-4689-bfe7-f9ce5753391a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.820245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd306-7575-4421-92f3-492b5edee857 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.907644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.909715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.910223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.910705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.913815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.916902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.920566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 133/250] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:51.932334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.933229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.933515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.933792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.935449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.936495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.936977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.938955 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 118/251] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:51.948762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.131362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a055ce-34cc-49a8-9e4a-7a3a05b6ee07 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.180214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.180925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.181209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.181488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.182399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=19ecd6d8217d4b36b6f68f46c780b656) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:52.182715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.185969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148a5c6-2b25-4bdb-a332-dfe37c5fe81f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.201235 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 134/252] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/role_assignments?user.id=19ecd6d8217d4b36b6f68f46c780b656&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:52.214081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fd18f-b604-48d3-aa93-353a5e28ede7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.216309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:52.260743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.261715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.262004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.262287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/677ded1f13184922a78ef382d42f3124/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.264693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, user_id=677ded1f13184922a78ef382d42f3124, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.266291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37377002-753b-421c-94f6-c54a070c0a6b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.291764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 119/253] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:51 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/677ded1f13184922a78ef382d42f3124/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:35:52.350848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de0cb-2733-4528-9ce2-4f68c734cd03 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.351197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de0cb-2733-4528-9ce2-4f68c734cd03 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.351418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de0cb-2733-4528-9ce2-4f68c734cd03 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.353199 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 135/254] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:52.366290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.367033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.367582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.400690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:52.402794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:52.509015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 120/255] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:52.551230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de0cb-2733-4528-9ce2-4f68c734cd03 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.554824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:52.688494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de0cb-2733-4528-9ce2-4f68c734cd03 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.761482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.762936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.763423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.763951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.788834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-dc49da71-7ce7-47a4-a7ab-003478b92ce0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:52.805526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:52.806944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:52.807814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 136/256] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:52.814982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.883294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2529-b952-4883-842f-829ef034d282 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.885793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2529-b952-4883-842f-829ef034d282 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.886667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2529-b952-4883-842f-829ef034d282 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.890836 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 137/257] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:52.904161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.905021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.905787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.944308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:52.947255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:53.002309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.035148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf3e8-50ca-4e13-ab4b-c81d59506d7b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.103139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.126005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.126732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.127088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.127300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.128397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:53.128587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.130017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.142335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 138/258] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:53.153162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 121/259] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:53.162703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.241154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.308677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986440b9-12cb-4aeb-9242-ade4d7e60aa5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.396636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.397821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.398264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.398690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.404408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.406344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.408333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 139/260] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:53.431728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.447540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b35dd8-3b5e-4ceb-93c0-30c3d8fee2bf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.494927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.496089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.496536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.496951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.517554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:53.535601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:53.535833 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:53.536887 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:53.537704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 122/261] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:53.541858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.572535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.622000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b138377-426c-4ee1-b962-7945e3739a13 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.692256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.693426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.693919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.694394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.780656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850772b-41d6-4255-ae6b-812df66e1467 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.845437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.848998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.876448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.877228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.877527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.877876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.878762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:53.879076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.880626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.903541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 123/262] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:53.912698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.991566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:54.053191 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 140/263] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:54.059470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:54.138613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:54.202602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b18b78-c7c8-4575-b491-92dfea58900c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:54.234856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c571a7-84c8-45ab-a68d-2e7fa9328613 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:54.279004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:54.279891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:54.280178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:54.280442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] PATH_INFO: `/v3/users/63f1db70c8574344bdb5069f6a6acf7e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:54.284598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] RBAC: Authorizing `identity:get_user(user_id=63f1db70c8574344bdb5069f6a6acf7e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:54.286677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:54.289135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 124/264] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/users/63f1db70c8574344bdb5069f6a6acf7e => generated 283 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:54.295160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:54.317240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:54.319678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:54.320745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:54.321566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:54.328341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:54.332072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:54.340546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 141/265] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:54 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:54.347419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:54.440079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:54.582627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a254-b129-4924-a4b4-bb80eaaf530b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:54.617735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c8c1-95de-42fa-a929-1424e1083dfe None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:54.666306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:54.666994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:54.667279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:54.667596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:54.668464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=63f1db70c8574344bdb5069f6a6acf7e) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:54.668779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:54.670410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:54.677338 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 142/266] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:54 2022] GET /identity/v3/role_assignments?user.id=63f1db70c8574344bdb5069f6a6acf7e&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:54.705632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:54.707656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:54.708513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:54.709358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:54.740884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:54.889288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:54.892576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:55.108604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 125/267] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:55.114816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:55.261736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:55.277670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea5858-2365-4c9b-919c-df5cb6d2d6d0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:55.319283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:55.320251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.320531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.320806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.327222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:55.328857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d2d3e-fd92-4ed9-bb17-88b3d5bc92c0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:55.331229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 143/268] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:55 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:55.337497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:55.395529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:55.546064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939aaf-35e4-4267-be20-c52732723d6f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:55.638169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:55.639794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.640543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.641278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.643162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=63f1db70c8574344bdb5069f6a6acf7e) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:55.644037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:55.646947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107490d3-dd9b-459e-9646-f6c9f768b631 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:55.664592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 126/269] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:55 2022] GET /identity/v3/role_assignments?user.id=63f1db70c8574344bdb5069f6a6acf7e&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.032963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9669-e8c3-420d-b9dc-4b582b11fc61 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.033258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9669-e8c3-420d-b9dc-4b582b11fc61 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.033644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9669-e8c3-420d-b9dc-4b582b11fc61 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.035634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 144/270] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:56.042128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e64f-21fa-407e-9d29-f5d03ac7091b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.043052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e64f-21fa-407e-9d29-f5d03ac7091b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.043882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e64f-21fa-407e-9d29-f5d03ac7091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.051718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55677eb-edfe-4f8b-976b-262cb8f90f4e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.052115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55677eb-edfe-4f8b-976b-262cb8f90f4e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.052333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55677eb-edfe-4f8b-976b-262cb8f90f4e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.054322 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 145/271] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:56.060666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2914-dc46-4242-84bd-7279ba0d63c0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.060947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2914-dc46-4242-84bd-7279ba0d63c0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.061281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e2914-dc46-4242-84bd-7279ba0d63c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.080016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-021e2914-dc46-4242-84bd-7279ba0d63c0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:56.081433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-021e2914-dc46-4242-84bd-7279ba0d63c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:56.092000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-34e4e64f-21fa-407e-9d29-f5d03ac7091b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:56.094522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34e4e64f-21fa-407e-9d29-f5d03ac7091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:56.179088 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 146/272] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:56.211189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca553-203b-4f7f-9403-fbe1409c7e18 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.211992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca553-203b-4f7f-9403-fbe1409c7e18 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.212420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca553-203b-4f7f-9403-fbe1409c7e18 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.215094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 147/273] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:56.220356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca553-203b-4f7f-9403-fbe1409c7e18 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.247619 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 127/274] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:56.249349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.249809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.250240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.274834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:56.277077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:56.318809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.338636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.351627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca553-203b-4f7f-9403-fbe1409c7e18 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.386768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 128/275] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:56.387590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.403308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.404623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.405109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.405697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.407335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.409121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.411426 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 148/276] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.423557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.525178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6804240-5a71-4f72-8799-9db72db57c4e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.540309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099bdb-d90f-436e-9e9d-f192879b9ccb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.561598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.562412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.562695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.562978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.574688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:56.578680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.579609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.580056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.580444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.581333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:56.582989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.584463 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:56.585367 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:56.586115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64db3a7-af37-40da-89e3-36bb46c2d74d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.586196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 129/277] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:56.587692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.607339 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 149/278] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:56 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:56.613812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e0c9-d9ef-471f-b922-aac0826ee762 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.614626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e0c9-d9ef-471f-b922-aac0826ee762 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.615072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e0c9-d9ef-471f-b922-aac0826ee762 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.617164 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 150/279] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:56.618069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e0c9-d9ef-471f-b922-aac0826ee762 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.632311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.642087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.744776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a972c81-2cc6-4380-b0fe-d461eb5cbff1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.771071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e0c9-d9ef-471f-b922-aac0826ee762 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.801286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.802676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.803120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.803577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.821527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:56.831041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-96d63ba4-d079-415f-a183-db6b415af0ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:56.831275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.832351 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:35:56.833135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 130/280] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:56.835034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.835662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.836073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.837596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:56.838141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.842325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.842508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.842508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.842508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.857779 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 151/281] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.858677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.868945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:56.869533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:56.976753 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 131/282] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:56.977913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.981650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.018672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.026688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76328c30-7b36-41a1-9178-02da6b93b091 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.107737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.107737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.107737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.107737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.108346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:57.108465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.111047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.126850 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 152/283] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.128064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.176770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a532d3-9527-4c34-88ad-470ce7700bbd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.226226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.227131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.227408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.227712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] PATH_INFO: `/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.248803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] RBAC: Authorizing `identity:get_user(user_id=41a011153d3c4abfbbf3ee6dbe3d43fd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.250936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.253971 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 132/284] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd => generated 293 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.256322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.263604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739317-ab68-4aee-b807-6efc50a1a10d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.304821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.305661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.305945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.306219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.315773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.323138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:57.332948 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:57.334729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 153/285] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:57.336314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.370215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.418372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b317ce-d8f2-4133-9d5b-f6160628a60f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.466818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.468026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.468316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.468598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] PATH_INFO: `/v3/users/19ecd6d8217d4b36b6f68f46c780b656` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.470580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] RBAC: Authorizing `identity:get_user(user_id=19ecd6d8217d4b36b6f68f46c780b656)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.472453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.478970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 133/286] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/users/19ecd6d8217d4b36b6f68f46c780b656 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.478970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.489471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bd4c0-4f7d-4065-ae35-b5f7d0477a16 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.533885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.534597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.534876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.535151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.536050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, user.id=41a011153d3c4abfbbf3ee6dbe3d43fd, scope.system=all) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:57.536357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.538183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.551560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 154/287] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/role_assignments?user.id=41a011153d3c4abfbbf3ee6dbe3d43fd&scope.system=all&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.551560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.675588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.719208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55338d-e708-4dc0-aa24-e5d64923e9cd None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.723070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7903e-62de-4ba8-83db-fa25578f52a9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.764004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.764914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.765194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.765467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.766808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.768663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.770667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 155/288] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.778305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.825936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.827106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.827626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.828109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.829726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:57.830290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.833605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.852485 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 134/289] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.860983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.868720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.933719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e374ec7-9469-4ed0-928c-dad27573b27f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.995260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.008115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.009051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.009384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.009664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/19ecd6d8217d4b36b6f68f46c780b656/roles/3c3fb75f2d874cd5856bea2f44fc1786` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.014342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, user_id=19ecd6d8217d4b36b6f68f46c780b656, role_id=3c3fb75f2d874cd5856bea2f44fc1786)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.015860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.041483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 156/290] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:57 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/users/19ecd6d8217d4b36b6f68f46c780b656/roles/3c3fb75f2d874cd5856bea2f44fc1786 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:58.071162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28fab7-8f4d-4fdd-b0c3-d2e2bfbfaac3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.136818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.138395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.138891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.139383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] PATH_INFO: `/v3/users/677ded1f13184922a78ef382d42f3124` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.145212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=677ded1f13184922a78ef382d42f3124)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.148252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.152041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 135/291] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/users/677ded1f13184922a78ef382d42f3124 => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:58.158100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.349029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c34c7-fd88-408e-9db2-168b6b5e750c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.414195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.415540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.415972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.416470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.549812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.566471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.568059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.752013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 157/292] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:58.758390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.862803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.911777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b09bb-8b73-4167-8576-a0aed4306fe3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.967232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.968816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.969317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.969818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.976491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.978129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b00a94-bfc7-4242-a434-4500becfbda3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.980561 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 136/293] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:58.987470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.118793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.130037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899fde-35cb-4c55-8daa-f46cf52229dd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.169630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.170301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.170581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.170849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.171717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=677ded1f13184922a78ef382d42f3124) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.172023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.173487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ac8e7-a463-4478-ae93-74c673c1b2bc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.189988 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 158/294] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/role_assignments?user.id=677ded1f13184922a78ef382d42f3124&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.740163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1d8f-ca8b-412e-8bd7-b31050dd5f16 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.740550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1d8f-ca8b-412e-8bd7-b31050dd5f16 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.740724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1d8f-ca8b-412e-8bd7-b31050dd5f16 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.742521 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 137/295] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:59.749108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.749626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.749702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.768052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:59.769342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:59.854753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 159/296] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:59.880884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1d8f-ca8b-412e-8bd7-b31050dd5f16 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.030310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1d8f-ca8b-412e-8bd7-b31050dd5f16 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.084404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.085655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.086167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.086685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.100091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.104198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8f3c8668-a0bf-4834-a46e-d059e25e5dcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:00.121691 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:00.123121 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:00.124122 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:00.129890 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 138/297] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:00.138912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.154615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7b7c-3d28-4b54-99b6-563769bcbda3 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.155441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7b7c-3d28-4b54-99b6-563769bcbda3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.156054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d7b7c-3d28-4b54-99b6-563769bcbda3 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.158177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 139/298] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:00.165779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.166695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.167452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.191331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:00.194393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:00.280296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.312327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20226beb-8033-490e-a9b6-1ad76b46c6d5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.343371 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 140/299] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:00.372343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.373897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.374602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.375242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.376726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.377266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.379205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.390414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 160/300] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.396129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.402244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.522270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dd744-e89a-459e-a966-38ac24ec3e47 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.537234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf3c5-f2d5-4437-9d76-c386ba4ebc2f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.561332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.570307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.571205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.571706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.572201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] PATH_INFO: `/v3/users/aeabce3aec07451a9b14c2a458f8f844` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.582775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.583634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.583923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.584207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.585573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.587177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.588612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=aeabce3aec07451a9b14c2a458f8f844)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.589274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 161/301] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:00.590155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.594845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.596824 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 141/302] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/users/aeabce3aec07451a9b14c2a458f8f844 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.597998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.614157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.715784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbe351-e8cf-42e2-a656-572eeae1d9c9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.729967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74d1b-48f8-45b3-a316-3f4953d60318 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.756087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.757162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.757732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.758213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.759310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, user.id=aeabce3aec07451a9b14c2a458f8f844, scope.system=all) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.759876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.762917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14427f-ee73-4367-99f6-ab17cb452aac None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.775539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.775539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.775539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.775539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.776639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.776639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada075-6d87-4057-a1d3-33a1e8a607fc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.777822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 142/303] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/role_assignments?user.id=aeabce3aec07451a9b14c2a458f8f844&scope.system=all&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.797134 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 162/304] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Jun 4 20:36:00 2022] POST /identity/v3/groups => generated 229 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:00.909624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b589-8904-4e5b-954d-e8eb0183b29a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.910461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b589-8904-4e5b-954d-e8eb0183b29a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.910461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b589-8904-4e5b-954d-e8eb0183b29a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.911864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 143/305] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:00.921145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.921457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.921757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.955155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:00.959073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:01.092922 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 163/306] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:01.138012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b589-8904-4e5b-954d-e8eb0183b29a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.241225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.335215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b589-8904-4e5b-954d-e8eb0183b29a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.374828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.375679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.375962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.376231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.388526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b677a831-84ef-4473-ba80-c847654feefd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:01.397782 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:01.399625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:01.401537 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 144/307] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:01.414584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.420683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.481833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aaf94-0669-4f99-80ef-021a39fd6879 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.482311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aaf94-0669-4f99-80ef-021a39fd6879 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.482804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aaf94-0669-4f99-80ef-021a39fd6879 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.485430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 145/308] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:01.494865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.495298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.495767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.524719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:01.527066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:01.619476 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 146/309] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:01.625714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e5ba5-5934-4dce-b725-d7b466d20eb2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.662589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.667751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.669276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.670033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.670774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.672585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:01.673477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.676365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.692957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 164/310] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:01.705347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.713119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.794144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888df14-8dbb-41ba-af19-84b53d942285 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.840388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.841216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.841496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.841769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.847995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.855891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:01.864898 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:01.866795 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:01.868447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 147/311] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:01.875386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.916226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc3ca-0335-4bcf-a949-327f8fc1d3bd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.985148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.988139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.989069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.989835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] PATH_INFO: `/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.992663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] RBAC: Authorizing `identity:get_user(user_id=41a011153d3c4abfbbf3ee6dbe3d43fd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.996098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.008116 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 165/312] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:02.009770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.012057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.013336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5f977-afae-4b9b-a7b3-522ed7daf56f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.059308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.059928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.060201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.060483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.061271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:02.061578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.063789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.075196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 148/313] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:02.086498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.213109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466b4dc-df62-4b13-bdef-aa918b69fcdd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.213800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f814f-4ec7-4d5e-a19d-f6a3990362ba None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.250579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.251469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.251784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.252052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] PATH_INFO: `/v3/users/19ecd6d8217d4b36b6f68f46c780b656` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.253370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] RBAC: Authorizing `identity:get_user(user_id=19ecd6d8217d4b36b6f68f46c780b656)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.255126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.263539 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 149/314] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/users/19ecd6d8217d4b36b6f68f46c780b656 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:02.267609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.282307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.283343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.283772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.284347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] PATH_INFO: `/v3/system/users/41a011153d3c4abfbbf3ee6dbe3d43fd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.286350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=41a011153d3c4abfbbf3ee6dbe3d43fd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.288063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.290310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.304408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 166/315] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jun 4 20:36:02 2022] PUT /identity/v3/system/users/41a011153d3c4abfbbf3ee6dbe3d43fd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:02.345121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.504814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78552a95-9dfe-4891-9655-dc401c8a33e0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.557844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.558511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.558794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.559070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.644584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.646030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.683683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.797230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 150/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:36:02.802872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.940396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3853d-d094-466f-bd8e-943932912e6c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.003892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.005595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.006072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.006508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.008895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.011704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065674f6-ac9d-49e7-8252-2205d03ea1bc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.019701 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 167/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:03.028774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.155086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434474b-3fc3-49b3-9c3d-fa0eb9a02717 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.192432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.200115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.201123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.201620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.202101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.202996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad, user.id=19ecd6d8217d4b36b6f68f46c780b656) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:03.203309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.204857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba29f5-bef6-4178-8c17-af63a0d403f6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.213326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 151/318] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/role_assignments?user.id=19ecd6d8217d4b36b6f68f46c780b656&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:03.350980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e860d3-e447-4e23-8d68-1a803daa5417 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.351251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e860d3-e447-4e23-8d68-1a803daa5417 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.351712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e860d3-e447-4e23-8d68-1a803daa5417 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.353673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 168/319] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:03.364537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.364984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.365131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.385549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:03.386862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:03.478519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 152/320] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:03.502990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e860d3-e447-4e23-8d68-1a803daa5417 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.593118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.641293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e860d3-e447-4e23-8d68-1a803daa5417 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.680890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.681697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.681978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.682247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.694071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-32a663ac-077b-483d-a48e-88a18565f72b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:03.701940 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:03.708908 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:03.710523 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 169/321] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:03.717116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.903604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107327ec-c40e-4aae-9fe6-b6af13ac1f18 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.949395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.969859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.970974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.971704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.972970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.974404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:03.974965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.977579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.985393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a80c-6dff-46d7-907c-4a2523b9c1a7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.985922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a80c-6dff-46d7-907c-4a2523b9c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.985922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a80c-6dff-46d7-907c-4a2523b9c1a7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.988221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 170/322] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:03.993907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.998748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.998858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 153/323] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:03.998965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.000481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.012429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:04.013657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:04.092574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 171/324] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:04.116678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.155533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebba6b-a46d-43ad-aff1-7db744a82944 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.189721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.202277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.203908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.204332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.204795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] PATH_INFO: `/v3/users/aeabce3aec07451a9b14c2a458f8f844` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.206341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] RBAC: Authorizing `identity:get_user(user_id=aeabce3aec07451a9b14c2a458f8f844)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.208137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.210531 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 154/325] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/users/aeabce3aec07451a9b14c2a458f8f844 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:04.217470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.247416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2318d-e2c9-4f6e-a06d-ade1056f14d2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.291438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.292593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.292775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.292959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.293148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.294813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.296563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.298319 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 172/326] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:04.305344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.363338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c988-29bf-4fe0-ab85-50b15acbb081 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.411008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.411898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.412182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.412462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] PATH_INFO: `/v3/system/users/aeabce3aec07451a9b14c2a458f8f844/roles/3c3fb75f2d874cd5856bea2f44fc1786` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.414470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aeabce3aec07451a9b14c2a458f8f844, role_id=3c3fb75f2d874cd5856bea2f44fc1786)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.416342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aa621-1fa3-4bc9-ae7a-1e8b4da14f67 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.428984 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 155/327] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jun 4 20:36:04 2022] PUT /identity/v3/system/users/aeabce3aec07451a9b14c2a458f8f844/roles/3c3fb75f2d874cd5856bea2f44fc1786 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:04.454490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683345ed-cccf-4d03-b775-6ec085fe236a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.489469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.504275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.504972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.505288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.505522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.506317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.507896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75500e-be42-412a-9094-4e36498c06c9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.539555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 173/328] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Jun 4 20:36:04 2022] POST /identity/v3/groups => generated 226 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:05.896803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8e8a-601d-4fef-9483-4e885540a29c None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.897456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8e8a-601d-4fef-9483-4e885540a29c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.897456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8e8a-601d-4fef-9483-4e885540a29c None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.899297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 156/329] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:05.916246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.917286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.917837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.948610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:05.949892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:06.084857 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 174/330] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:06.165152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8e8a-601d-4fef-9483-4e885540a29c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.314085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8e8a-601d-4fef-9483-4e885540a29c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.346990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.389485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.390718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.391202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.391730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.408631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:06.417672 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:06.418617 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:06.419407 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:06.425043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 157/331] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:06.433394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.619484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c449e9e-59c7-44f3-a6c5-2dc594d3b403 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.635420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.663743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.664433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.664707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.664979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.665757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:06.666061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:06.667575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:06.683373 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 175/332] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:06.694175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.957952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1c49a-9827-4cc2-9bf0-722329a6a026 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.049382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.051623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.052433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.053187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] PATH_INFO: `/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.057191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=41a011153d3c4abfbbf3ee6dbe3d43fd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.060480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bf61d-eac8-45e4-adad-74c9fbdb5aa5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.064588 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 158/333] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/users/41a011153d3c4abfbbf3ee6dbe3d43fd => generated 293 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:07.070382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.232604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f8039-b185-41dd-b9fd-b72d8459d3c1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.277567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.278249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.278559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.278840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.279676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] RBAC: Adding query filter params (role.id=14868dac29204ecd9ad19d6590b5b153, user.id=41a011153d3c4abfbbf3ee6dbe3d43fd, scope.system=all) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:07.279991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.281496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711c818-c906-4757-8f15-11bbc128f705 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.301570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 176/334] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/role_assignments?user.id=41a011153d3c4abfbbf3ee6dbe3d43fd&scope.system=all&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:08.605074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7897-d672-4b73-8ed4-c362cd2facbb None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.606144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7897-d672-4b73-8ed4-c362cd2facbb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.606628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7897-d672-4b73-8ed4-c362cd2facbb None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.608338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 159/335] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:08.622727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438702d-447d-4a1b-b6ad-a512efea1fe5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.624307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438702d-447d-4a1b-b6ad-a512efea1fe5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.625089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438702d-447d-4a1b-b6ad-a512efea1fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.669140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8438702d-447d-4a1b-b6ad-a512efea1fe5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:08.670723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8438702d-447d-4a1b-b6ad-a512efea1fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:08.744257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.838654 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 177/336] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:08.917724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7897-d672-4b73-8ed4-c362cd2facbb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.052468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b6c-df2d-423b-84ae-6cf50568b998 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.052819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b6c-df2d-423b-84ae-6cf50568b998 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.052946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.053269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d011b6c-df2d-423b-84ae-6cf50568b998 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.062942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 178/337] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:09.082515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f48e-0970-42c6-a102-ce199bb730b5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.082990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f48e-0970-42c6-a102-ce199bb730b5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.083464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f48e-0970-42c6-a102-ce199bb730b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.162053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d4e8f48e-0970-42c6-a102-ce199bb730b5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:09.164386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4e8f48e-0970-42c6-a102-ce199bb730b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:09.176348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7897-d672-4b73-8ed4-c362cd2facbb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.284532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.285388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.285671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.285949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.307747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d210ddb6-d5b9-4f86-ac93-4fcf1948741e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:09.320345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:09.321873 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:09.323162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 160/338] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:09.335611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e95a-0e83-492e-9dd5-522c497952d0 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.335611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e95a-0e83-492e-9dd5-522c497952d0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.337792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e95a-0e83-492e-9dd5-522c497952d0 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.338147 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 161/339] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:09.339478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e95a-0e83-492e-9dd5-522c497952d0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.394189 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 179/340] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:09.400153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.407565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.408810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.466554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:09.468149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:09.647768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 180/341] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:09.652933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.673825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e95a-0e83-492e-9dd5-522c497952d0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.694022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.697816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.765959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.766644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.766995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.767226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.768004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:09.768300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:09.769929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.793147 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 162/342] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:09.794113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.859457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c348e71-0ef9-4b9e-b0c1-639fdc5bb736 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.927615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.928411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.928742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.928969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.955963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:09.970746 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:09.973274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 181/343] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:09.974795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.089281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0c8bf-4ffb-4481-83ac-3f1f8ee07a83 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.130208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.150776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0be2-82bc-4b74-bc66-0072c9bbbac6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.177797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.179220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.180096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.180880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.194792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.195574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.195789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.196063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.204648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:10.222503 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:10.224562 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:36:10.226261 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:10.230439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 163/344] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:10.232182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.274980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.276878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aaf6e-e8ca-4109-ab25-c6bef5c1db76 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.292854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.374346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.398395 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 182/345] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:10.399380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6d63-b758-4066-920a-22f7b56ebac7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.406930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6d63-b758-4066-920a-22f7b56ebac7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.406930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6d63-b758-4066-920a-22f7b56ebac7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.406930 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 183/346] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:10.406930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6d63-b758-4066-920a-22f7b56ebac7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.462565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6a21d-5d18-4dcb-aa2a-6e3ed591972f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.526443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6d63-b758-4066-920a-22f7b56ebac7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.535181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.536423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.537137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.537626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.538586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.539141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.540787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c5bae-f061-4030-a06d-54e105b500da None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.551939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 164/347] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.553683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.554150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.554642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.572279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.573316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.573759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.574259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.575190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.575675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.578353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.582797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:10.584118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:10.595829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 184/348] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.598720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.689727 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 165/349] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:10.691201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.719237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.755688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.798565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff89e4-7611-4faa-8ee5-477235de6307 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.843268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.844636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.845113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.845731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.847415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.849190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.851667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 185/350] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.852806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.921539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51c173-2283-4db8-8565-8cf498d03566 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.010261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.011307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.011850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.012346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.012729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a2e1b-d0f2-42f4-ae11-62fe94032156 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.052007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.063365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.064986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.065515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.066012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] PATH_INFO: `/v3/users/aeabce3aec07451a9b14c2a458f8f844` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.067850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] RBAC: Authorizing `identity:get_user(user_id=aeabce3aec07451a9b14c2a458f8f844)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.069981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.074383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 186/351] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/users/aeabce3aec07451a9b14c2a458f8f844 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.075662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.155660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.157277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.195005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.243041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949bcaf-7cd3-43da-bd2c-97c824a29d4b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.300201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.302268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.302775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.303277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.325399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:11.328395 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 166/352] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:11.329838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-bd384a87-d945-436b-968a-b9562fd2ea08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:11.340279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:11.341242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:11.342035 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:11.342633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 187/353] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:11.345584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c592be-30aa-4e91-9bb2-ad90d01534dc None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.346073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c592be-30aa-4e91-9bb2-ad90d01534dc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.348281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c592be-30aa-4e91-9bb2-ad90d01534dc None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.349877 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 188/354] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:11.351023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c592be-30aa-4e91-9bb2-ad90d01534dc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.432199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.490218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfd48-403d-481e-801c-06913615eb26 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.517013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.532044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c592be-30aa-4e91-9bb2-ad90d01534dc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.542202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.543641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.544109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.544572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.554438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.556902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98732469-6dbc-464b-a9c5-a78b99e5883c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.561273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 167/355] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.563710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f855ea-c869-4c27-8789-58f3b9d345f7 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.564175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f855ea-c869-4c27-8789-58f3b9d345f7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.564585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f855ea-c869-4c27-8789-58f3b9d345f7 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.566820 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 168/356] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:11.567995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f855ea-c869-4c27-8789-58f3b9d345f7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.596300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.597172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.597602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.597995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.599002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] RBAC: Adding query filter params (role.id=3c3fb75f2d874cd5856bea2f44fc1786, user.id=aeabce3aec07451a9b14c2a458f8f844, scope.system=all) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:11.600173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.601735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.624665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 189/357] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/role_assignments?user.id=aeabce3aec07451a9b14c2a458f8f844&scope.system=all&role.id=3c3fb75f2d874cd5856bea2f44fc1786 => generated 510 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.625953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.757031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f855ea-c869-4c27-8789-58f3b9d345f7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.805309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.809679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a663f1-114d-4cb0-b358-d72e88dfe329 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.825419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.826815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.827252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.828015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.829833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.832992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45b56b-68cc-46e4-98ff-9e307e78bd05 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.836216 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 169/358] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.841012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceea54d-88d2-4a0b-be8e-fd5fb2e49ec4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.841012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceea54d-88d2-4a0b-be8e-fd5fb2e49ec4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.841012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceea54d-88d2-4a0b-be8e-fd5fb2e49ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.866981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bceea54d-88d2-4a0b-be8e-fd5fb2e49ec4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:11.869032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bceea54d-88d2-4a0b-be8e-fd5fb2e49ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:11.882867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.883625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.883906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.884188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.885429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:11.885429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.886784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.899026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 190/359] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.899773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.974531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.002793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 170/360] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:12.004743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.005120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.005307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.030755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:12.030755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:12.082632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4053-fd42-48ef-9e0a-4d1a6ecffdf9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.129178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.129867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.130154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.130407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.131268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:12.131615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.133172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.141092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 191/361] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:12.142181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.159540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 171/362] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:12.159540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.192909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.312604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee8aee-d16f-4f75-992f-1331347df6db None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.330076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.333242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3ea6c-8c32-4800-b2c7-4a7b60f8a1e9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.365787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.366512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.366798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.367077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.404637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.405857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.406308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.406725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.408902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.410693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.413757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 192/363] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:12.414869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.465104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.466642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.575685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.583079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01947f-f2c6-4a27-92e8-b3dcde13f172 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.635983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.636857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.637141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.637418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.642449 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 172/364] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:12.644361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.660163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:12.668171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:12.669129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:12.670458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 193/365] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:12.671773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.671917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.798935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ff3e3-3a25-43bc-82b7-0285d847796a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.839324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed354be-2f16-4144-ae12-ae3d5d543fb8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.857472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.858562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.858846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.859123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.877426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:12.890991 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:12.891968 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:12.892783 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:12.895826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 173/366] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:12.895826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.906749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.907956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.908451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.909408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.911011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:12.914451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.914451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.931682 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 194/367] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:12.933230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.971969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.990231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.043139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffa280-a264-4565-a9fd-e44ca5ba1798 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.108434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.109739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.110238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.110727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.114832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.115568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297595a0-23d3-460b-8fb8-f4a1f3bb90bb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.117740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.121014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 174/368] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.122490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.165419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.166532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.167030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.167835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.169458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.170079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.172112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.186648 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 195/369] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.188544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.268034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39ed8-614a-4952-a1aa-3f8a40dbe8e3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.295541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.310312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a811efe-24a2-48fe-a913-5198829ac73d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.315076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.315895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.316242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.316582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.317436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.317803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.319289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.331340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 175/370] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.332624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.353594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.354887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.355374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.355896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.357352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.359164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.361594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 196/371] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.362796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.367485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.458982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcfd1c-18c3-4197-9486-af83e16d7d0f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.496690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.497383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.497664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.497937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.499422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd16dc-bb34-4a51-b1cc-603175b4e43b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.540179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.541275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.541818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.542330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.564036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.573141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.574859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.576735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.629576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.632798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.690153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 176/372] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:13.691318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.768102 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 197/373] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:13.769388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.799686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da38d0-000e-4b81-9748-99b518c0c959 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.801550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.838736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.839784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.839784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.840080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.840898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.841210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.842729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.850090 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 177/374] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.850514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.851030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.933490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3667-22a3-4f82-8a25-d1bbc93fcc05 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.972888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b73f-e755-40bc-a6c4-5488d2d72496 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.976822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.978161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.978723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.979311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] PATH_INFO: `/v3/projects/598115c278dc4440816e2bfd4030f050` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.981108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] RBAC: Authorizing `identity:get_project(project_id=598115c278dc4440816e2bfd4030f050)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.983122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.985823 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 198/375] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/projects/598115c278dc4440816e2bfd4030f050 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.996832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.067680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.068510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.068792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.069065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.070459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.074156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.078577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 178/376] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.084750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.167025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.236407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429de6-df92-48f9-a3db-1a9be66b1c7d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.282611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.313417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.314620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.315068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.315310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] PATH_INFO: `/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.322249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fcc79-1478-4756-b383-a9d440362df4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.331583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] RBAC: Authorizing `identity:get_group(group_id=9dd28d4ef2494e938ecc674fba9c89f2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.331583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.339796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 199/377] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2 => generated 229 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.369189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.425442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.427454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.428260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.428932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.433068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.436259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.439949 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 179/378] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.447046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.521515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfe781-507d-40b2-8c24-20e9a7c7a8aa None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.609046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.609624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.609898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.610192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.611040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] RBAC: Adding query filter params (group.id=9dd28d4ef2494e938ecc674fba9c89f2, role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=598115c278dc4440816e2bfd4030f050) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.611358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.613021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ac86c-4dd0-41bd-a70a-f7184940dd9d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.619934 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 200/379] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/role_assignments?group.id=9dd28d4ef2494e938ecc674fba9c89f2&scope.project.id=598115c278dc4440816e2bfd4030f050&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.672361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75aba7-d2e2-4165-8cca-80bf9e6df53d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.692085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.764107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.765282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.765788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.766282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.768437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.769220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.772093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a725042-a43f-4bce-986f-fb209808984a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.785190 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 180/380] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 260 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:15.180981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b3a1-1a41-464a-8c3b-343fc9a2370d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.181774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b3a1-1a41-464a-8c3b-343fc9a2370d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.182277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b3a1-1a41-464a-8c3b-343fc9a2370d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.185382 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 201/381] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:15.194393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.195156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.195288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.230969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:15.233046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:15.367543 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 181/382] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:15.442035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537b3a1-1a41-464a-8c3b-343fc9a2370d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.526239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.612514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537b3a1-1a41-464a-8c3b-343fc9a2370d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.675958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.677330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.677823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.678304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.709456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:15.728995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:15.730687 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:15.732220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 202/383] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:15.741048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.000275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.014007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a0d44-a89c-4b6a-9ef5-05b54f7b132a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.098331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627315-0114-493a-80fa-059d558d471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.099494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627315-0114-493a-80fa-059d558d471d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.104248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627315-0114-493a-80fa-059d558d471d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.104751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627315-0114-493a-80fa-059d558d471d None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.106252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627315-0114-493a-80fa-059d558d471d None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:16.106993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627315-0114-493a-80fa-059d558d471d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.109655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627315-0114-493a-80fa-059d558d471d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.126419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 182/384] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:16.132139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.185415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741639d-66aa-47b7-8da9-772dfe4acd69 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.188722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741639d-66aa-47b7-8da9-772dfe4acd69 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.189254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741639d-66aa-47b7-8da9-772dfe4acd69 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.199152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 183/385] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:16 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:16.218051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.218544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.219037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.250091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:16.252318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:16.417723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe765d8-ea72-4120-9546-24863e12be62 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.426408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.447236 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 184/386] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:16.497175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.498998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.499525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.500039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.502648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.505373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.508944 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 203/387] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:16.517116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.517488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.721670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51463c4c-5de9-4f4c-a9b6-be70c59bb347 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.817737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.819196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.819673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.820232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.862267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:16.880906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:16.882754 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:16.884675 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:16.888924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 204/388] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:16.900267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.911978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.945568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911cd13-fd2e-4c9a-ab6a-bb06f6bdd346 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.986138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.007823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931676-be64-495f-84e7-7f363264136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.009215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931676-be64-495f-84e7-7f363264136c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.009643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931676-be64-495f-84e7-7f363264136c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.010074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da931676-be64-495f-84e7-7f363264136c None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.012117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da931676-be64-495f-84e7-7f363264136c None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.014612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da931676-be64-495f-84e7-7f363264136c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.022736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 185/389] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:17.028300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931676-be64-495f-84e7-7f363264136c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.154664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9e78-68e5-4631-a1de-f0df56ac1a27 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.223492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.224457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.224902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.225328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.226233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:17.226680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.226789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da931676-be64-495f-84e7-7f363264136c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.228758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8539fe-38db-4cf7-b24e-ca631ef93ea8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.239008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 205/390] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:17.240736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b702cf-7a83-459c-9dac-4492edf34b16 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.241223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b702cf-7a83-459c-9dac-4492edf34b16 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.241729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b702cf-7a83-459c-9dac-4492edf34b16 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.243344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 206/391] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:17.247880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b702cf-7a83-459c-9dac-4492edf34b16 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.290243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.292119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.292788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.293427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/groups/b6bcced240934849897f6eff99f71afb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.297315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, group_id=b6bcced240934849897f6eff99f71afb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.300241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83be30-48d7-46e8-bf09-69f7928a8f00 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.324930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 186/392] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jun 4 20:36:17 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/groups/b6bcced240934849897f6eff99f71afb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:17.334556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.335352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.336141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.383566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:17.387316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:17.419571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.484322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.504310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b702cf-7a83-459c-9dac-4492edf34b16 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.562016 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 187/393] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:17.587146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.588086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.588364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.588653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.589967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.591491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.593599 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 207/394] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:17.598341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.604686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.820701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f976c5-f5a1-49e3-ae3c-85a25dcc8026 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.824699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557a48-9f93-470b-a12d-e1a88fd4c8a3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.885826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.886307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.887682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.887996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.888376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.888827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.889120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.889680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.891934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.894550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.898209 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 208/395] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:17.907604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.909813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:17.925199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:17.927156 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:17.929192 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 188/396] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:17.935329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.962086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.966721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.092545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803aa5-9bc2-4dc0-b10f-83b97a3bd0dc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.157585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.159447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.160130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.160802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/groups/b6bcced240934849897f6eff99f71afb/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.172546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] RBAC: Authorizing `identity:create_grant(project_id=21c31bc8add74fc89a03c0a93338ae0b, group_id=b6bcced240934849897f6eff99f71afb, role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.175395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2212b9-624a-4040-ac4e-df9403889308 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.208296 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 209/397] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jun 4 20:36:17 2022] PUT /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b/groups/b6bcced240934849897f6eff99f71afb/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:18.227764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5a62-7590-4b49-a961-dc521f5e103a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.228056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5a62-7590-4b49-a961-dc521f5e103a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.228377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5a62-7590-4b49-a961-dc521f5e103a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.230132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 210/398] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:18.237175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.237554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.237734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.254707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085710a-a717-485c-ab29-8d64bcea7962 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.258650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:18.259906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:18.339363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.340098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.340382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.340659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.341437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:18.341744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.343257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.369900 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 189/399] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:18.380786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.421131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 211/400] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:18.448541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.486466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.511166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.570855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635bacb-e27b-4bd3-9f7d-f52fe5e9fe2d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.612553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.613772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.613772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.614043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.615081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.616623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.618701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 190/401] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:18.625312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.661598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a6cf9-205a-4ac1-be96-8d84d139e877 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.727541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.729354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.730135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.730900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.748379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7dd-bb75-4d84-8e1c-47f29557b5a8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.751128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:18.773848 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:18.775574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:18.777449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 212/402] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:18.783992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.824731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.825694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.825956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.826281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.828000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.833286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.837564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 191/403] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:18.842907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.851911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.016086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.029321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638309-c993-43f8-ac47-b57ab47e6568 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.032515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf8b91-537b-49b6-87b4-0d8291d0f447 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.069936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.070185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.070630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.070916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.071199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.071974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.072097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:19.072335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.072776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.073240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/groups/b6bcced240934849897f6eff99f71afb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.073775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e617f-4ff7-4ffc-9734-ec6051352106 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.076029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, group_id=b6bcced240934849897f6eff99f71afb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.077741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c174e-1495-4b6e-9282-cf911dfd977e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.085092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 213/404] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:19.086452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc8714-61a8-4c0c-8849-c16fd6cff71c None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.086710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc8714-61a8-4c0c-8849-c16fd6cff71c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.086951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc8714-61a8-4c0c-8849-c16fd6cff71c None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.092990 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 214/405] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:19.094056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc8714-61a8-4c0c-8849-c16fd6cff71c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.097577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 192/406] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jun 4 20:36:18 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/groups/b6bcced240934849897f6eff99f71afb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:19.099424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.099981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.100452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.128911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:19.131851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:19.204002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.216734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 193/407] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:19.270161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.304769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc8714-61a8-4c0c-8849-c16fd6cff71c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.390386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.391375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.391772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.392052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] PATH_INFO: `/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.396547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] RBAC: Authorizing `identity:get_group(group_id=9dd28d4ef2494e938ecc674fba9c89f2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.398175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.400452 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 215/408] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2 => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:19.403445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e398-1f87-4711-9652-a71b39ba903e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.407682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.438729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.449108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e829-7258-4718-81e1-723e6133641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.450341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e829-7258-4718-81e1-723e6133641a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.450864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e829-7258-4718-81e1-723e6133641a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.451337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474e829-7258-4718-81e1-723e6133641a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.464721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474e829-7258-4718-81e1-723e6133641a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6474e829-7258-4718-81e1-723e6133641a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:19.474260 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:19.475220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:19.476151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:19.479043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 194/409] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:19.485131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e829-7258-4718-81e1-723e6133641a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.553713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.570451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a640db-ad2c-4d89-aeae-e69b90b21bf1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.611850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474e829-7258-4718-81e1-723e6133641a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.619549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.621412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.621933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.622825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] PATH_INFO: `/v3/projects/598115c278dc4440816e2bfd4030f050` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.625103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] RBAC: Authorizing `identity:get_project(project_id=598115c278dc4440816e2bfd4030f050)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.627576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.630973 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 216/410] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/projects/598115c278dc4440816e2bfd4030f050 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:19.636278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.673814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.674734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.675019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.675304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.676204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:19.676517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.681984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.712305 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 195/411] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:19.722336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.842702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.885768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9aae-3d78-4a9e-9e57-8307ab2c6a2c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.953950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911842-fc92-4d24-9668-fe5da6f17436 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.963528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.964571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.964866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.965142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] PATH_INFO: `/v3/projects/598115c278dc4440816e2bfd4030f050/groups/9dd28d4ef2494e938ecc674fba9c89f2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.973501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=598115c278dc4440816e2bfd4030f050, group_id=9dd28d4ef2494e938ecc674fba9c89f2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.975088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.976681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.999201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.001398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.002390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.003059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.016733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.016733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.016733 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 196/412] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:20.018171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.028831 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 217/413] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jun 4 20:36:19 2022] PUT /identity/v3/projects/598115c278dc4440816e2bfd4030f050/groups/9dd28d4ef2494e938ecc674fba9c89f2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:20.200697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79992215-e75f-49b7-9c3c-cd2de97f371e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.256417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1560cd-6857-4955-8421-92208596693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.257341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1560cd-6857-4955-8421-92208596693f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.257625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1560cd-6857-4955-8421-92208596693f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.257903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1560cd-6857-4955-8421-92208596693f None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.259308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1560cd-6857-4955-8421-92208596693f None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.260895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1560cd-6857-4955-8421-92208596693f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.263076 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 197/414] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:20 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:20.269277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.484831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0965e4b-cd5a-436c-a567-209aebc74ddd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.543925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.544830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.545112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.545386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/groups/b6bcced240934849897f6eff99f71afb/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.553615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] RBAC: Authorizing `identity:create_grant(project_id=61dc38dcdc8f4f7d91dac6b79c15afad, group_id=b6bcced240934849897f6eff99f71afb, role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.555116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810d507-dfca-4529-8011-cb0c18d6f07f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.578172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:20.584594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 218/415] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Jun 4 20:36:20 2022] PUT /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad/groups/b6bcced240934849897f6eff99f71afb/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:21.260151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1775-cfab-42ee-abd2-35ec0c3fb3df None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.260723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1775-cfab-42ee-abd2-35ec0c3fb3df None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.260723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c1775-cfab-42ee-abd2-35ec0c3fb3df None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.262539 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 198/416] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:21.268614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.269058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.269189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.293524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:21.294805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:21.409311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 219/417] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:21.450446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c1775-cfab-42ee-abd2-35ec0c3fb3df None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.523064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.586926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c1775-cfab-42ee-abd2-35ec0c3fb3df None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.633405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.634669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.635167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.635762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.654356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-780a04c5-5601-4524-ad36-1c813a61e817 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:21.667429 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:21.668498 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:21.669349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:21.672447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 199/418] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:21.684744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.776649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42dcd4-48db-43fc-93cd-23d987608b2b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.777046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42dcd4-48db-43fc-93cd-23d987608b2b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.777509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42dcd4-48db-43fc-93cd-23d987608b2b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.786434 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 200/419] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:21.791212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.791760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.792260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.845123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:21.846557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:21.870592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda5e4f-98db-439b-8e01-8e964ffa4bfe None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.931837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.940560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.941259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.941547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.941815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.942600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] RBAC: Adding query filter params (name=member) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:21.942916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.945975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.970412 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 220/420] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:21.978088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.013587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 201/421] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:22.060277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.156146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.216014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3f3d-6a54-4822-a89a-339f6238931b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.314697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e8617-32e0-4d1d-b569-53a492444995 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.315882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.316563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.316869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.317229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.403068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.403956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.404237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.404510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.427738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:22.444287 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:22.445376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:22.446176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:22.450364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 202/422] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:22.455486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.456829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.483789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.485338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3a82-bef1-4512-bcf0-823695c7c6a7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.664537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f036-4816-43ea-b69a-10933685ab4e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.667396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.709889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.710585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.710873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.711152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.711999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:22.712390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.712601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 221/423] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:36:22.713756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d0401-b960-4e80-9461-df9df47fddc0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.714912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0754-1fa8-40b4-ae73-9ed0d42f630a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.715793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0754-1fa8-40b4-ae73-9ed0d42f630a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.716337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e0754-1fa8-40b4-ae73-9ed0d42f630a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.718871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 222/424] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:22.723576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0754-1fa8-40b4-ae73-9ed0d42f630a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.728268 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 203/425] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:22.730054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.730505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.730938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.766917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:22.769452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:22.907969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.919343 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 204/426] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:22.921337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.939934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e0754-1fa8-40b4-ae73-9ed0d42f630a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.026683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.028206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.028695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.029181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.031328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:23.034228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:23.037894 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 223/427] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:23.039314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.128823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:23.141835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07891ca-f4af-4a09-879b-4a78bee15157 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.173350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3b6e3-cf0d-4fae-850a-f791490af09e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.207120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.208848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.209505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.210416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.227573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.228832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.229291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.229743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.248001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:23.263621 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:23.265491 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:36:23.267146 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:23.274195 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 224/428] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:23.276168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.313707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:23.315010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:23.316635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa5ab4-ef7a-4463-9858-92e02403a61e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:23.460017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:23.461755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e822-6032-4514-b08e-5462a18a99dd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.470774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 205/429] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:23.473026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb88e-8e90-41d7-8b64-f7006bfae8ee None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.473510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb88e-8e90-41d7-8b64-f7006bfae8ee None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.473990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb88e-8e90-41d7-8b64-f7006bfae8ee None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.476809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 206/430] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:23.480988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb88e-8e90-41d7-8b64-f7006bfae8ee None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.533402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.536773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.537744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.538225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.540888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:23.543664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:23.554624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 225/431] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:23.554624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.637789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb88e-8e90-41d7-8b64-f7006bfae8ee None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.687256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.688338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.688810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.689268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.690655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] RBAC: Adding query filter params (name=member) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:23.690655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:23.692182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfe9ab-82d7-4410-88a6-9732309968cb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:23.706432 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 207/432] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:23.708028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.708286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.708564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.719852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:23.733726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:23.735680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:23.752949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249d8f8-3949-47fc-a7a4-9c70bb9392a8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:23.806087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:23.807480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:23.807878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:23.808292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] PATH_INFO: `/v3/projects/21c31bc8add74fc89a03c0a93338ae0b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:23.809761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] RBAC: Authorizing `identity:get_project(project_id=21c31bc8add74fc89a03c0a93338ae0b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:23.811723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:23.813841 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 226/433] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/projects/21c31bc8add74fc89a03c0a93338ae0b => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:23.814796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.836245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:23.865923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 208/434] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:23.867759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:23.974518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552bf3-10db-4595-adf2-354184e13056 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.017427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.018316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.018892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.019308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.020546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:24.020994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.023039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.039562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 227/435] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.039562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.068277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73a8d-256f-409b-93c2-8eb77e801a5b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.076485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.129782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.130801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.131238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.131721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.229204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.238216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139190c-822a-443a-8ff6-f0a27b005550 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.248323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.249982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b323159-dfe8-4344-8130-6749b7d82af6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.303533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.304873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.305403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.305805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.307634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.310056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.320094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 228/436] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.321081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.420515 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 209/437] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:24.421922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cebe-d836-485d-b7cf-d5ec15106293 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.422215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cebe-d836-485d-b7cf-d5ec15106293 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.422576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81cebe-d836-485d-b7cf-d5ec15106293 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.424391 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 210/438] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:24.425169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81cebe-d836-485d-b7cf-d5ec15106293 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.472984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.498263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0206b-a75e-4834-89db-49c3fe5c730b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.564873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.565991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.566457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.566881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.583781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.587884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:24.600079 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:24.602072 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:24.603749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 229/439] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:24.606717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.615682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81cebe-d836-485d-b7cf-d5ec15106293 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.671493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.672315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.672666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.673039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.674045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=21c31bc8add74fc89a03c0a93338ae0b) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:24.674428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.676058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ded7-2c74-4def-b7ad-78a081428842 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.683163 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 211/440] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=21c31bc8add74fc89a03c0a93338ae0b&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 611 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.684632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e172-d549-4452-9758-a28b053e606b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.684963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e172-d549-4452-9758-a28b053e606b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.685283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e172-d549-4452-9758-a28b053e606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.716331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8579e172-d549-4452-9758-a28b053e606b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:24.718002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8579e172-d549-4452-9758-a28b053e606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:24.789609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8c0c-2d98-4114-80a6-7379d935a8b9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.824447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 212/441] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:24.824447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e172-d549-4452-9758-a28b053e606b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.851299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.853005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.853518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.854017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.856549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.859488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.863277 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 230/442] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.868327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.895001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.990522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.025262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e172-d549-4452-9758-a28b053e606b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.057579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b074a-99a3-45e4-a2d2-b469d77badb5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.071371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.072611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.073120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.073566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.075031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:25.075593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.078457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.094228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 213/443] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.095105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.123733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.124902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.125194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.126120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.145467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:25.162526 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:25.163637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:25.166046 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:25.171729 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 231/444] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:25.171729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.242152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9182e-92af-4ef7-adb8-f6460655c302 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.280110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.296849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.298393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.298947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.299444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.301592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.304479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.307553 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 214/445] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.308042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7f33e-3c1e-4274-8df1-933975b1c3ab None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.308748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.328898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.348268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.348930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.349210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.349464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.430267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.431806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.445410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a679-8425-46a0-93b7-5866b2b74b91 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.484297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.484932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.485168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.485444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.486281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:25.486593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.488092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.498918 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 215/446] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.500437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.537259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.578331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 232/447] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:25.579423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.612173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.662539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f791-04aa-4929-b631-f398f0c684cf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.717639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.718662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.719040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.719450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.720493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=14868dac29204ecd9ad19d6590b5b153, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:25.721053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.723541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.747639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 216/448] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=14868dac29204ecd9ad19d6590b5b153 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.747639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.747990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9f4d1-a9bf-4a05-a522-bad2aaec7fbd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.813847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.815961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.816398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.816824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.892477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.934444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0593-568f-4111-8c7a-43704562fc46 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.940618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.942566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.001255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.003315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.003315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.003315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] PATH_INFO: `/v3/projects/598115c278dc4440816e2bfd4030f050` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.004727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=598115c278dc4440816e2bfd4030f050)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.006242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.008545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 217/449] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/projects/598115c278dc4440816e2bfd4030f050 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:26.015200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.024098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.130400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 233/450] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:26.139409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.210025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534814c8-d4c8-4387-9064-3c66c1d5a0c9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.264751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.269381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.270461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.270818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.271102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] PATH_INFO: `/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.273119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] RBAC: Authorizing `identity:get_group(group_id=9dd28d4ef2494e938ecc674fba9c89f2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.274569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.276665 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 218/451] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/groups/9dd28d4ef2494e938ecc674fba9c89f2 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:26.282930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.297782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e05f6-9558-4acf-99fb-7945290b1c66 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.336400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.337285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.337569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.337847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] PATH_INFO: `/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.339093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] RBAC: Authorizing `identity:get_project(project_id=61dc38dcdc8f4f7d91dac6b79c15afad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.340603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.342347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 234/452] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/projects/61dc38dcdc8f4f7d91dac6b79c15afad => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:26.348308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.363635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.405320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6de3-fc7e-46c8-9a94-e39691cb6456 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.457897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.458752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.459099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.459437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.460548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] RBAC: Adding query filter params (group.id=9dd28d4ef2494e938ecc674fba9c89f2, role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=598115c278dc4440816e2bfd4030f050) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:26.460861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.462652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.469634 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 219/453] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/role_assignments?group.id=9dd28d4ef2494e938ecc674fba9c89f2&scope.project.id=598115c278dc4440816e2bfd4030f050&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:26.482283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b86d3-f9b6-47bf-a329-f8a6366c2988 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.537763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.538889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.539230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.539579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] PATH_INFO: `/v3/groups/b6bcced240934849897f6eff99f71afb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.541186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] RBAC: Authorizing `identity:get_group(group_id=b6bcced240934849897f6eff99f71afb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.542783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a91b98-e33e-4ece-aba2-af5d74774171 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.544665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 235/454] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/groups/b6bcced240934849897f6eff99f71afb => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:26.551192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.673904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c456-420f-4874-8c87-0a03a458eba5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.715241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.715850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.716150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.716550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.717394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] RBAC: Adding query filter params (group.id=b6bcced240934849897f6eff99f71afb, role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:26.717713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.719189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36b1f2-a0aa-41f0-be75-0759dc99cd94 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.722738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.727275 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 220/455] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/role_assignments?group.id=b6bcced240934849897f6eff99f71afb&scope.project.id=61dc38dcdc8f4f7d91dac6b79c15afad&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:29.996110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5b66-2c68-483e-9dc8-f5c6b726f49e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:29.996842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5b66-2c68-483e-9dc8-f5c6b726f49e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:29.996968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b5b66-2c68-483e-9dc8-f5c6b726f49e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.000020 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 236/456] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:30.006599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.007292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.007621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.051445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:30.053699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:30.201503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 221/457] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:30.250954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b5b66-2c68-483e-9dc8-f5c6b726f49e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.281469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.447548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b5b66-2c68-483e-9dc8-f5c6b726f49e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:30.510609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:30.512850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.513159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.513435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.538057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:30.539885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8574e50c-4266-435c-b6b2-5c39b8b483fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:30.565198 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:30.566163 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:30.567024 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:30.567024 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:30.567024 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:30.567024 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:30.567024 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 237/458] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:30.575539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.677728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f903-ab6c-49be-91a0-849c7b84c908 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.678066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f903-ab6c-49be-91a0-849c7b84c908 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.678279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f903-ab6c-49be-91a0-849c7b84c908 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.680052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 238/459] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:30.699329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.700029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.700508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.729606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:30.732197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:30.771383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c552651-a6f0-4f52-a7d1-b0cea9119e3d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:30.840376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.849475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:30.850517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.851021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.851492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.852491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:30.853087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:30.854687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:30.863347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.875589 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 239/460] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:30.902964 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 222/461] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:30.909015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.916658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.157776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3b91-0a83-4056-b6b4-b20b2e8a8f16 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.247869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.248734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.249019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.249298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.272678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.274214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:31.319582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:31.321436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:31.323549 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:31.323549 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:31.323549 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:31.323549 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:31.323549 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 223/462] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:31.332628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.436315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e9ba2-8575-4b9f-84ef-8325ba8f291c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.459897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.513788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.514492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.514766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.515042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.516070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.517664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f93c7-7f69-422d-8d94-768ef19d1d28 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.557953 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 240/463] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:30 2022] POST /identity/v3/users => generated 246 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:31.559332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e68-1c85-4b42-bdb9-c4aa9c233b01 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.559905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e68-1c85-4b42-bdb9-c4aa9c233b01 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.560345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20868e68-1c85-4b42-bdb9-c4aa9c233b01 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.568083 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 241/464] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:31.569884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b660-5e94-4678-beb1-52674e7b948d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.570388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b660-5e94-4678-beb1-52674e7b948d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.570816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75b660-5e94-4678-beb1-52674e7b948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.594988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88109d7d-8779-443d-8685-13d3e329ca0c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.608556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8c75b660-5e94-4678-beb1-52674e7b948d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:31.614637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8c75b660-5e94-4678-beb1-52674e7b948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:31.665168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.666374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.666860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.667292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.668288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:31.668789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.670610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79d1b-6f2c-4a49-9fa9-b63bea6a1f31 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.691293 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 224/465] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:31.693374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247f91-a292-4210-aa4f-772c64ee77d1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.693981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247f91-a292-4210-aa4f-772c64ee77d1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.694468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11247f91-a292-4210-aa4f-772c64ee77d1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.696283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 225/466] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:31.697427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247f91-a292-4210-aa4f-772c64ee77d1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.723106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.781267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 242/467] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:31.783285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.784150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.785032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.817277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:31.819623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:31.965230 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 243/468] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:31.966835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.018135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11247f91-a292-4210-aa4f-772c64ee77d1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.021245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.058351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.059039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.059326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.059642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.060516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.062029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.088697 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 226/469] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:31 2022] POST /identity/v3/users => generated 248 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:32.089586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.204477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75aa80-7a04-4acf-a04e-b5b7651b0ee2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.215376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023be9f-04b6-485c-81a4-8ad8572c3b86 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.237443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.262579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.263449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.264609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.264912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.283873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.286865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.287945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.288775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.289058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.289332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.301583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.303143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:32.324323 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:32.325262 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:32.326128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:32.326128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:32.326128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:32.326128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-eba4f60d-313b-4cd4-b2c3-801c005823a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:32.326336 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:32.327099 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:32.328018 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:32.328018 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:32.328018 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:32.328018 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:32.328018 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 227/471] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:32.334176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7789e-6462-4b2b-91a0-0f2059917e8d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.334503 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 244/471] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:32.334664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7789e-6462-4b2b-91a0-0f2059917e8d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.334664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7789e-6462-4b2b-91a0-0f2059917e8d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.334664 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 228/472] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:32.335074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.339988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7789e-6462-4b2b-91a0-0f2059917e8d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.385881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.507113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69703c-4101-4b9d-bad5-850f8948df9e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.559976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7789e-6462-4b2b-91a0-0f2059917e8d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.573408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.575154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.575981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.576269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.577038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:32.577351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.579617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb8813-4a57-4def-981e-18074f0c09ec None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.600949 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 245/473] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:32.603426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.604005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.604485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.611331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.614113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.614617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.615109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.616546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:32.617095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.620145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.628890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:32.630145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:32.647599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.650939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 229/474] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:32.652845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.759892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.773945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 246/475] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:32.776283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.847818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956120-f42c-4a4a-afc0-46c6a7cd9594 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.899491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ef2c7-2097-43d6-b4f5-7f6c9a707f4a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.925307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.927394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.928245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.928994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.930922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.934678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.940553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.941425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.941770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.942119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.942977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.944632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.979879 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 247/476] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:32 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:32.981566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.993391 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 230/477] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:32 2022] POST /identity/v3/users => generated 248 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:33.005889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.162990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded2990-a819-4973-ba9c-029bbbcf3a1e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.217229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.218589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.219094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.219716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.221392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.223874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.235797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.sql.core [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 20:36:33.235797 ncdv-master-1 devstack@keystone.service[97803]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 20:36:33.235797 ncdv-master-1 devstack@keystone.service[97803]: [parameters: {'id': '3a320fe0ef0044b388919bed5cdea08a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 20:36:33.235797 ncdv-master-1 devstack@keystone.service[97803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:33.261631 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return ref.to_dict() Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:33.262566 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application yield resource Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise self.value Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application session.commit() Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 20:36:33.263486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.flush() Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application compat.raise_( Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:36:33.264387 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:33.265298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:33.266228 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [parameters: {'id': '3a320fe0ef0044b388919bed5cdea08a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:33.267004 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 20:36:33.269968 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:33.271569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 248/478] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jun 4 20:36:32 2022] POST /identity/v3/roles => generated 144 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:33.278961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.415475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743646e-61e9-4d72-853a-9ba34046b690 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.447273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.461369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.462421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.462791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.463309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.478430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-15307994-2c10-4658-86d8-54f22afe8b1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:33.494447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:33.495657 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:36:33.496642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:33.499102 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 231/479] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:33.504856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.617966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.656625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd62b2-a1bd-4902-b98a-6c4be6e264a0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.693937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.694629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.694911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.695185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.695994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:33.696300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.697720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c903b5-7519-4add-b14d-7e6fdfb01db5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.707757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 249/480] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:34.631299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc928-5d8c-4b9f-9d56-219ff8ffb738 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.631829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc928-5d8c-4b9f-9d56-219ff8ffb738 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.631829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abc928-5d8c-4b9f-9d56-219ff8ffb738 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.633451 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 232/481] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:34.639363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.640313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.640784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.665453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:34.667356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:34.785633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 250/482] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:34.826773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abc928-5d8c-4b9f-9d56-219ff8ffb738 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.005624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abc928-5d8c-4b9f-9d56-219ff8ffb738 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.063266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.064596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.065098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.065657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.088833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:35.097570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:35.098583 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:35.099401 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:35.106391 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 233/483] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:35.108541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.185868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.230003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b38ddb-587d-405a-b686-25f3511275f6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.268298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.269013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.269294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.269569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.270353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.270658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.272179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758212-1875-42e5-995b-5e4ed1893fbd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.282371 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 251/484] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:35.292754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.380372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.480047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c34b0b-c105-4236-b109-3f7aa1e5f2f8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.530314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.531058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.531344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.531690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.544882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.546399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.566077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef097-58ad-48e6-8782-8935f24ac886 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.566476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef097-58ad-48e6-8782-8935f24ac886 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.566885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef097-58ad-48e6-8782-8935f24ac886 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.568475 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 252/485] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:35.574470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.574780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.575078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:35.584696 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:35.585631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:35.586578 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:35.586578 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:35.586578 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:35.586578 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:35.596166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 234/486] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:35.610660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.623656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:35.625589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:35.821028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 253/487] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:35.832105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.838720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6d5bb-11aa-4805-b2a6-4a34929d2cce None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.897166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.905956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.906914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.907336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.908229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.914042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.914600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.918029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.952423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 235/488] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:35.965300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.997387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.054450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc494c9a-162e-418e-8c46-785eb2caa82e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.095259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.096979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.097463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.097946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.111062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:36.120429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:36.121434 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:36.122234 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:36.125586 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 254/489] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:36.133856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.198819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988a157-118c-426c-b6f5-423f9ebe3c34 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.244784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.245738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.246026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.246308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.257889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.259926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:36.280755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:36.281753 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:36.282725 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 236/490] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:36.287307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c13f-1160-45e7-8e7a-debf594399d6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.291203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.310468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.341139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.341884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.342179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.342491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.343427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:36.343768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.345491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece61011-6651-4218-8b08-011008f533b7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.351982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.367095 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 255/491] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:36.369776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a85fa-9255-4781-b5c8-bc3f8af7533e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.370068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a85fa-9255-4781-b5c8-bc3f8af7533e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.370352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a85fa-9255-4781-b5c8-bc3f8af7533e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.376345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 256/492] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:36.377401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a85fa-9255-4781-b5c8-bc3f8af7533e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.478694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb0828-6dd9-4db2-8090-c6cd4a423b9d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.511438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a85fa-9255-4781-b5c8-bc3f8af7533e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.520718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.521412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.521696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.522379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.523255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:36.523937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.526018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6794044-1f27-411d-a6d1-32673409f81a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.547658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.548560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.548902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.549178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.560518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.562000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.574474 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 237/493] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:36.576166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.576636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.577071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7f4ab620-773e-430d-b6b4-22dae48f3e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:36.579802 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:36.580636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:36.581767 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:36.581767 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:36.581767 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:36.581767 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:36.581767 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 257/494] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:36.582276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df82eb-28f6-49ce-908c-f08d5e5c8fed None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.582567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df82eb-28f6-49ce-908c-f08d5e5c8fed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.582830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df82eb-28f6-49ce-908c-f08d5e5c8fed None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.584361 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 258/495] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:36.585069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df82eb-28f6-49ce-908c-f08d5e5c8fed None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.600426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:36.601958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:36.617558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.676824 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 238/496] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:36.677983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.691002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.714948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df82eb-28f6-49ce-908c-f08d5e5c8fed None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.751843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.752524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.752875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.753155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.794184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bb7dd-3584-4790-ba33-d44c7cb56252 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.830289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.832710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.833188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.833861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.834145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.834422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.835162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:36.835471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.836871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695b083-9d77-4067-958d-523bf494e751 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.849862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 239/497] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:36.851232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.851460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.851791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.868775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:36.869974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:36.870109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.933977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.942317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 240/498] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:36.951697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.960798 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 259/499] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:36.961971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.055552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0230301-8c51-467f-8dd2-b6871893caec None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.072467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4a31d-29a4-4549-a8cc-a2561d4adfc4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.090647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.091450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.091761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.092037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.098944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.102831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:37.107701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.108654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.108963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.109236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:37.110762 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:37.111741 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:37.112554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:37.113170 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 241/500] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:37.113731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.120801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.122292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:37.139934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:37.141091 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:37.142030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 260/501] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:37.142629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.175236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.222057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773815b-6896-4773-ac4f-227ab60205fd None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.243234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9e62-1b1c-45c5-86d5-c0773a894833 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.257331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.258141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.258424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.258705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.269694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.271175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.277816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.278626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.278903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.279174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-ba3e7525-d2da-482c-8337-048a369aadd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:37.289165 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:37.290070 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:37.290909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:37.290909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:37.290909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:37.290909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:37.291114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:37.291184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 242/502] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:37.291811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77658-8333-4369-91ab-0162a036645d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.291967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77658-8333-4369-91ab-0162a036645d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.292236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77658-8333-4369-91ab-0162a036645d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.293662 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 243/503] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:37.294189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77658-8333-4369-91ab-0162a036645d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:37.300242 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:37.301358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:37.302173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 261/504] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:37.302842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.352647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.400923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77658-8333-4369-91ab-0162a036645d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.410635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359d9e7-e970-4e11-9361-96ac0d561606 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.410819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.436550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.437224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.437516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.437797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.438558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:37.438868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.440428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.445938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.446690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.446981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.447334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.448221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:37.448557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.453355 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 244/505] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:37.453505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac9f8-4bbb-4a50-98c4-7f5db41edd5d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.453582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.490729 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 262/506] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:37.492171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669014-02da-48a7-b5c3-571242657208 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.492589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669014-02da-48a7-b5c3-571242657208 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.492797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669014-02da-48a7-b5c3-571242657208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.510315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b2669014-02da-48a7-b5c3-571242657208 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:37.511576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2669014-02da-48a7-b5c3-571242657208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:37.567256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b74c9-e0b7-437b-ae3d-68aef00b2b54 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.583774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 263/507] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:37.584631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669014-02da-48a7-b5c3-571242657208 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.603457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.604168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.604460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.604734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.605464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:37.605773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.607170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.619808 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 245/508] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:37.620663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.626448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.653863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.694952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2669014-02da-48a7-b5c3-571242657208 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.731396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.732104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.732405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.732680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.733429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:37.733733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.735125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.738417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed86e0-d510-42f2-bd10-e3a01caff750 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.743788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 264/509] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:37.744716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.777693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.778500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.778779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.779058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.789820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.791309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:37.809615 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:37.810534 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:37.811447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:37.811447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:37.811447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:37.811447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:37.811447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 246/510] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:37.812072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:37.848701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.852615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0fb1-5351-4c19-92fb-23b8841047b0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.890477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.891059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.891338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.891647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.898230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:37.926086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87890290-019d-423b-96a2-d4ec90d21470 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:37.967266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.968699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:37.968822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:37.969504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:37.969788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:37.970379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:37.981993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:37.983468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:38.000886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.002357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 247/511] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.003225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.072825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.077021 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 265/512] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:38.078287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.122032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768530b-b10d-49af-957d-6d553b3d73d4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.157583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.158990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.159276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.159588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.161738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.168212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.169954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:38.185993 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.187027 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 248/513] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.188062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.198349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5b910-f6bd-4102-8fc0-8d5b34a638c4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.234674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.235628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.235893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.236286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.248186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.249642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:38.269771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.271213 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 266/514] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.272103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.313792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622051a-5061-499f-94de-bbb4d0c64b24 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.331764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.352665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.353824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.354342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.354833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.356277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.356847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.359570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.373751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 249/515] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:38.374724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.394945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b2416-d5d8-4af2-a7cc-0a82f2646b32 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.438349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.439330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.440025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.440324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.441061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.441367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.442760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.449267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.456632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 267/516] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:38.457505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.507030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043adf7c-a472-4ca6-9946-159b81f32c67 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.559473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.560838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.561284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.561775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.572970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1717c9-7012-4f49-a44e-2127c37e6f58 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.574494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.576026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.585051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:38.597392 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.598376 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.599251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:38.599251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:38.599251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:38.599251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:38.599959 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 250/517] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.600896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.632920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.633843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.634261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.634698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.636096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.636585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.638583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.657608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 268/518] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:38.659174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.722665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356401df-3b96-44da-86da-890b18ba9859 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.730595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.768974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.769810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.769941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.770225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.770967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.771282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.772877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.784001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e98e95-c58d-465b-a65c-c1f067cf1e4e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.790346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 251/519] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:38.791307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.844965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.847237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.847741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.848218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.862139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.865035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:38.886696 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.887790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 269/520] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.889556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.919031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12d321-6277-4ab4-acce-8f033e291f0a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.927427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.959753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.960460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.960842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.961023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.962115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.963250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.987132 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 252/521] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:38 2022] POST /identity/v3/users => generated 247 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:38.987960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.015448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85b3f-9218-4a4f-858f-cba4ffcfe7f2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.036154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.061445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.061769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.061983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.062405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.063677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.063677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.065213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.086245 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 270/522] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:39.086245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.140180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d49eb-dfe2-47b3-ad60-9ec88a0503d5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.185251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.186312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.186595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.186912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.187774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.188087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.189687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.207664 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 253/523] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:39.207664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.224474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.242199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7abc7-1c8d-4187-8b58-927c6a8458e2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.296775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.298332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.298807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.299152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.310176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.311759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:39.328633 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:39.329692 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:39.330576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:39.331128 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 271/524] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:39.331875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.334234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.368860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21637-84fe-4c72-8c4c-d14213ad5ee2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.419395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.420511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.421006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.421549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.422643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.423132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.425249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.445709 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 254/525] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:39.446859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.521686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588eae0-fefd-448c-b6e2-5c2c28a03e60 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.559836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.560651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.560932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.561213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.568931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.570440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:39.586963 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:39.587932 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:39.588766 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 272/526] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:39.589231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.591227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122c73b-a770-4486-b7f9-c098db5d4f6b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.603779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.631635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.632586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.633039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.633520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.634508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.634979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.636736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.657896 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 255/527] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:39.659161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.662155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.700193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2868d3-3b92-4979-9558-6cada3458089 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.736489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.737156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.737442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.737717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.777249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddc040-1b4c-4275-865d-4ef9e2b210f1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.813527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.815331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.815542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.816374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.816800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.817215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.818180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.818633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.820249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.839676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 256/528] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:39.840758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.847937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.911840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:39.951555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 273/529] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:39.952977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.957282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450704a7-a8db-4976-84fc-f135a6067767 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.998976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.000060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.000511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.000931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.077697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.080061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.092770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d1c6-382d-4d6a-aebe-754cb51bb27c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:40.107739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:40.140732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.141631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.141975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.142256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.143751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=828a7d4e334d459cb88fc2ba20894623) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:40.144281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.146016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.149061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:40.159657 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 274/530] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/role_assignments?user.id=828a7d4e334d459cb88fc2ba20894623&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:40.162394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:40.230750 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 257/531] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:40.239730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:40.352819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43f8d8-0aef-4fd3-b135-97b78ba7bdf6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:40.413740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.414976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.416710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.417247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.445275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.447235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.488459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e33a64-91f0-4bac-b6f2-5250f3b0ea46 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:40.491251 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:40.492136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:40.492981 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:40.492981 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:40.492981 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:40.492981 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:40.496081 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 275/532] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:40.505246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:40.539357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.540627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.542339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.542841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.568097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.572369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.573572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:40.607533 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:40.608445 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:40.609299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:40.609299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:40.609299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:40.609299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:40.619541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 258/533] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:40.628767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:40.645998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:40.740721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b5ad1-d612-4c64-8c05-f3cb9dca9dbb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:40.786429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9668-e2aa-401f-a658-9036fa657bfa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:40.824637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.825374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.825670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.825952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.826692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:40.827030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.828633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.836432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:40.837466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:40.837950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:40.838425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:40.839385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:40.839918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:40.841564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:40.843072 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 259/534] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:40.852087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:40.871346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 276/535] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:40.877420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.028977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.029975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.068314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e84205-7385-4ca4-a891-1195af6165f7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.127296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb64592-d3b1-4f27-b6aa-01168de0117c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.176727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.178088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.178587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.179024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.200224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.202893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.219802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.221194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.221704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.222185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.235485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.238715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:41.240290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:41.241145 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:41.242009 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:41.242421 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 277/536] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:41.248655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:41.271071 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:41.272040 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:41.272880 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:41.273765 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 260/537] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:41.283365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.461448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1058e-0f77-49fd-9c41-4762a5284a17 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.505490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.506175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.509368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.509733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.510561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:41.510876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.512403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.542940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be76f35-b1d6-43be-a67a-2b3fa4883d23 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.546730 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 278/538] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:41.553701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.565219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.627560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.628868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.629377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.629854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.630874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:41.631393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.633178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.635362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.665626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 261/539] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:41.678874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.723557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f7ed4-7903-483a-84c1-1ee56e649e5a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.773298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.773967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.774244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.774519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.775354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=6afed72705e6494c9ce5272b328e416b) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:41.776030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.777710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2db2d-4361-4011-9578-9969e06883c9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.791739 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 279/540] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:41 2022] GET /identity/v3/role_assignments?user.id=6afed72705e6494c9ce5272b328e416b&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:41.793550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbada-30e1-44be-8530-624039b90a65 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.793841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbada-30e1-44be-8530-624039b90a65 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.794213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbada-30e1-44be-8530-624039b90a65 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.795948 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 280/541] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:41.803299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.803651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.803876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.816078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6110-3865-4112-960f-0b55f207972e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:41.844899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:41.846543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:41.875728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:41.876486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.876783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.877061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.877973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=57831f8b23c243ff9223b08588949da4) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:41.878291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:41.880112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:41.897989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 262/542] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:41 2022] GET /identity/v3/role_assignments?user.id=57831f8b23c243ff9223b08588949da4&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:41.954589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.962400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 281/543] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:42.010275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.118668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:42.172803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9eb5f-a96b-4a95-9262-24e8791ea945 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.215421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.216380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.216706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.216989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.230129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-0e93a944-8a94-41bb-a922-2b0de77a942a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:42.238303 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:42.239273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:42.240601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 263/544] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:42.246189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.414808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c14bb-9c6f-478f-8267-285d63ddd735 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.415299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c14bb-9c6f-478f-8267-285d63ddd735 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.415842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c14bb-9c6f-478f-8267-285d63ddd735 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.418635 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 264/545] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:42.426579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.426978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.427475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.464235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:42.465484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:42.469718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd1b6f-7994-4a74-acab-0acaa7688cdd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.568087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.569179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.569652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.570113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.571061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:42.571634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:42.573462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:42.585441 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 265/546] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:42.590570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 282/547] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:42.599725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.621591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.692406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:42.696176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:42.738976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea33297-26b5-451d-adb7-5f1195c6e126 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.781380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.783276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.784111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.784609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.792025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a269b94-d8c7-489c-a3fd-1f4948105c97 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.798780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:42.807636 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:42.808570 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:42.809358 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:42.813535 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 283/548] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:42.819563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.869119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.870244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.870741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.871165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.891269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:42.895734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-bb285285-b711-400e-9538-6ce9a8085c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:42.929998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:42.931169 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:42.932273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:42.932273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:42.932273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:42.932273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:42.932273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 266/549] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:42.932968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f903-9cc7-4f18-891b-3295eb071b8d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.937641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f903-9cc7-4f18-891b-3295eb071b8d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.937641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482f903-9cc7-4f18-891b-3295eb071b8d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.939319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 267/550] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:42.940887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.941178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.941453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.960031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:42.961153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:43.012595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553509cf-a738-4a9e-870e-e2fdfca248ba None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.047696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.052260 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 268/551] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:43.053318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.064661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.065620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.066047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.066540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.067485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:43.068722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.070344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.082327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 284/552] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:43.089689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.106979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.182737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764aec-5e6b-4e39-adab-923e30a281d2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.227956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.228577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.229017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.229305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.230386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:43.230749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.232445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.233524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d3ee5-4fb2-4d3a-b1d4-5b7fb71f328e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.251561 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 269/553] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:43.251561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.295632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.297178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.298360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.299125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.315634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:43.323666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:43.324688 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:43.325555 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:43.330798 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 285/554] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:43.331852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.374299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.386343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.393324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77363db2-4b7c-49ff-b74d-384ade4861a7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.439779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.440823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.441200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.441729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.454051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.455924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.461535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e86d5-ad0c-4124-8aa3-7733b58d2d6a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:43.475047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:43.476164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:43.477100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:43.477100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:43.477100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:43.477100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:43.477100 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 270/555] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:43.477366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.510326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.512060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.512745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.513165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.526256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.529080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:43.550268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:43.551436 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:43.553131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 286/556] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:43.553808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.603008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be450865-84de-457a-aeb2-c9e71de5926f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.641427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.642145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.642434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.642716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.643763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:43.644078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.646154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.657586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 271/557] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:43.658653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.664004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.702435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acda641-f93d-4a3a-a72b-5c10ed8c26ea None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.705938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.741407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.742079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.742626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.742626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.743360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:43.743719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.745329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.758540 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 287/558] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:43.759423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.796337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d734-0f85-4904-ab06-2a2d0ecd8048 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.835596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.836295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.836611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.836865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.837776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:43.838088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.839867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.865837 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 272/559] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:43.865837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.902321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe2f52-6986-44cc-931d-1cd1e8aefe11 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:43.941857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:43.942679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:43.942963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:43.943590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:43.943755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:43.962885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:43.965028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:43.990663 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:43.991790 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:43.992866 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:43.992866 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:43.992866 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:43.992866 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:43.992866 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 288/560] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:43.993139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:43.999150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4cad9-958b-41e7-af4c-073dd07aad81 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.022057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.051547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.052712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.053145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.053655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.062657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.064641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:44.082551 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:44.083746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:44.084746 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:44.087098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 273/561] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:44.088272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.128380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b5f0-898f-4fcf-8170-4affa56e2731 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.180059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.181210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.181494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.181770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.197524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.199939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.222000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d187f-b9ae-4c6e-839f-1a60c43250d5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:44.228270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:44.229268 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:44.230156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:44.230156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:44.230156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:44.230156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:44.234393 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 289/562] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:44.235673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.268677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.289951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.291698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.292493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.293233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.294989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:44.295877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.298882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.321417 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 274/563] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:44.323087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.324388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.391918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99d72-5c19-4905-a37d-97f66e467039 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.454125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.455997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.456199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.456542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.457322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:44.457632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.459165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.478280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d58b84-92c5-44ec-a66c-06adc1cf9e9f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.486768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 290/564] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:44.488673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.521554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.522230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.522518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.522795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.523569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:44.523882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.525330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.545437 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 275/565] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:44.546452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.604400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.631872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3726a-19fa-474b-84bf-b3bc1e09bdf6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.662937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.673766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.674793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.675079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.675359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.681188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3053fa-3c98-4f91-9251-6f95aa7f6509 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.684210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.685711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ba1c54c2-5aed-46d2-ab32-22fb762f2326 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:44.701913 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:44.702965 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:44.704048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 291/566] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:44.704736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfc3b-597b-4544-9684-fdd2dd5bf0fb None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.705152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfc3b-597b-4544-9684-fdd2dd5bf0fb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.705577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dfc3b-597b-4544-9684-fdd2dd5bf0fb None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.707322 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 292/567] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:44.707922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfc3b-597b-4544-9684-fdd2dd5bf0fb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.730599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.731266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.731576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.731856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.807211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.808772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f43462-1166-4af8-ad4e-9fa20ebacdab None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.824159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dfc3b-597b-4544-9684-fdd2dd5bf0fb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.853676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.862520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.863252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.863558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.863842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.871335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.872860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d4355ea3-5dde-4c1e-bd08-55ca67ce60b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:44.887865 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:44.889593 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:44.891540 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:44.894605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 293/568] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:44.895955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf69cd-c784-4799-84c4-544bb7f62b39 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.896226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf69cd-c784-4799-84c4-544bb7f62b39 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.897032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf69cd-c784-4799-84c4-544bb7f62b39 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.897884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 294/569] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:44.898621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf69cd-c784-4799-84c4-544bb7f62b39 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.920832 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 276/570] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:44.922150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.922435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.923121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.945524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:44.946742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:44.961920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.035726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf69cd-c784-4799-84c4-544bb7f62b39 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.043220 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 277/571] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:45.044125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.085352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.086034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.086310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.086580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.087429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.087799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.089264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cea155-6eca-4bd5-b872-cfd8de184e82 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.110663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 295/572] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:45.112039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.112322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.112654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.129344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:45.130555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:45.149050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.181223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a63fe-df5e-47a9-bbff-790c0090f64a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.213393 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 296/573] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:45.214250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.216070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.217012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.217291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.218459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.219284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.219618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.221272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.239329 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 278/574] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:45.242056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.252190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.340784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45f40-e702-4b0b-aeb4-d8bd19f0eb4b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.379780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185fd54-1403-4976-8328-ab8b63f783ad None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.387979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.388788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.389069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.389335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.402195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.403676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.418031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:45.423439 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:45.424466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:45.425426 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:45.425426 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:45.425426 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:45.425426 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:45.426062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.426153 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 297/575] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:45.426223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.426291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.426377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.426377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.440404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:45.448390 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:45.449695 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 279/576] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:45.450602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.521743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.538284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dc39b-d75d-4f73-a2b6-eb856549ec64 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.566995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1fc2-e51a-4958-949b-1660ba887394 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.581628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.582824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.583104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.583374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.595316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.596854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.605582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.606662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.606789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.607007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:45.616514 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:45.618042 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 298/577] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:45.619125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.623869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:45.632272 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:45.633492 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 280/578] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:45.634442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.697792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.741726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769f7e-a437-48f0-b5fc-725f27a884d6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.754317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877d9a-d2e5-4039-aadc-756371a9be47 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.783636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.784589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.784904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.785144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.793293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.793967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.794258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.794514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.794617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.795270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.795620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.797186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.803176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=1d53786e35f04229b4fdb375d5141b99, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.804722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.811665 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 281/579] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:45.812841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.822973 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 299/580] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:45 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:45.823849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.958888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eda3a7-8505-48ee-9cef-bfc7e1e83504 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.968305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb403563-f7d0-45c0-afb1-490648292031 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.983346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.012828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.013717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.014102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.014480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.015392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.015833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.017957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.018515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.018731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.019026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.019366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.020195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.020506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.022023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.035808 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 282/581] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.035808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.041816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 300/582] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.048541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.114220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.167685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c284a-5445-4d39-84cf-c30e5bf1b0b3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.186533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd99d5f-8365-41ba-9a30-15494cd0f91b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.207038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.207754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.208038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.208311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.209119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.209367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.210760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.223389 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 283/583] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.224776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.238074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.238895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.239182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.239458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.250200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.251772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:46.267558 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:46.268756 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:46.269849 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:46.273370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.274092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 301/584] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:46.274994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.344036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff394-f7ed-4d85-ba38-fba7f043bba0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.388509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226d783-89d5-4280-b0a0-49dd5b818b00 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.391104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.392127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.392503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.392823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.399839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.405125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.407194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:46.425613 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:46.426749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 284/585] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:46.427685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.430839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.431978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.432259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.432532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.439753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.441249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:46.458698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:46.459778 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 302/586] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:46.460690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.541023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.555968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846fa9-03b0-47d0-b7ec-d35b71534ad6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.570165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0b3c4-e0b6-49b3-b2df-2298cc874f6b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.595708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.596521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.596880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.597086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.606026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.606869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.607245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.607652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.608563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.608970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.610145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.610710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.611811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.624465 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 303/587] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.625235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:46.635735 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:46.636786 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:46.637736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:46.637736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:46.637736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:46.637736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:46.637736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 285/588] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:46.638015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.661133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.736962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee023-9454-46d8-9ca3-0bc4a9689010 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.757440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbda0a-91d2-4213-a991-fd57a9c7abbf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.774875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.775972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.776251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.776525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.777258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.777555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.778944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.791345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 304/589] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.792237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.800407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.801432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.801936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.802389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.803329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.803816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.805420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.816395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.825198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 286/590] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.825198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.896594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:46.911169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307761f6-5f68-44ee-ac31-2c1ba0f3785c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.935864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1daa9-18dd-4a58-8e13-e5de0ac75a2a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:46.948650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.949308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.949593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.949864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.950703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=d40d4b6dcab740c39553774b3daed388) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:46.951019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:46.953078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:46.959570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 305/591] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/role_assignments?user.id=d40d4b6dcab740c39553774b3daed388&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:46.960234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:46.994713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:46.996854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:46.997905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:46.998492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:46.999962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:47.000295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.001878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.026377 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 287/592] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:47.028615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.095454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab48e98-ce43-426c-9e3e-05d47f9404bd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.117011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.138192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.139017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.139303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.139639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.149226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.151191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:47.168156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:47.169298 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:47.170237 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:47.174507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 306/593] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:47.175684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.183322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b47665-47c3-40cf-821e-2bf5ac60dde3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.198523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.230956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.231891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.232771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.233063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/828a7d4e334d459cb88fc2ba20894623/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.253634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=828a7d4e334d459cb88fc2ba20894623, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.255729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.279690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 288/594] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:47 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/828a7d4e334d459cb88fc2ba20894623/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:47.282562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.331786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf77e0-f4af-40ba-a8e6-f0d8b01fa1ee None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.403552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.404399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.404683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.404953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.422011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.424653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:47.446764 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:47.447847 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:47.448796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 307/595] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:47.456230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.519672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8629dc5-462f-4fdf-af1a-d685f406c235 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.537286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.573078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.574068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.574356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.574639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.576271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:47.576607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.578637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.594299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.607639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 289/596] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:47.613084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.660169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bffbcc-8704-418e-911c-3aa450bceb4f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.735300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.736174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.736499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.736780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.737683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:47.738008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.739563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.747019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104477a7-cc3b-4fa3-9cf9-e5365ee513c4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.778048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 308/597] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:47.779181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.797731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.799045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.799338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.799731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.822749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.824346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:47.854175 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:47.856273 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:47.858430 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:47.858430 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:47.858430 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:47.858430 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:47.858430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 290/598] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:47.873313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:47.908746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560e12e-824f-431d-a60c-74b070265e23 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:47.936000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.942528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:47.957253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:47.958096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:47.958383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:47.958670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:47.991856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:47.993781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:48.031629 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:48.032641 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:48.033539 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:48.033539 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:48.033539 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:48.033539 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:48.035497 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 309/599] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:48.040250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.074499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7fe6-c4d2-4c95-b653-8a31bb6ef050 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.126578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.127608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.128044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.128474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.129649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:48.129963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.131402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.151659 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 291/600] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:48.154528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.247166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.268477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1360f-580e-4db9-afa0-acf2ce1763fa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.305782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.306609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.306988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.307277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.315662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.316193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2d846-4620-4580-b129-801694dfe34f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.317234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:48.332895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:48.334064 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:48.334982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:48.338912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 292/601] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:48.340271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.380780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.381669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.381847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.382131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.382877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:48.383239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.384626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83902-b372-452f-acaf-5d34624f3b2e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.397831 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 310/602] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:48.399550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f96e-e042-412a-ba38-8cd69f8feb6c None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.399856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f96e-e042-412a-ba38-8cd69f8feb6c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.400140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f96e-e042-412a-ba38-8cd69f8feb6c None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.406488 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 311/603] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:48.406488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0f96e-e042-412a-ba38-8cd69f8feb6c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.476664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.519070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd448e2-629b-44f5-bb6a-2b0017cc98a6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.567857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0f96e-e042-412a-ba38-8cd69f8feb6c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.579422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.580645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.581125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.581592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.582666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:48.583788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.585682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ecc0b-ddca-4fd7-8d08-6c6cee0aa187 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.598262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.605278 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 293/604] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:48.607225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.607949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.608829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.624783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.625758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.626110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.626389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.632783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:48.634383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:48.636266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.638269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:48.661342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:48.662628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:48.663763 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:48.667594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 312/605] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:48.669125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.759233 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 294/606] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:48.759233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.865533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0df9d-1161-4b97-bbd4-10992cb7ee49 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.890329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.941424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d88cdb-60e0-4727-963b-b71d28506944 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.943925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.947951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.948655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.949565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/6afed72705e6494c9ce5272b328e416b/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.974671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=6afed72705e6494c9ce5272b328e416b, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.976984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.996579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.001945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 313/607] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:48 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/6afed72705e6494c9ce5272b328e416b/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:49.004620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.006054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.007283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.020364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.020875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.022614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:49.023003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.026227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.092228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 295/608] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:49.099129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.138487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825907-e48c-4790-80ae-0aca53032383 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.186324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.187887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.188806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.189337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.203336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:49.212225 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:49.213288 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:49.214138 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:49.217100 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 314/609] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:49.233923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.298045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf74529-fb6a-4a44-8cfb-e3c03a62920c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.300093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.341861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.342787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.343069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.343349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/57831f8b23c243ff9223b08588949da4/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.361122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=57831f8b23c243ff9223b08588949da4, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.362630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.382739 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 296/610] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:49 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/57831f8b23c243ff9223b08588949da4/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:49.395681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceee2c-cbd4-4a05-b346-288af833e02a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.437537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.438328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.438551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.438833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.439889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:49.440200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.441627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.452330 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 315/611] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:49.461062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.547984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.632260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cf2c1-3f37-41c6-83d8-d61af5865931 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.677467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.678375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.678658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.678971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.691835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.693622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:49.715888 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:49.716862 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:49.717743 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:49.717743 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:49.717743 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:49.717743 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:49.717743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 297/612] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:49.723330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.830790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.865412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8984a-5647-4a04-b29e-cbe4588bb144 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.915629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.916344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.916632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.916913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.917698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:49.918012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.919547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b734-b0ca-4559-8c0d-4cd5ba0caeb4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.952366 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 316/613] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:49.961261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.060447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270023a-5eb5-4fad-be4b-9850bf992e09 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.060935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270023a-5eb5-4fad-be4b-9850bf992e09 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.061412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270023a-5eb5-4fad-be4b-9850bf992e09 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.066094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 317/614] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:50.073549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.074051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.074518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.101898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:50.103132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:50.140610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:50.158385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431402c3-c761-4e45-9561-157799dd8ca9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.229269 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 318/615] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:50.232776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:50.233606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.233896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.234177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.252970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:50.254533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.254664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:50.270954 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:50.271994 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:50.272911 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 298/616] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:50.279048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.385125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:50.430826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8522a14-a21a-4078-acc9-09f3ffde38fe None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.434370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f9df0-b5d1-48a5-b88a-76ad6a505866 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.471789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:50.472480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.472765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.473045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.473900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:50.474260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:50.475719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecfd8c-022b-4acc-a8c2-04e4ba09479f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:50.484710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:50.487812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.488466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.488921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.501939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 299/617] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:50.503497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-0853-4bb0-80b8-4bd970db09d3 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.503880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:50.503988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-0853-4bb0-80b8-4bd970db09d3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.504240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7faa6-0853-4bb0-80b8-4bd970db09d3 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.510162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 300/618] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:50.510162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7faa6-0853-4bb0-80b8-4bd970db09d3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ac9036b4-ab2e-43fe-a364-ca6fa75c92cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:50.514217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:50.516111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 319/619] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:50.518600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.519731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.519731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.539566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:50.539945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:50.540748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:50.636870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 320/620] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:50.636870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.680592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7faa6-0853-4bb0-80b8-4bd970db09d3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.717923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:50.727314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:50.728433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.728433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.728756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.775694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f87dd5-d226-48db-8de7-d1e6c5121592 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.801939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:50.803431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:50.815336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:50.815987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:50.817633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:50.818128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:50.818625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:50.819635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:50.820167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:50.821858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:50.838361 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 321/621] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:50.839820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.925340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 301/622] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:50.926562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:50.957497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674501-0568-4b87-805a-abca2aa1bdef None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:50.983669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.011355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.012497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.013507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.013948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.030290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:51.041454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.042723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:51.043864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:51.046171 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 322/623] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.047924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.070403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eec9b6-a0f4-447d-ae07-258012ca1e21 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.082685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.109644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.110589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.110974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.111442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.122710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.124397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:51.144320 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.145500 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.146643 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:51.146643 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:51.146643 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.146643 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:51.148281 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 302/624] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.149273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.184142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a09e34-b542-4075-b1c6-471ac3e11b23 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.220550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.221508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.221911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.222289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.236893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.239531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:51.260128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.261336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.262460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:51.262460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:51.262460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.262460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:51.264210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 323/625] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.265192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.286713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab91b-fd5b-4082-9322-7fc5ea75d83f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.298842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.323576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.324414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.324815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.325178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.326272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:51.326522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.328087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.338628 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 303/626] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:51.339815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.378473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.401015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09651-125b-4cae-a8c8-1709001af7c5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.443539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.444701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.445237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.446054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.447587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:51.448259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.450032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.475758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fcf90-8246-4bb9-a925-e32a41afbbdf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.476552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 324/627] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:51.477603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.523985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.526878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.527165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.527444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.528220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:51.528531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.529955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.550373 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 304/628] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:51.551057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.600224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.620541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8b0c-e8dd-4851-b39b-736954b04fa9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.658881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.660664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.660664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.660664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.672360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.674366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.679224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:51.696356 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.697541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.698661 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:51.698661 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:51.698661 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:51.698661 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:51.700066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 325/629] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.701190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.701838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4407957-68da-4eca-aed1-ae0d6328acab None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.750082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.752949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.753582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.754038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.765736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.768170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:51.788683 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.789749 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:51.790715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 305/630] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.791335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.843601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0097-a482-4a51-9466-4e5fbc08962b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.896006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.897509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.897999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.898476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.908101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.909773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:51.912929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.919036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1c35-d8d8-4bb1-bb56-6a40d40c91ca None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:51.928598 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:51.929571 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:51.930460 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:51.931738 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 326/631] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:51.932987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:51.975172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:51.976979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.977457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.977948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.979598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:51.980117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:51.982918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca7ed6-2dcc-4591-8a27-6707dd16b276 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.008232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 306/632] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.008232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45d5b7-130a-421f-86a3-8fb7eb55263b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.008232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45d5b7-130a-421f-86a3-8fb7eb55263b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.008232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45d5b7-130a-421f-86a3-8fb7eb55263b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.011548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 307/633] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:52.014709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45d5b7-130a-421f-86a3-8fb7eb55263b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.018736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.066555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8aae-310b-4ff6-a8d9-16fbfd9530af None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.103970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.104586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.105032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.105323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.114486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.114869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.116360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.147092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 327/634] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.148711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.179040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45d5b7-130a-421f-86a3-8fb7eb55263b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.220214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.220893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.221180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.221464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.222273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.222600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.224129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee0e23-1023-4d2d-a224-8d39e47dd8f6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.224394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.237513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 308/635] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.239487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494952-9488-4440-8a3e-423037dd991c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.239944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494952-9488-4440-8a3e-423037dd991c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.240354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494952-9488-4440-8a3e-423037dd991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.269910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-95494952-9488-4440-8a3e-423037dd991c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:52.271126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95494952-9488-4440-8a3e-423037dd991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:52.274791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a697-c5b3-4f39-aa47-8d1251a12c42 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.319727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.320544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.321226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.321226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.331419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.332942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:52.348878 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:52.350124 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 328/636] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:52.351051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.359597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.372364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 309/637] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:52.373664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a627e9-d8e7-4f4f-962c-e4e3282f7d56 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.373965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a627e9-d8e7-4f4f-962c-e4e3282f7d56 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.374378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a627e9-d8e7-4f4f-962c-e4e3282f7d56 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.376478 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 310/638] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:52.377279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a627e9-d8e7-4f4f-962c-e4e3282f7d56 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.491353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a627e9-d8e7-4f4f-962c-e4e3282f7d56 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.498795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7906e3-43f7-4029-9131-f5cde2ef3c01 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.520576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.532734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.533528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.533806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.534080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.534953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.535262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.536793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.547199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 311/639] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.547199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.549153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.550025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.550315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.550593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.564855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.566467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f844a3e4-6bc3-4393-9cb5-b456384dacd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:52.589727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:52.590758 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:52.592160 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:52.592160 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:52.592160 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:52.592160 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:52.592160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 329/640] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:52.593227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.593521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.593801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.622887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:52.624162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:52.651471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.717669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d8b34-da8c-45f2-8310-1e3b2c266a3a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.727783 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 330/641] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:52.728846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.766587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.767287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.767613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.767891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.768777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.769086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.770598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.792544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 312/642] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.793603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.862866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.866966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887fdd-2cbc-4b31-a69e-242a48d8e521 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.911178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.912020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.912358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.912710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.926276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:52.935422 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:52.936720 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:52.937977 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:52.939691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 331/643] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:52.940827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.943680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636835b-1e0c-4b5e-abee-6b41cb20569a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.963376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.985559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.986446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.986922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.987237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.988030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.988546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.990134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.016641 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 313/644] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:53.016641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.079307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0eed2-b5e9-4b9d-a6c0-a8cfdccc3138 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.119033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.119963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.120258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.120583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.133831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:53.135537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c87c9-61b7-4f2f-847f-7a72a4667df5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:53.142550 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:53.143610 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 332/645] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:53.150008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.173922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.188550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.190129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.190422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.190709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.243900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.275591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e60ee7-38e7-42ca-8946-5d4e931358f5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.276461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.277962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.331027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.331753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.332060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.332324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.333113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:53.333421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.334835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.343883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 333/646] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:53.348965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.402600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 314/647] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:53.403759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.473104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.504120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae226d-548e-46a9-ac0f-e6400de45d9c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.524502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.558448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.559755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.560182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.560292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeec59b-d494-4330-bf8a-bd73ae0a998e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.560624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.569780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.571289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:53.586151 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:53.587111 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 334/648] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:53.588573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.605980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.606954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.607272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.607568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.608344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:53.608653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.610038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.619558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 315/649] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:53.624633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.701823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fd75-7866-442e-ba21-d619c6a829dc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.745790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.746706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dce1b-88b2-4272-a4c2-3f0c259e2610 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.747039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.747464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.747908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.763295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.765479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.768857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.783132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.783985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.784333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.784640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:53.787543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:53.788516 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:53.789437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:53.789437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:53.789437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:53.789437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:53.789437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 335/650] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:53.790678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.795938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:53.802115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.803654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:53.824709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:53.825737 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:53.826648 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:53.826648 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:53.826648 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:53.826648 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:53.826648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 316/651] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:53.826947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.923573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036eff4-19f9-4ab8-822f-8e8c1db8cfde None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.934316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4818401-a0c4-4df8-ba92-92c9432a3c4a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.965497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.966168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.966446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.966723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.967576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:53.967890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.969417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.974665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.975760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.976304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.976883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.986668 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 336/652] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:53.986668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:53.989607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.991082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:54.008878 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:54.009772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 317/653] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:54.010661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.054574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.068953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.103304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc2abe-722f-4810-9e62-009f29c1735e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.133173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139567-ac6d-4bef-a3f4-28123bb4c366 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.141433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.142103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.142372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.142691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.143421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:54.143758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.145186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.158404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 337/654] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:54.159219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.176721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.177731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.178192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.178745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.179810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:54.180293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.181981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.196099 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 318/655] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:54.197292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.277197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5eaa-e2e5-467a-949a-cfe7de64dd50 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.293473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.308606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07411-d090-47c6-ba8f-e493c19e354d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.310213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.319605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.320837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.320837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.321048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/d40d4b6dcab740c39553774b3daed388/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.338569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=d40d4b6dcab740c39553774b3daed388, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.340579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.348106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.348858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.349143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.349419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.350163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:54.350461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.352270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.367538 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 338/656] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:54 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/d40d4b6dcab740c39553774b3daed388/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:54.367538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.372704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 319/657] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:54.373624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.518141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9df186-f666-4597-be2e-d7d6710070a3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.523148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146d0f-bf7a-4d34-86d2-a5ef5fd98fe1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.559902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107492-81ea-4421-9033-32828d3856de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.560639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107492-81ea-4421-9033-32828d3856de None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.560924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107492-81ea-4421-9033-32828d3856de None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.561195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107492-81ea-4421-9033-32828d3856de None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.570258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4107492-81ea-4421-9033-32828d3856de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.571742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.571909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4107492-81ea-4421-9033-32828d3856de None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.573059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.573700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.574186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.584144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.586276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c4107492-81ea-4421-9033-32828d3856de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:54.588469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:54.589435 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:54.590335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 320/658] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:54.591370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107492-81ea-4421-9033-32828d3856de None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:54.609452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:54.610624 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:54.611606 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:54.614309 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 339/659] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:54.615622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.623723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.648264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.724906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107492-81ea-4421-9033-32828d3856de None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.762487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf912f-3010-4395-8c63-986071d00c56 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.769228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.770218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.770568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.770953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.782228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.784438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:54.806033 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:54.807067 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:54.808423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:54.809505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:54.810495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.810978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.811450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.811949 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 321/660] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:54.812734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:54.812961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.813590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:54.815370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:54.828961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 340/661] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:54.830158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:54.934049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.935421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:54.960498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9c04-6f0c-4665-8971-804cf89b5b40 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:54.970430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5830b-2a0f-49f5-8c5d-36bb3e19f646 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.004606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.005409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.005689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.005967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.006924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:55.007239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.008771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.011403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.012237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.012556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.012838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.013713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:55.014025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.015664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.030479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 322/662] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:55.031475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.037769 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 341/663] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:55.038671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.160124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419e7c2-c0ff-406e-8026-9d87ca1efe07 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.160500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8dc1d-00af-439a-a0e6-31b9aa0a7595 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.198823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.199482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.199859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.200235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.200461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.201132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.201471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.201682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.202527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=828a7d4e334d459cb88fc2ba20894623) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:55.202840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.204685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1fad9-a635-4582-8b7d-5b3d5c0b81f9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 323/664] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/role_assignments?user.id=828a7d4e334d459cb88fc2ba20894623&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b909a6-00aa-4b5f-a53b-d7ee0b46f713 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b909a6-00aa-4b5f-a53b-d7ee0b46f713 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b909a6-00aa-4b5f-a53b-d7ee0b46f713 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 324/665] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:55.219563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b909a6-00aa-4b5f-a53b-d7ee0b46f713 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.224270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.224819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.302922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.304604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22506788-6b41-4958-a162-f792216e01d4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.363706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b909a6-00aa-4b5f-a53b-d7ee0b46f713 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.418545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.419642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.420064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.420422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.429702 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 342/666] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:55.430961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.431300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.431534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.457603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:55.459687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:55.516012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.520516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.522120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.526200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.565135 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 343/667] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:55.568471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.673520 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 325/668] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:55.674412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.708574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b794-a9f2-4822-accd-384adfd845ed None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.756283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.757295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.757794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.758163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.770912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.772939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:55.795960 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:55.797220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:55.798592 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:55.798592 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:55.798592 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:55.798592 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:55.800723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da92ee-2da0-484b-8d4a-c73a45d16ac6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.804128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.804505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 344/669] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:55.805760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.836976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.841424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.842331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.842730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.843044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.854922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:55.864374 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:55.865403 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:55.866285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 326/670] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:55.867003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.954895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35b061-df97-4a04-927f-ec5a6aea66f0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.997254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af2ab-2634-4085-a91c-0ac337f0804e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.020037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.022218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.023239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.023839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.038242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.038918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.039252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.039593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.040335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.040643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.042105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.048512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.052353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.057698 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 327/671] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.058638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:56.079670 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:56.080749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:56.081666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:56.081666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:56.081666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:56.081666 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:56.085654 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 345/672] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:56.086618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.095170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.180419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.182907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d49a54-4b68-4e60-ae17-3c68f6d8adaf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.209495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe81e6-13b5-4cab-89a2-1e3bc43771ec None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.224728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.225770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.226316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.226732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.227665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.228251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.229988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.240494 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 328/673] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.241608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.253702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.254579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.254862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.255306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.263825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.265340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:56.281173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:56.282447 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:56.283376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:56.287620 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 346/674] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:56.288791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.347585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.370255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8afe62-76b8-4793-8e1a-8434aa159cb5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.413530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e9bbc-d776-4b11-acb4-aacddf2874b7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.416374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.417291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.417768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.418187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.419080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.419574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.421146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.436114 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 329/675] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.437253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.461958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.462703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.462986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.463263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.467575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.477668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.479227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:56.502525 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:56.503718 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:56.504712 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:56.504712 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:56.504712 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:56.504712 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:56.508891 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 347/676] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:56.509960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.565825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d915a9-d5e5-4b53-a2bd-c53fbda29c28 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.608596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.609671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.610275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.610722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.611846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.612335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.614107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.626976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18461ff-d77d-45c0-bf66-d63f3900bab6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.633606 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 330/677] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.634753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.645252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.665013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.665825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.666153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.666430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.674168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.675670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:56.691209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:56.692352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:56.693384 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:56.697225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 348/678] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:56.698193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.752831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.756909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ce39-507b-41e5-b3ae-ea5b2afc5bfb None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.795906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.796828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.797376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.797845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.798785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.799231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.800873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.806937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a062c-85f9-433e-b683-0e7657da4649 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.819257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 331/679] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.820513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.843129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.843832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.844162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.844475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.845360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=6afed72705e6494c9ce5272b328e416b) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.845675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.847335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.859721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 349/680] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/role_assignments?user.id=6afed72705e6494c9ce5272b328e416b&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:56.859721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.957952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.001518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fda4-3982-424c-a594-d01db32f0735 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.013409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7927eb3-0125-4f37-b55e-dbe45fa7e52c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.035546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.042732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.043426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.043760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.044041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.044863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:57.045175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.046871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2189f-6bf9-4add-bea4-844d65843620 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.062542 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 332/681] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:57.065233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12047-cac4-4ceb-b153-fe21800d3c1e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.066244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12047-cac4-4ceb-b153-fe21800d3c1e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.067185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12047-cac4-4ceb-b153-fe21800d3c1e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.068988 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 333/682] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:57.070003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12047-cac4-4ceb-b153-fe21800d3c1e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.071210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.072215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.073044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.075941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.090939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.092838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c15bde37-cc1e-4614-8d7e-0ba5df727b45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:57.109306 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:57.110353 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:57.111300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:57.114622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 350/683] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:57.116209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.116673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.117156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.136684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:57.139109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:57.205124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12047-cac4-4ceb-b153-fe21800d3c1e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.219483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 351/684] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:57.220404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.239671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.251851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.253011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.253744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.254684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.256068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=57831f8b23c243ff9223b08588949da4) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:57.256846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.259231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.268181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 334/685] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/role_assignments?user.id=57831f8b23c243ff9223b08588949da4&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:57.269821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.337419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c382722-2bb1-4045-b6a3-4cfa093c0fdb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.339666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.379138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.380172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.380685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.381192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.382272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:57.382815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.384578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.406284 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 352/686] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:57.416738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.446017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480386d-fd32-4261-b97f-bf42780cca34 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.524876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.526059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.526344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.526616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.550203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0028f-b7da-4d34-8495-5223985e23fc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.576223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:57.584129 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:57.585185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:57.586049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 335/687] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:57.591640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.594257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.595232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.595784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.596274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.633097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.668881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:57.691185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.693944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.733367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a612c92-3510-4979-9b15-a926713f2974 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:57.774768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:57.777075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.777585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.778079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.779192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:57.781008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:57.782793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:57.794912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 336/688] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:57.800575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.894087 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 353/689] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:57.899937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:57.988723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5011511-72f6-4065-ad46-887bc4e48f30 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.001067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.023938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.056268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856689a-8122-4f20-b95d-aa7f1d90c8d6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.073535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.074355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.074673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.074906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.096925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.098434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.112312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.113499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.114041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.114521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.126142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.128052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:58.135259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.136262 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.137145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:58.137145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:58.137145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.137145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:58.137145 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 337/690] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:58.143283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:58.151934 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.152943 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.153888 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:58.153888 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:58.153888 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.153888 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:58.157370 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 354/691] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:58.168802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.293805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab75d-212c-41aa-be14-fb4fa1d42c6b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.301947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469fb2-6a00-4443-bca5-4ee9a752d785 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.308279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.332355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.333038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.333324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.333602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.334341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.334650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.336161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647152b0-85ee-463d-bc58-4b7210d22040 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.341382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.342058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.342339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.342612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.343438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.343794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.345231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23bbd-9b61-4d75-9f21-c67744cabe0e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.349396 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 355/692] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.350777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53bfb0-7226-45ad-a990-dae352eea8de None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.351070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53bfb0-7226-45ad-a990-dae352eea8de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.351351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53bfb0-7226-45ad-a990-dae352eea8de None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.352916 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 356/693] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:58.358007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53bfb0-7226-45ad-a990-dae352eea8de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.375194 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 338/694] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.376987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.377282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.377554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.396221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:58.397657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:58.418612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.470742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53bfb0-7226-45ad-a990-dae352eea8de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.483372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 339/695] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:58.484790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.508525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.515647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.515647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.515647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.527909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.529399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:58.549466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.550578 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:58.551587 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:58.553653 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 357/696] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:58.554615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.592079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.655528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a299ef-1cdf-4b80-b1e3-1d5074ef557e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.684433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165856-4ae5-4a28-b2c5-db88bbee13b3 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.694945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.696070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.696598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.697023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.705966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.708072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.725540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.726798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:58.726949 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.728047 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:36:58.729094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:58.729633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.729633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.731887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 340/697] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:58.733258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.742851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.744778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.753373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:58.773508 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.775918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.777289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:58.777289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:58.777289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:58.777289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:36:58.785903 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 358/698] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:58.785903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.888701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.890438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044de3-d33c-413b-9ab8-78f6023c2697 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.908106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114d36-fdb6-41a1-9cc7-03d384497d08 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.936776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.937471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.937752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.938033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.939031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.939244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.941349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.954975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 341/699] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.955967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.962224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.963305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.963876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.964365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.965465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.966798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.969254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.999672 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 359/700] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:59.002862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.052153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:59.089939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1566dd2-af57-4d39-96a9-b050934db3c3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:59.127820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:59.128632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.128975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.129315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.130116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:59.130499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:59.132072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:59.149852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 342/701] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:59.150021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815f7f-97bb-4221-a976-00aac0adb435 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:59.151585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.196306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:59.197003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.197272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.197539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.198426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:59.198737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:59.200282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:59.208040 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 360/702] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:59 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:59.208955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.220180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:59.291176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422d908-ac3d-43ee-8baf-48b2da6772a2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:59.327171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433bd41-0b19-4381-bb20-9bf9424dddcc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:59.346153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:59.346840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.347123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.347395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.358264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:59.394874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:59.395644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.395930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.396188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.396919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:59.398411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81648e9f-5f82-45a0-a98e-e746cd7a2d37 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:59.428801 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 361/703] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:36:59 2022] POST /identity/v3/users => generated 254 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:59.493578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:59.495139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:59.578136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf52a-ec79-4b39-8ee9-a61d689a51fc None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.578486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf52a-ec79-4b39-8ee9-a61d689a51fc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.578780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf52a-ec79-4b39-8ee9-a61d689a51fc None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.580463 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 362/704] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:59.586354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f785-973e-4482-a27d-18a310f03129 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.586704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f785-973e-4482-a27d-18a310f03129 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.586926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258f785-973e-4482-a27d-18a310f03129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.617941 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 343/705] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:59.628587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0258f785-973e-4482-a27d-18a310f03129 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:59.628793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.629803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0258f785-973e-4482-a27d-18a310f03129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:59.697358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:59.740864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:59.760942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 363/706] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:59.795697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a226a-2103-49fa-8497-c0f4d3f19908 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:59.803153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f785-973e-4482-a27d-18a310f03129 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.838196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:59.839005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:59.839292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:59.839602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:59.852577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:59.854391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:59.875126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:59.876780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:59.878363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:59.878363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:59.878363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:59.878363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:36:59.878363 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 344/707] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:59.883231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:59.995432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258f785-973e-4482-a27d-18a310f03129 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.004600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.025619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb473-e99b-41e9-908e-30e2384c28a9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.047573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.048427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.048870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.049325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] PATH_INFO: `/v3/services/network` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.049966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.052343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:00.070972 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:00.072864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:00.073883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.074790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.074891 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 364/708] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:59 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:00.074973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.074973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.080032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.080927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:00.081313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.082870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.086748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.106827 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 345/709] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:00.112678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.157825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.217301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458487-8259-404d-ac4a-eb435e09ca89 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.255745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.256347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.256626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.256897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.258277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] RBAC: Adding query filter params (name=network) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:00.258594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.260213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.266047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 365/710] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:00.272156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.374324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c8b1-1f2c-4a4d-b81a-70c3111d23be None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.378414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe291-8077-4bf2-bbaf-7829b195628f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.403937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.415064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.415929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.416389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.416762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.417582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] RBAC: Adding query filter params (type=network) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:00.418045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.419594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3c6e-f10d-461a-9a85-adbaadf06703 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.427924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 366/711] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:00.445968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.446805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.447089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.447363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.462139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.463697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.491807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d524-9c59-457c-ab82-fcde9c0cdc12 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.492244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d524-9c59-457c-ab82-fcde9c0cdc12 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.492616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441d524-9c59-457c-ab82-fcde9c0cdc12 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:00.493358 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:00.494540 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:00.496469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 346/712] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:00.497739 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 367/713] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:00.504258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.515102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.516707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.517098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.517379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.552780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:00.554137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:00.637798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd1f-9250-4677-9c7a-fff79acc7940 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.675640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.676312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.676591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.676866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.677663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:00.677969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.679434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.692484 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 347/714] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:00.699159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.709201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 368/715] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:37:00.731641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:00.800848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.843191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc192-1fdf-4ab5-91e4-ed2107fd059d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.870783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1ed4b-ab64-47f3-b7be-7b8fbcfdf953 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:00.884059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.886743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.887372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.889140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.890232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=d40d4b6dcab740c39553774b3daed388) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:00.892512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.894195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.896055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:00.911144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 348/716] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/role_assignments?user.id=d40d4b6dcab740c39553774b3daed388&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:00.937549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:00.939219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:00.939755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:00.940229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:00.941123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:00.942841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:00.960653 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:00.961839 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:00.962723 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:00.965814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 369/717] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:00.972167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:01.105566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd65c5-2b5e-44b3-a4f1-ced16e7a9dfe None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:01.138256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:01.146106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:01.147192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.147731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.148265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.149214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:01.149720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:01.151758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8303f19-e74b-4444-bd2b-318b202a7b38 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:01.157844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 349/718] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:01.163857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:01.283943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc22ea-0e62-43db-811d-dcf4ad85d31c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:01.324649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:01.325762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.326257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.326729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.327708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:01.328238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:01.330022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4310a-45bc-44d2-866d-5353057e1c65 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:01.336125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 370/719] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:02.052832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197428-25d3-4900-8508-0979fe2004e7 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.053737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197428-25d3-4900-8508-0979fe2004e7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.054235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de197428-25d3-4900-8508-0979fe2004e7 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.056171 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 350/720] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:02.062274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.062860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.063366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.087953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:02.089548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:02.141408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:02.193369 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 371/721] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:37:02.249529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de197428-25d3-4900-8508-0979fe2004e7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:02.400719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de197428-25d3-4900-8508-0979fe2004e7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:02.451019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:02.451880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.452159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.452431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.469074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:02.476813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:02.477771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:02.479200 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 351/722] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:02.484668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:02.624755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f426b8-1b3e-441d-b3c5-7b0978e0ac22 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:02.675367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:02.676445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.676927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.677419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.678401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:02.678907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:02.680635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95780cf4-86de-4cb1-af81-8af2e006ce80 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:02.690839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 372/723] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:02.696180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:02.702739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21cbf1-e82d-4148-a41a-cdbb554a2aff None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.703319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21cbf1-e82d-4148-a41a-cdbb554a2aff None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.703968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21cbf1-e82d-4148-a41a-cdbb554a2aff None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.707015 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 373/724] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:02.720933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.721659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.722133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.746920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:02.748508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:02.783738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:02.827690 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 374/725] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:37:02.842501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:02.852686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:02.969894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea5db-4a42-49e8-b2b2-9bd66a301b20 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:02.981606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6882-9932-48a6-a089-13f0fadb7b48 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.011182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.012470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.012954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.013428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.026474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:03.035090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:03.036162 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:03.037047 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:03.045202 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 375/726] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:03.047013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.076375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.077248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.077548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.077793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.095935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:03.104912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.106405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:03.137771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:03.138774 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:03.139709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:03.139709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:03.139709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:03.139709 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:03.148122 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 352/727] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:03.153864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.169901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb7d3c-1459-468a-92c2-668658055a9f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.207475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.209019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.209535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.210222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.211324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:03.211851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.213553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.227610 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 376/728] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:03.229300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.364800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31b21c-fdfd-4a72-8ff3-a107da77fe9c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.387765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:03.406380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:03.423945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.424564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61081-21c4-4b6d-a72b-5205a9107a2e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.425252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.425744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.426510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.428107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:03.428421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.429840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58c5da-23ab-4259-99d7-a62de891bd61 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.449167 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 353/729] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:03.451989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f45b4-c71d-4341-9cb2-e6e7a8ed802b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.452526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f45b4-c71d-4341-9cb2-e6e7a8ed802b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.453387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f45b4-c71d-4341-9cb2-e6e7a8ed802b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.455934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 354/730] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:03.457111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f45b4-c71d-4341-9cb2-e6e7a8ed802b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.471883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901591-e573-420b-999f-687c86d097f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.472858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901591-e573-420b-999f-687c86d097f8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.472971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901591-e573-420b-999f-687c86d097f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.473224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901591-e573-420b-999f-687c86d097f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.485919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901591-e573-420b-999f-687c86d097f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.487357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901591-e573-420b-999f-687c86d097f8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-81901591-e573-420b-999f-687c86d097f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:03.506574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:03.507604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:03.508520 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:03.508520 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:03.508520 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:03.508520 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:03.512695 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 377/731] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:03.514295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.514505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.514784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.538845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:03.541189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:03.586735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f45b4-c71d-4341-9cb2-e6e7a8ed802b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.630691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.631935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.632466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.632955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.639908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 378/732] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:37:03.640960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.642570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.644573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:03.663928 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:03.665007 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:03.665963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:03.669258 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 355/733] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:03.677096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.715928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:03.733287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:03.771929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4f53f-caad-43c9-828f-243a0e8b3c74 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.811202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.812231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.812515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.812820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.813630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:03.813934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.816421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.818425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3490-7e59-4811-ad48-98344357f5d2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:03.835768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 379/734] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:03.835768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:03.865616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:03.866738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:03.867298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:03.867807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:03.869037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:03.871185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:03.901342 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 356/735] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:03 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:03.901342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.044887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4e12-e439-4061-8640-a0db32f24825 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.108768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.110612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.135318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.136248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816afe1-2806-4fe7-9b6f-b611fce63597 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.136675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.137152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.137654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.138736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:04.139274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.140979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.177545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.178387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.178668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.178939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.185435 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 380/736] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:04.191040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.202879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.205008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:04.230159 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:04.231232 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:04.232205 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:04.235325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 357/737] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:04.240578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.325423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c45cc-f26c-4683-80ca-61e3b8eaea37 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.366702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.367916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.368441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.369060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.380314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885603-d2b4-45c4-bedd-238ed1dd8c6f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.382808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.384704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7eb35083-6a9d-4b27-84a4-8d4c2fc7678c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:04.409753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:04.410744 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:04.411691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:04.411691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:04.411691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:04.411691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:04.411691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 381/738] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:04.412480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd7be-5937-4ff6-aa87-3c54728e6afe None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.412712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd7be-5937-4ff6-aa87-3c54728e6afe None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.412995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd7be-5937-4ff6-aa87-3c54728e6afe None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.416134 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 382/739] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:04.416134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c871-b7e1-4a53-a2e4-fcfda5718cc3 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.416134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c871-b7e1-4a53-a2e4-fcfda5718cc3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.416420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24c871-b7e1-4a53-a2e4-fcfda5718cc3 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.417601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 383/740] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:04.419386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c871-b7e1-4a53-a2e4-fcfda5718cc3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.434021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.434704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.434988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.435260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.436163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:04.436473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.438042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87eadc-cd7d-495b-8723-7353030e25ab None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.459724 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 358/741] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:04.459724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382c0e-cf78-4427-a608-f04c84644ca0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.459724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382c0e-cf78-4427-a608-f04c84644ca0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.459724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382c0e-cf78-4427-a608-f04c84644ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.460662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.468807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.482092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-93382c0e-cf78-4427-a608-f04c84644ca0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:04.483285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-93382c0e-cf78-4427-a608-f04c84644ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:04.542960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24c871-b7e1-4a53-a2e4-fcfda5718cc3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.575621 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 359/742] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:04 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:37:04.575621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.575621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.575621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.584953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:04.586148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:04.596305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.597500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.597889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.598312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.599341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:04.599682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.601101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.622109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 384/743] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:04.622109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.665898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 360/744] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:04 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:37:04.667076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.730778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.741490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411a31-2fc3-480f-8515-561e50fe236a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.742891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.784375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.784629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1709ef-4d7e-4c60-b9da-6ed6ecc0bd9e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.785039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.785429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.785716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.820356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.821554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.822053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:04.822423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:04.833623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:04.841920 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:04.842908 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:04.843793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 361/745] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:04.845238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.862934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:04.864547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:04.958053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3fa1f-d30b-4dc2-9526-1e28ed543968 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:04.968446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.977569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 385/746] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:37:04.983117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:04.985333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:04.998626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:04.999430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:04.999743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.000017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.007374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.008919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:05.026431 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:05.027439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:05.028384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 362/747] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:05.028920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.118154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf8dc-22d1-4ace-bcc8-674cae9687bf None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.158563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64cf4-9604-4662-b21c-2040c8db428c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.159728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.160359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.160641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.160913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.161648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.163166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.180665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 386/748] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:04 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:05.182057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.209849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.211000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.211578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.212060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.213147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:05.214011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.215855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.236113 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 363/749] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:05.237509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.303981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:05.313629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:05.341975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c83a3-80d9-4fb4-9a0b-a5f582d95f94 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.390446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f15-8e8c-4d9f-a7fd-399baa523f3d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.392699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.393994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.394380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.395760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.410770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.413593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:05.436354 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:05.437388 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:05.438360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:05.438360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:05.438360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:05.438360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:05.442754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 387/750] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:05.443809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.445021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.445891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.446166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.446438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.448345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:05.448797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.450262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.466177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 364/751] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:05.466861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.574037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288965a2-8eab-4b74-b7f7-3ba3c4ccb08e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.582412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:05.611070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad030787-1ad4-4609-9cfd-82ab86b36a56 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.613798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:05.618840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.621046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.621533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.622019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.635128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.637046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.653818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.654488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.654777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.655194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.655968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:05.656276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.658291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:05.658992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:05.659879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:05.660835 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:05.660835 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:05.660835 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:05.660835 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:05.663167 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 388/752] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:05.664417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.678956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 365/753] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:05.678956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.792220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286502a-0200-43e3-8b90-9d6dedb27332 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.829419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b6ac2-2757-4e28-ba25-468cb9a3e4a1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:05.839292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.840634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.841150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.841621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.843916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=1d53786e35f04229b4fdb375d5141b99, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.845952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.864423 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 389/754] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:05 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:37:05.865699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.872593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:05.873699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:05.874162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:05.875825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:05.876751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:05.877068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:05.878559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:05.893244 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 366/755] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:05.898970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:05.901124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:05.942317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:06.032673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7913-849d-4217-a3e2-8c266d79ead4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.075761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.077113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.077634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.078110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.089391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.091295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:06.107932 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:06.109046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:06.110135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:06.113627 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 367/756] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:06.123296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:06.150406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ff962-a5d6-4ee1-b7f0-7c2b23b4c74b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.241808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.245679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.245679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.246942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.255359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.257224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:06.281594 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:06.283769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:06.285105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:06.285826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:06.289154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 390/757] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:06.298602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:06.326264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7d93b-5e38-4eb4-b08d-cb7173ab5946 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.388111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:06.408714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b3adf-89fd-48f2-92c7-d97f0366c4aa None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.423980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.424669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.425058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.425340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.426419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:06.426734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.428287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.463643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.464339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.464619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.464889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.465688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:06.465994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.467454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.470035 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 368/758] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:06.476166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:06.482848 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 391/759] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:06.489161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:06.636310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c430-f91d-425c-b69e-960a4cdd517c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.678490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.679149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.679430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.679865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.680797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=03b02ac92ea443e3b329758bc367972e) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:06.681180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.682791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872cf98-1246-4a52-a0c8-213848ee5a69 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.691373 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 392/760] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/role_assignments?user.id=03b02ac92ea443e3b329758bc367972e&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:06.696001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171973-6816-4f88-9476-0243d91ba6bc None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:06.698083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad10c-f0a4-442a-a2b6-d863b850953f None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.698439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad10c-f0a4-442a-a2b6-d863b850953f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.698916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ad10c-f0a4-442a-a2b6-d863b850953f None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.708108 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 393/761] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:06 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:06.714301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.714662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.715151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.734010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:06.744787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:06.745847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:06.746320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:06.746801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:06.762352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:06.769878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:06.771156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:06.838623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:06.840699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:06.973966 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 394/762] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:06.979775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 369/763] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:06.993141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.003942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.090461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:07.160246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6a4a-3e90-49b0-8323-5c566c484d7e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.194963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:07.204597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.205360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.205666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.205915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.214560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60aea-045c-4627-adc6-7fa106588bd6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.232801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.234869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:07.267877 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:07.268993 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:07.270771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:07.270771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:07.270771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:07.270771 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:07.270771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 395/764] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:07.275594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.276747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.276879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.277360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.277839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] PATH_INFO: `/v3/services/network` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.278784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.280497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:07.298742 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:07.300149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:07.301148 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:07.304985 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 370/765] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:06 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:07.310725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.513801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5b1ff-16a0-4227-81a5-d87f0ff30105 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.516740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:07.519677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5110ec-a840-4793-b171-dff81ea7d2d8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.562445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.563236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.563546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.563827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.564583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] RBAC: Adding query filter params (name=network) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:07.564894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.566346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.578813 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 371/766] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:07.585055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.586221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.586963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.587235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.587477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.588265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:07.588578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.590047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.620206 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 396/767] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:07.627959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.692034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:07.782758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321fb2b-42f9-4501-9b3b-371ecf010bdb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.783007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6be3-f4eb-4093-b99c-ce58921bbf69 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:07.827941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.828557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.828846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.829145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.829853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] RBAC: Adding query filter params (type=network) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:07.830166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.831612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.843934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:07.844642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:07.845002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:07.845193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:07.848178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 372/768] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:07.855179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:07.856592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:07.859671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:07.903918 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:07.905686 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:07.908864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 397/769] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:07.912711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:07.955622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:08.063467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0805bbf-8b3f-4c02-8942-18b2ada5a260 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:08.151538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7329-5548-46e5-9449-89ab3adb8d72 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:08.157875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:08.167059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:08.172941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.173692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.174237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.175457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] RBAC: Adding query filter params (interface=public, service_id=360389c9cd834a11a7a231637ae19a7a, region_id=RegionOne) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:08.176185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:08.178228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:08.204375 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 373/770] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/endpoints?service_id=360389c9cd834a11a7a231637ae19a7a&interface=public®ion_id=RegionOne => generated 194 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:08.211099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:08.245018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:08.245800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.246258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.246714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.248230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:08.248935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:08.252016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82fc76-464c-4ea3-9b03-1ecb75871467 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:08.269821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 398/771] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:08.271310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab494c7-d100-43ea-98b8-29ab8bee9123 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.271659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab494c7-d100-43ea-98b8-29ab8bee9123 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.271953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab494c7-d100-43ea-98b8-29ab8bee9123 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.278441 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 399/772] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:08.279664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab494c7-d100-43ea-98b8-29ab8bee9123 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:08.362132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:08.368642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c812478-0f79-4a30-aeb8-7229c9b80e20 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:08.406836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab494c7-d100-43ea-98b8-29ab8bee9123 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:08.418782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:08.419475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.419821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.420158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.421395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:08.422488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c4e-578d-4d91-911d-cdbada3c7825 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:08.436083 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 374/773] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:08 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:08.437851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.438125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.438402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.459618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:08.460987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.461579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.462090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.463261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=d40d4b6dcab740c39553774b3daed388) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:08.465343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:08.467245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:08.477079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:08.480302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:08.482781 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 400/774] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:08 2022] GET /identity/v3/role_assignments?user.id=d40d4b6dcab740c39553774b3daed388&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:08.630424 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 375/775] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:08.659393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:08.694149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:08.814060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c1cd-c346-4091-8d2a-3bf7ac09d145 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:08.862498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:08.863767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:08.864281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:08.864770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:08.865640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:08.867385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:08.882738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:08.883749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:08.884601 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:08.891994 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 401/776] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jun 4 20:37:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:08.895039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.004821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:09.017274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662560e-b53b-4d1b-a204-bf9dd2214ebd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:09.057091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:09.058292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.058779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.059353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.060700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:09.061228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:09.063000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77c2f-019a-4820-8fb8-745347ebb61e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:09.069435 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 376/777] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:09.075920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.088502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75cf5-6d75-4baa-ba25-91219d5b47d9 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.090958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75cf5-6d75-4baa-ba25-91219d5b47d9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.091453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75cf5-6d75-4baa-ba25-91219d5b47d9 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.093551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 377/778] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:09.100564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.101534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.102086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.126554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:09.128282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:09.212930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 378/779] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:09.227795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:09.238555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecddbc-81fa-4eeb-b1aa-286f42b18b8c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:09.255812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.278033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:09.278732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.279018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.279293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.280060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:09.280368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:09.287976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:09.288366 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 402/780] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:09.296883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.452180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:09.479579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94dafe-e4dd-47e0-9af4-19c45c46c2f3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:09.533244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27660-c68b-4d74-9831-dd2b678dec42 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:09.580569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:09.581674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.582946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.583376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.619216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:09.636702 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:09.638143 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:09.639101 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:09.644397 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 379/781] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:09.648959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.655046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:09.655046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:09.655046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:09.655046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:09.655444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] RBAC: Adding query filter params (interface=public, service_id=8b91574e60fd40cfb905b5a83897ad7b, region_id=RegionOne) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:09.656497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:09.658256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:09.682816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 403/782] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:09 2022] GET /identity/v3/endpoints?service_id=8b91574e60fd40cfb905b5a83897ad7b&interface=public®ion_id=RegionOne => generated 194 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:09.701152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:09.749216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:09.922275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba838-52ef-43d7-b65b-3962cea22f02 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:09.947746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862805f-9d18-402a-bbcf-051b48058d6b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.002383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.003791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.004858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.005698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.006333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.007283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.008411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:10.008889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.009415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.009929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.010802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.012535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.014270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fdfeb-31df-42d4-a44d-eaa2b117585b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.035542 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 404/783] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:09 2022] GET /identity/v3/services => generated 772 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:10.039686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7828-f06a-4d8c-bdcc-7a5fbe530691 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.042449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7828-f06a-4d8c-bdcc-7a5fbe530691 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.043152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 380/784] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:10.043701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa7828-f06a-4d8c-bdcc-7a5fbe530691 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.045785 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 405/785] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:10.053317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.055825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.058725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.059492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.078334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:10.124972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:10.126956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:10.262422 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 406/786] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:10.278587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282b36-ab63-4394-900c-448d7c2ca162 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.304291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.335667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:10.338625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.339439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.339753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.340100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.354792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.356577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:10.377469 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:10.378357 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:10.379275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:10.379275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:10.379275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:10.379275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:10.379275 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 381/787] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:10.386401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.487929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:10.510875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfab26c-046c-476a-9dd9-347be75dcd0f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.528985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ecde-84ac-4e71-9879-a303f64d1131 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.574148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.576625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.578519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.579088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.596149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.597412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.597935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.598514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.599814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:10.600447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.602507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.608503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:10.617140 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 382/788] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:10.619432 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:10.620435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:10.621337 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:10.623544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.625729 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 407/789] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:10.631856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.742773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc23b7-dc4f-49bf-9ae0-6482e1655a8d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.762483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:10.783414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.784640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.785166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.785654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.794873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.797437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:10.813471 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:10.814487 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:10.815434 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:10.816048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:10.818527 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 383/790] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:10.824999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.870922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2cca-9d20-4221-a35a-27a4dc6b2be6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:10.937243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:10.937961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:10.938245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:10.938522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:10.939295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:10.939633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:10.941067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:10.956941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 408/791] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:10.962673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:10.997043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dbd88-5663-4d53-9fc5-ad5f6d4d52ff None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.061823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.062886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.063175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.063449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.064438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:11.064756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.066231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.106719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 384/792] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:11.117587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:11.196004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:11.213109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420ea4-d0e2-4337-bb35-8a627269c26a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.268653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856ffd-3ef7-4a61-895f-d01bd4648b16 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.310799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.311468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.311784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.312112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.327746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.328620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.328905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.329186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.336905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:11.365667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.367201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:11.392255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:11.393258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:11.394170 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:11.394170 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:11.394170 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:11.394170 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:11.399543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.399543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.400347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 409/793] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:11.400347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:11.436346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:11.543144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52f32-8806-4f9d-ae1a-2c7ec5660b49 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.551310 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 385/794] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:11.556920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:11.579547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.580597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.581087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.581561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.582493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:11.582995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.584651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.598871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 410/795] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:11.620640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:11.704243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1dac3-674f-4acb-ae3e-a3cf2132c86c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.716623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:11.746817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.748350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.748658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.748917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.753419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:11.764190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.766075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-fa78b909-cfc5-4d63-afaf-7d38a55294ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:11.786217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:11.787221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:11.788198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:11.788198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:11.788198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:11.788198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:11.788198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 386/796] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:11.789169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a97-4d59-40af-9121-4174f522da86 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.789283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a97-4d59-40af-9121-4174f522da86 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.789525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64a97-4d59-40af-9121-4174f522da86 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.791130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 387/797] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:11.795570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5bbcd-fba3-4364-8545-2b7dce6e3e59 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.795570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5bbcd-fba3-4364-8545-2b7dce6e3e59 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.795570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5bbcd-fba3-4364-8545-2b7dce6e3e59 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.795570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 388/798] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:11.795570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5bbcd-fba3-4364-8545-2b7dce6e3e59 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:11.798410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33ef1-f1d9-4938-9273-2ab26cd1a232 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.841718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.842473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.842756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.843028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.853889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.855853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7d25107f-465d-4e66-bad6-8c983404e1c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:11.873129 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:11.874181 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:11.875283 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 411/799] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:11.876942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259626ae-906e-4da4-87de-2874aed8ba63 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.876942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259626ae-906e-4da4-87de-2874aed8ba63 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.876942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259626ae-906e-4da4-87de-2874aed8ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.894848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-259626ae-906e-4da4-87de-2874aed8ba63 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:11.896150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-259626ae-906e-4da4-87de-2874aed8ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:11.928341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5bbcd-fba3-4364-8545-2b7dce6e3e59 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:11.969657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:11.970352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.970634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.971004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.971710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:11.972027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:11.983750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 412/800] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:11.983991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:11.984073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:11.984073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:11.984073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:11.994800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:11.996146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:11.998107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 389/801] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:11.999110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.035853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.075426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.083828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 413/802] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:12.084694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.149579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27370b9-82d2-4ba6-9b4b-efda2799dcc4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.189702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.190472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.190817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.191095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.191977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:12.192286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.193735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.210928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d63028-a0b3-4ea6-a88f-b7475ef4ae85 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.217277 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 390/803] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:12.217277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.256769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.257549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.257823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.258090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.270700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:12.279127 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:12.281029 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 414/804] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:12.282813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.315457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.336457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c158-c656-4027-a6ca-23b1d0614426 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.345627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.378888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.379722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.382963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.382963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.388827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.390309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.404014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cb01-8990-4cc1-b803-0a99ad226026 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:12.405576 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:12.406591 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 391/805] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:12.408217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.447725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.448536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.448815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.449085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] PATH_INFO: `/v3/services/network` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.449740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.451148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:12.463919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:12.465023 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:12.465845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 415/806] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:12.466668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.539149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ee401-56fc-4eaa-b83a-28d431d224c7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.585255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.587136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.588552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.589006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.589466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.602392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106adfeb-29c4-435e-af37-1eacad379010 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.607269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.609112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:12.629412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:12.630872 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:12.632495 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:12.632495 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:12.632495 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:12.632495 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:12.635444 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 392/807] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:12.636377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.654150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.654734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.655016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.655436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.656686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:12.657026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.658785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.664725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.672450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 416/808] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:12.674468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.769751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55c00-2435-4a80-a757-60aa9535a6aa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.801719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ff15-3b23-480c-abeb-1a7571ae19b0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.812577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.813814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.814228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.814599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.815465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:12.815867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.817494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.841109 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 393/809] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:12.841109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.850757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:12.851621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:12.851992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:12.852361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:12.853162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] RBAC: Adding query filter params (name=network) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:12.853528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:12.854982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:12.865273 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 417/810] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:12.865273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:12.884380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.943418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.970846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb79e2a-a20c-4e50-ad85-82381a6c7176 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:12.976581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064a085-ecf5-4a91-9854-53d8877f8647 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.013556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.013937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.014568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.015010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.015177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.015457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.015678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.016337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.017026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:13.017534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.019901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.033482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.035740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.039861 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 394/811] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:13.041266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:13.063429 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:13.064612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:13.065691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:13.065691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:13.065691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:13.065691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:13.065691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 418/812] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:13.066808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.165105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.205097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63266-f0ea-4612-8779-97e682cb83ef None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.214026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e714-d722-4566-ac81-f18b852241c0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.245227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.245937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.246220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.246722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.247403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:13.247839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.248968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.249291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9017ca-f074-4d77-b257-1ecf3ec203bb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.249636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.249924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.250239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.250948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] RBAC: Adding query filter params (type=network) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:13.251249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.252676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.256719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 395/813] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:13.258050 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 419/814] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:13.258298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318eb-bf17-434e-8551-d50229d11cd0 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.258298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318eb-bf17-434e-8551-d50229d11cd0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.258578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318eb-bf17-434e-8551-d50229d11cd0 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.258696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.263553 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 396/815] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:13.263553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126318eb-bf17-434e-8551-d50229d11cd0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.271942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.397731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1b6dc-3967-44fc-b301-8397e1157e23 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.447353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126318eb-bf17-434e-8551-d50229d11cd0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.448830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.449981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.450268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.450583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.454902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.463447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.465847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f4e93723-4b40-4898-8ece-0e59b9cbbaf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:13.483982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:13.485841 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:13.486742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 420/816] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:13.487234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.487234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.487736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.502368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.504060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.504392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.504673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.505553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:13.506439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.506535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:13.507974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:13.508510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.526825 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 397/817] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:13.528115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.614709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.635535 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 421/818] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:13.635535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.686879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df180160-c7e3-4e95-8329-6e0116be9526 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.731674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.732472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.732924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.733221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.734291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.736344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.757017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92732a4-6ef3-4924-9ec3-f9ee07083d93 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.767546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 398/819] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:13.767546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.798662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.822363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.823108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.823391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.823705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:13.824832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:13.825159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:13.826679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:13.849161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 422/820] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:13.850015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:13.930829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5c141-da47-47f8-adba-9863a7de66ad None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:13.958577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:13.986920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:13.987763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:13.988124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:13.988414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.001526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.003393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.004268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117696-fbe6-44fe-a604-c200167ab97c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:14.023982 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:14.026282 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 399/821] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:14.029198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.060942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.061658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.061939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.062215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.063404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.065840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:14.084021 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:14.085189 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:37:14.086308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:14.089233 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 423/822] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Jun 4 20:37:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:14.090483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.161060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:14.190307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ff6f-d6c2-48a0-ac4c-386ae02cb22a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.233850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481904de-57d7-40db-a07c-1d2752937d01 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.242678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.243592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.243903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.244230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/03b02ac92ea443e3b329758bc367972e/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.261783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=03b02ac92ea443e3b329758bc367972e, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.263411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.277173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.277436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.277436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.277951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.278834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:14.279231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.281032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.294212 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 400/823] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:14 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/03b02ac92ea443e3b329758bc367972e/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:37:14.294212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.319715 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 424/824] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:14.324323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.336384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:14.465014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e240-6ed6-4b07-aa7d-893efd10674f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.501859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a741b-0596-4672-b97d-e1fc628c56bf None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.504886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:14.508761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.509424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.509710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.510037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.510774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:14.511084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.512667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.519038 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 401/825] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:14.525961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.561169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.562268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.562774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.563196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.584452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.587155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:14.611071 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:14.612300 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:14.613210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:14.613210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:14.613210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:14.613210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:14.613210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 425/826] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:14.618898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.651617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:14.662215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711bb5-04a5-4e91-9436-f9c4617b283d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.700602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.701581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.702065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.702819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.703985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:14.704559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.706483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.714180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 402/827] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:14.722957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.763460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbeae-c05b-4a6f-8563-07426cb41274 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.806132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.807314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.807868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.808385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.809344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:14.809864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.811701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.826174 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 426/828] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:14.833974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:14.860240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87809df-7393-46ad-a9d1-3e99a3a1fdb2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:14.864920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:14.906089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:14.907575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:14.908207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:14.908739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:14.911666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:14.913484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:14.942826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 403/829] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:15.009158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e618852-8f4e-4b44-87d1-b0142890c093 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:15.060996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:15.062329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:15.062899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:15.063388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:15.072491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:15.074459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:15.092208 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:15.093289 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:15.094360 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:15.097300 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 427/830] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:15.103766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:15.124333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:15.231777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a683f-20fc-48c3-8290-3e6a6c4a3f5f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:15.277207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:15.277881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:15.278161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:15.278472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:15.279323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:15.282845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:15.282845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37a0f0-fd1c-4dfd-b8bd-8bac97a9d53c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:15.308427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 404/831] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:15.317761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:15.399710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:15.437854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca4fd-59ab-4871-bf7a-389a7326c7a6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:15.482773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:15.483816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:15.484123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:15.484594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/d40d4b6dcab740c39553774b3daed388/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:15.488150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=d40d4b6dcab740c39553774b3daed388, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:15.489858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fae110-17fe-4d2b-bdab-cf9bc761baf0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:15.508029 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 428/832] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:15 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/d40d4b6dcab740c39553774b3daed388/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:37:15.867754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824dd8-3cf2-4041-9d50-9086a892059d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:15.868042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824dd8-3cf2-4041-9d50-9086a892059d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:15.868324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824dd8-3cf2-4041-9d50-9086a892059d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:15.870242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 405/833] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:15.876941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:15.877233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:15.877512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:15.897221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:15.898620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:16.008902 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 429/834] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:16.049092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824dd8-3cf2-4041-9d50-9086a892059d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:16.145625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:16.185047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824dd8-3cf2-4041-9d50-9086a892059d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:16.225178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:16.226006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:16.226344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:16.226625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:16.227298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:16.228733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:16.242934 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:16.245378 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:16.247589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 406/835] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jun 4 20:37:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:16.255096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:16.323834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:16.375056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289bd26-cc02-4e77-a892-fa9b36dba3a3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:16.414469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:16.415145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:16.415433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:16.415736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:16.416678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:16.417093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:16.418959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446e3b6-2336-4462-973c-5e433845b164 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:16.426541 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 430/836] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:16.433180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:16.569102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081dc1-f793-4281-a26a-4f80517c4a31 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:16.604651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:16.605319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:16.605645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:16.605923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:16.606631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:16.606937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:16.608342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdd57-4e71-45cd-8a9a-2e8a9d4d78d8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:16.610559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:16.614022 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 407/837] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:16.801840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee095a1-868b-4a37-92d7-f243e427ee1d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:16.802157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee095a1-868b-4a37-92d7-f243e427ee1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:16.802426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee095a1-868b-4a37-92d7-f243e427ee1d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:16.804215 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 431/838] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:16.810210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:16.810494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:16.810772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:16.831616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:16.832815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:16.911136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 408/839] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:16.930387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee095a1-868b-4a37-92d7-f243e427ee1d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.035035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee095a1-868b-4a37-92d7-f243e427ee1d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.063762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:17.080043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.081313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.081797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.082286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.094075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:17.102442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:17.103406 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:37:17.104302 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:17.107154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 432/840] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:17.113114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.216227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972768a4-a949-4c1a-92e0-cfaef3d51e14 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.245885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:17.252391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.253246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.253589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.254048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.254803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:17.255108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:17.256514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:17.269788 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 409/841] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:17.272613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.386909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd953a-3bbd-44e0-b5f6-206f77596d1a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.425378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.426190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.426472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.426746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.440382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:17.441875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:17.461173 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:17.462177 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:17.463066 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:17.463066 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:17.463066 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:17.463066 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:17.463066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 433/842] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:17.468744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.579693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495887-8e79-4c8a-b97d-e742144636c6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.614892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.615591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.615873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.616147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.616885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:17.617190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:17.618580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5978b-3ef9-4109-aa64-243b7246857e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:17.635749 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 410/843] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:17.637554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.662307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9419e3-f91f-4a2d-9705-f066ce332fdc None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.662628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9419e3-f91f-4a2d-9705-f066ce332fdc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.662861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9419e3-f91f-4a2d-9705-f066ce332fdc None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.664535 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 411/844] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:17.670060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.670364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.670617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.681110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:17.691295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:17.692609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:17.743796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:17.759409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4944fc-5482-41a7-8fac-161529b35220 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.775532 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 412/845] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:17.791772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.798247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.799131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.799416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.799726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.808002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:17.809470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:17.824916 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:17.825920 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:17.826855 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 434/846] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:17.836479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.904471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe252b-722a-4241-afe0-f71c79cfdaf6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:17.942639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:17.943442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:17.943753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:17.944029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:17.944686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:17.946166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:17.959704 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:17.960754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:17.961595 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:17.966381 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 413/847] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:17.967297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:17.976890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:17.986196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c63269-2330-4319-ae28-29b3c4a150e4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.026571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.035500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.036208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.036489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.036761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.037604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:18.037917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.039358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7e35b-e474-4cfd-b55b-b03a8623a924 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.062220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 435/848] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:18.062220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f969-76a9-47e8-86b0-d246f84ec136 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.062220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f969-76a9-47e8-86b0-d246f84ec136 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.062220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222f969-76a9-47e8-86b0-d246f84ec136 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.062220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 436/849] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:18.064589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222f969-76a9-47e8-86b0-d246f84ec136 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.101805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355b401-8a7f-4810-a12b-0f94113116d5 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.137370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.138067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.138297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.138567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.139274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:18.139607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.141208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f7dc7-e87c-4ed7-ae64-8264bf91e72b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.147732 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 414/850] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:18.148955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.149246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.149521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.168215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:18.169305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:18.182154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222f969-76a9-47e8-86b0-d246f84ec136 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.218328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.219117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.219400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.219735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.248557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.251904 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 415/851] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:18.252808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.303641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.305377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.306914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.366899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea5787-6371-482d-96fc-ffc1414a3b67 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.402136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.402807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.403087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.403358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.404101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:18.404401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.405792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.419637 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 416/852] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:18.419637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.434505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 437/853] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:18.440080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.516907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.541630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418534-4327-4fa4-9aae-60bff65489df None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.544651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.583307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.584238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.584523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.584806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.585174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27723cba-d636-4b8b-80e2-ee672fb1c403 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.598550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:18.606736 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:18.609207 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:18.611085 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 417/854] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:18.617023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.654149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.655774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.656390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.657101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.670756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.672862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:18.692912 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:18.693879 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:18.694769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:18.694769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:18.694769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:18.694769 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:18.697132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 438/855] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:18.705438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.735653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b8eeb-395d-4d57-ba24-bb8ede361d01 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.782882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.784095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.785582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.786033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.786945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:18.787395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.789128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.806969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 418/856] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:18.808819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.831882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301fc7-8983-4730-9ac5-d07cac27dd83 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.841480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.850304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:18.876288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.877187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.877537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.877881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:18.878805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:18.879165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:18.880702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:18.895993 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 439/857] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:18.902455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:18.958254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f215cd-91a4-4681-b411-d691423b6810 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:18.996547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:18.997465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:18.997821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:18.998156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.011277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.013046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.024351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86068df2-d494-4a05-be27-298a779a38dc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:19.033218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:19.034185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:19.035086 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:19.035086 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:19.035086 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:19.035086 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:19.039443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 419/858] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:19.040484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.065466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.066597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.067053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.067550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.075111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.077063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:19.092695 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:19.094156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:19.095220 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:19.097925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 440/859] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:19.103441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.148219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.148766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.181954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfd8d-b20b-4fdd-8805-54880dacd3b6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.220685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.221264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.221546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.221844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.222537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:19.222846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.224249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4325161-94b4-44bd-b3b7-e5757f2b9321 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.241507 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 420/860] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:19.241772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a296026-08b7-45cb-9947-66047816cff2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.241873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff57-b7ba-4987-90f9-04b41e03e936 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.241873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff57-b7ba-4987-90f9-04b41e03e936 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.241873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff57-b7ba-4987-90f9-04b41e03e936 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.241873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 421/861] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:19.245811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ff57-b7ba-4987-90f9-04b41e03e936 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.279502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.280199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.280483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.280760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.281790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:19.282108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.283606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d22300-4250-49aa-8c15-49a9c1d22321 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.301097 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 441/862] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:19.302507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.302803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.303086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.319796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:19.321018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:19.352619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ff57-b7ba-4987-90f9-04b41e03e936 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.392980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.393810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.394114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.394387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.401218 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 442/863] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:19.402609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.404918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.405050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.409997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.424612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:19.429046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:19.430098 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 20:37:19.431051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:19.433125 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 422/864] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:19.435382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.525275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3b88f-f2b0-4f77-b97c-f01d408dcece None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.559463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10773e8-00ae-4440-b67c-6c8351a36039 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.565096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.565806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.566089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.566344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.567230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=03b02ac92ea443e3b329758bc367972e) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:19.567540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.569058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.576019 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 443/865] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/role_assignments?user.id=03b02ac92ea443e3b329758bc367972e&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:19.576885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.615702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.616834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.617666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.618218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.619913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.622053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.640719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 423/866] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:19 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:19.711867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.737688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985f5c-f75f-424d-89e4-3ad68d6c4ea4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.790057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.790685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.790972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.791253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:19.792208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:19.792597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:19.794339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:19.823140 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 444/867] 10.222.0.18 () {56 vars in 1135 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:19.829094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:19.905963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:19.956483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3f45-f511-4686-a3ab-17d9f03bacf1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:19.996832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:19.997487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:19.997768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:19.998034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:20.073241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:20.074623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:20.133329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:20.179084 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 424/868] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:19 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:20.189568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:20.349074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d3893-decf-47d9-90e2-0c2d04a75273 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:20.385826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:20.386639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:20.386921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:20.387192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:20.389380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:20.399268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:20.401167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:20.421112 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:20.422176 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:20.423085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:20.423085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:20.423085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:20.423085 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:20.423905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 445/869] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:20.430135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:20.543817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417ac8-4fe4-4bae-913b-211b8c7c94b4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:20.582815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:20.583496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:20.583802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:20.584081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:20.584816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:20.585125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:20.586505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:20.600356 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 425/870] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:20.606729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:20.740332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ea237-ca79-4c63-a239-f7a82503a36a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:20.777584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:20.778402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:20.778679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:20.778952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:20.786261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:20.787754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:20.802716 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:20.803693 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:20.804604 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 446/871] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:20.811342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:20.839358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:20.931429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47917429-cdee-4298-b8b6-aaa5e871a86b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:20.966239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:20.966911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:20.967190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:20.967463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:20.968285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:20.968946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:20.970405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1299f-72a2-4a05-9247-d212fcceee8a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:20.984463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 426/872] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:20.992647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:21.009178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6898-eec1-46e7-a957-6e6abf19b0f3 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:21.009518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6898-eec1-46e7-a957-6e6abf19b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:21.009745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d6898-eec1-46e7-a957-6e6abf19b0f3 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:21.011388 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 427/873] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:21.016920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:21.017204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:21.017489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:21.038302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:21.039648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:21.055603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:21.117240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2950b-5fff-4ab8-bb76-77d63d090517 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:21.133826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 428/874] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:21 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:21.159149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:21.161914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:21.162908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:21.163396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:21.163915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:21.164992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=d40d4b6dcab740c39553774b3daed388) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:21.165550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:21.167407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914ec26-da01-4c0a-9ae2-a37b3b457b81 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:21.170156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:21.177092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 447/875] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:20 2022] GET /identity/v3/role_assignments?user.id=d40d4b6dcab740c39553774b3daed388&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:21.282791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9adc5-ded0-4b9b-b721-a43a6987967f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:21.321131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:21.321825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:21.322108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:21.322387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:21.323126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:21.324588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53ac1-fae3-4a04-af9e-96f20c47275b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:21.342689 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 429/876] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:21 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:22.307531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fa8-1f72-44db-a8e0-1085fc26558b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.308180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fa8-1f72-44db-a8e0-1085fc26558b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.308180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42fa8-1f72-44db-a8e0-1085fc26558b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.309765 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 448/877] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:22.316048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.316599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.316599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.326041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73553d86-58c2-4afd-8bff-5be5361177ef None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.326404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73553d86-58c2-4afd-8bff-5be5361177ef None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.326605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73553d86-58c2-4afd-8bff-5be5361177ef None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.329201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 449/878] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:22.334026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:22.334722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.335016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.335227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:22.335342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.353461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:22.354678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:22.425824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:22.438563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 450/879] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:22.449775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 430/880] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:22.465335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.479902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.508545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:22.595302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97dd51-5bb2-4909-b03a-560eda9b16de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:22.612238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a20026-5313-4bfb-b07d-ec367b258d1c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:22.632007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:22.632838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.633125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.633404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.634068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:22.635485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:22.648430 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:22.649479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:22.650747 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:22.655242 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 451/881] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:22.656704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.659266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:22.660451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.661705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.662013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.676981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:22.688679 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:22.690299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:22.691573 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:22.695601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 431/882] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:22.696678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.775854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:22.777483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:22.779347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55665e0-22b7-4ff6-8506-3b1bca26f8b0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:22.820510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:22.821179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.821458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.821725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.822426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:22.822728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:22.824322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:22.829594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 452/883] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:22.838280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.842554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560d7c-327d-4cea-a1a7-28169bd85d3e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:22.888247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e33455-879c-4262-8584-315029422e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:22.889000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33455-879c-4262-8584-315029422e53 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:22.889380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33455-879c-4262-8584-315029422e53 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:22.889750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e33455-879c-4262-8584-315029422e53 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:22.890940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e33455-879c-4262-8584-315029422e53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:22.891595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e33455-879c-4262-8584-315029422e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:22.893305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e33455-879c-4262-8584-315029422e53 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:22.909591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 432/884] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:22.911098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e33455-879c-4262-8584-315029422e53 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:22.978590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af665fb-0715-4110-81c3-aa794ea02268 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.018196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.019061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.019440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.019871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.020818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:23.021256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.022792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.027879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e33455-879c-4262-8584-315029422e53 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.029573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 453/885] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:23.037489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.052780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.071819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.078971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.079822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.080107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.080383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.095395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.097216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:23.122015 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:23.123008 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:23.123966 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:23.123966 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:23.123966 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:23.123966 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:23.123966 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 433/886] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:23.130016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.165126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e3ce7-a4e1-474b-864a-9fa419b7afc8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.206179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.207199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.207695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.208132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.209147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] RBAC: Adding query filter params (interface=public, service_id=93ab046b80be4db6acc5e6f8c5ee1447, region_id=RegionOne) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:23.209650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.211337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.218605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 454/887] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/endpoints?service_id=93ab046b80be4db6acc5e6f8c5ee1447&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:23.225192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.283087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631fba-8bfb-4c50-8f12-eb408a163e0f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.324989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.326563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.327082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.327609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.328718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:23.329404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.331323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.342820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.353183 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 434/888] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:23.354797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.355540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9370-d908-45c2-bde4-b14557b435b9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.391802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.409796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.411091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.411632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.412140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.414013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.416599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.432335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 455/889] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:37:23.496707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1da6c-a050-4216-8ab7-9094577e541c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.540280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.541139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.541427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.541704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.550222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.551739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c51b6d8c-de2a-46fe-9ccc-f2e3a0a7e64f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:23.573115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:23.574180 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:23.575182 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:23.578484 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 435/890] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:23.584141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.709639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932061-a3e0-4c59-a316-32d62b09a4d7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.724360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38fcf-1b33-44ed-b54e-99e52624dd4a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.724706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38fcf-1b33-44ed-b54e-99e52624dd4a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.724934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38fcf-1b33-44ed-b54e-99e52624dd4a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.726344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 436/891] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:23.732745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b437-9b37-4e8a-9b5a-e3537f7342e8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.733027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b437-9b37-4e8a-9b5a-e3537f7342e8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.733293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b437-9b37-4e8a-9b5a-e3537f7342e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.755436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7324b437-9b37-4e8a-9b5a-e3537f7342e8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:23.756703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7324b437-9b37-4e8a-9b5a-e3537f7342e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:23.760904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.761846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.762297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.762763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.763797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:23.764263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:23.766945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d5ee8-974b-467a-ab33-586ba54ed7c0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:23.788273 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 456/892] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:23.789436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da5e7-7426-4180-b5c0-791ff63aef9d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.789727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da5e7-7426-4180-b5c0-791ff63aef9d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.790001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da5e7-7426-4180-b5c0-791ff63aef9d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.791394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 457/893] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:23.793924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1da5e7-7426-4180-b5c0-791ff63aef9d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.816441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.835146 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 437/894] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:23.841970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.842558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.843038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:23.865360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:23.866557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:23.881077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:23.914238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1da5e7-7426-4180-b5c0-791ff63aef9d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:23.951624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 438/895] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:23.951624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:23.954711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:23.955384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:23.955707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:23.955990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.034007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.035652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.054941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.071917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4025585-ca4a-4bbe-8a93-5c70bc30af2f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.112061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.112867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.113155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.113427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.114201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.115628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:24.128075 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:24.129155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.129999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 439/896] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:24.131474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.146850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.155154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 458/897] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 20:37:24.156879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.249500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adeabe-fb29-4af7-9e2d-2c9beafa2351 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.262895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a54f76-95af-49fb-90c3-3d18d2269704 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.279700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.289225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.290027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.290376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.290720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.291487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.292920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.302479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.303371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.303813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.304246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.305117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:24.305447 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:24.306550 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.307423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 440/898] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:24.308302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.308580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.309990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.316623 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 459/899] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.321919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.406573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.437051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e4fc-c9bd-44ef-8be8-0c003f2dd283 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.441853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203e183-f8b0-4bdc-915b-2e067f63f86f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.481131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.481927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.482165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.482280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.482465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.482833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.483115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.483391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.484319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.484786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.486273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.495963 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 460/900] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.495963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.498933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.500748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:24.519094 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:24.520155 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:24.521046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:24.521046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:24.521046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:24.521046 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:24.521046 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 441/901] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:24.522055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.551604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.614009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c375-d790-49bb-8d46-b8e7dacc273e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.631427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc858c4-1262-41de-8784-90e91328b821 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.655046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.656156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.656597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.656871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.657611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.657914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.659534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.661966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.675545 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 461/902] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.675545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.688413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.689097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.689381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.689654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.690387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.690923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.692279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.704105 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 442/903] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.708655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.797975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae903-1775-4ce2-bf09-37efeb6b58d5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.806489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.830608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d7ba-1b9d-4f37-ad46-5d9d9646a3b8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:24.838292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.838983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.839263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.839579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.840339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.840647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.842247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.855212 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 462/904] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.861332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.883456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:24.885041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:24.885535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:24.886016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:24.887056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] RBAC: Adding query filter params (interface=public, service_id=abd24af6a17f4b64ba3986d2d6aa31ce, region_id=RegionOne) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:24.888777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:24.891112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:24.900745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 443/905] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/endpoints?service_id=abd24af6a17f4b64ba3986d2d6aa31ce&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:24.908058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:24.975953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:24.985934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401bc20-6248-40d8-af54-1d12b4786782 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:25.026312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:25.027554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.028034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.028600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.036715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:25.038360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:25.044626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90402ba-dc20-4e5e-b70d-fe929c48b50e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:25.055882 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:25.057105 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:25.058243 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:25.060141 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 463/906] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:25.066360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:25.089356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:25.090579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.091020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.091445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.092337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:25.094628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:25.102817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:25.112030 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 444/907] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:24 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:37:25.191658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e52a-8c1c-406f-8f13-be81102c0475 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:25.229565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:25.230412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.230785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.231148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.232109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:25.232510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:25.234193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ccd2d-c20f-4ac9-8619-0f3f386d8c89 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:25.247888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 464/908] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:25.256706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:25.385744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace82-9027-4d76-939a-8ebb2bbc3bb7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:25.408668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:25.424014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:25.424684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.425025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.425309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.426148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] RBAC: Adding query filter params (role.id=066f36c263bb462fb2851e0c795e0fd9, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=03b02ac92ea443e3b329758bc367972e) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:25.426466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:25.427936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e93fad-eed6-4aaa-9465-a84e93bad0be None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:25.434302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 445/909] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:25 2022] GET /identity/v3/role_assignments?user.id=03b02ac92ea443e3b329758bc367972e&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=066f36c263bb462fb2851e0c795e0fd9 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:25.897861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524ead-34ff-4a0d-aede-3dcd8ff16994 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.898435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524ead-34ff-4a0d-aede-3dcd8ff16994 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.898435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33524ead-34ff-4a0d-aede-3dcd8ff16994 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.900403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 465/910] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:25.906387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:25.906885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:25.907177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:25.930166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:25.931449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:26.008246 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 446/911] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:26.033686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33524ead-34ff-4a0d-aede-3dcd8ff16994 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:26.127234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:26.144090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33524ead-34ff-4a0d-aede-3dcd8ff16994 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:26.184518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:26.185357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:26.185643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:26.185921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:26.186578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:26.188062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:26.200919 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:26.201931 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:26.203148 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 466/912] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Jun 4 20:37:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:26.208477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:26.319166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f7aca-5d7b-42c0-a08a-74ce61783c22 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:26.334306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:26.356005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:26.357091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:26.357568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:26.358035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:26.358963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:26.359482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:26.361111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:26.366919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 447/913] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:26.372446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:26.497075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302fc1-8933-4bb6-adb2-99440ab071b2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:26.547861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:26.548582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:26.548868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:26.549197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:26.549938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:26.550250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:26.551721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df3513-d2e0-405b-9722-316b0f7cef0c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:26.558141 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 467/914] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:26.564406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:26.676594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a514-6b40-4e77-bf96-1b26c7c007e9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:26.712785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:26.713728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:26.714153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:26.714570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:26.715468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:26.718003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee6a0-09dd-4d99-932a-9a6dc164cdba None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:26.739802 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 448/915] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:27.220338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977e699-1fc2-4931-926e-7a96a5014752 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.220890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977e699-1fc2-4931-926e-7a96a5014752 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.221186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977e699-1fc2-4931-926e-7a96a5014752 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.222997 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 468/916] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:27.228429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c847c-5e9a-4ec1-baf0-c919e6462106 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.228714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c847c-5e9a-4ec1-baf0-c919e6462106 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.228991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c847c-5e9a-4ec1-baf0-c919e6462106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.254788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-190c847c-5e9a-4ec1-baf0-c919e6462106 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:27.256801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-190c847c-5e9a-4ec1-baf0-c919e6462106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:27.306886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:27.382481 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 449/917] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:27.406738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977e699-1fc2-4931-926e-7a96a5014752 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:27.424162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:27.515097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977e699-1fc2-4931-926e-7a96a5014752 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:27.556142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:27.556817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.557099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.557372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.558105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:27.559738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884afd78-997b-4ded-a5ff-a8a0579367b7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:27.580876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 469/918] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:27 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:27.701923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2b036-c691-4cb4-a9b6-028655940b85 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.703190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2b036-c691-4cb4-a9b6-028655940b85 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.703821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2b036-c691-4cb4-a9b6-028655940b85 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.705946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 450/919] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:27.712188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51e40-6c19-4435-bdaf-87b3ce5755d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.712811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51e40-6c19-4435-bdaf-87b3ce5755d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.713289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51e40-6c19-4435-bdaf-87b3ce5755d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.731979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aef51e40-6c19-4435-bdaf-87b3ce5755d1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:27.733577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aef51e40-6c19-4435-bdaf-87b3ce5755d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:27.812368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:27.823697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 470/920] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:27.844404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2b036-c691-4cb4-a9b6-028655940b85 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:27.952512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2b036-c691-4cb4-a9b6-028655940b85 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:27.973392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b95f1-447d-486b-9793-276a3349139b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.973744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b95f1-447d-486b-9793-276a3349139b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.973953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b95f1-447d-486b-9793-276a3349139b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.975804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 471/921] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:27.981678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.982029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.982233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.992716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:27.993531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:27.993814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:27.994090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:27.994754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:27.996211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.002917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:28.004186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:28.009110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:28.010115 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:37:28.010956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:28.015086 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 451/922] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:28.017033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.043956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:28.087719 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 472/923] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:28.110514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.124286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850da86c-d990-42e7-91c6-b80efae343ca None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.164324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.165157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.165440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.165717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.166731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:28.167045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.168480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.179594 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 452/924] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:28.181695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.225614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20209a-a563-4bc0-ae27-c0f66ab93a83 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.266005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:28.275767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.277359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.277823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.278716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.290666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:28.294078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:28.304521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a2f95-7fc2-460c-ae0e-144c243af461 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:28.306273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:28.307210 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:28.308095 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:28.310145 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 473/925] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:28.315555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.343483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.344459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.344921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.345372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.346275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:28.346786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.348426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.353967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 453/926] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:28.359692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.437450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ea49f-bd14-4b3e-bc9a-392aaa54239d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.482307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.483882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.484401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.485249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.487704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:28.488291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.492377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.493456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21349-b9b3-434c-a64c-0d9c5dd968aa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.504835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 474/927] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:28.510224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.550408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.551791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.552536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.553471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.554742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.557779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.576799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:28.588652 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 454/928] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:28.638398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecf87-e436-4881-acc9-ac13e635701a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.686641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.687893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.688183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.688459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.701613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.703230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:28.723254 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:28.724280 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:28.725197 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:28.725197 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:28.725197 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:28.725197 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:28.725197 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 475/929] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:28.731089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:28.743908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:28.858219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfc796-5fc7-4a60-94a6-14c216ad9464 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:28.893774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:28.894370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:28.894702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:28.894982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:28.895782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:28.896091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:28.897485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:28.911623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 455/930] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:28.917400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.027051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.030669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0ecb-632b-4462-adc9-b6e9a223c128 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.065353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.066563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.067065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.067554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.076235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.078110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:29.093556 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:29.094580 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:29.095549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:29.098207 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 476/931] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:29.104099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.175253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.211205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8b34-685f-4a29-9683-a04fed2efc2a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.246667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.247821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.248406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.248884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.250009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:29.250530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.252204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81a44-c8e0-423e-be77-00cd090e220d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.272432 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 456/932] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:29.278736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.288567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61857e-b195-4139-89a9-1d08187ccf61 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.289059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61857e-b195-4139-89a9-1d08187ccf61 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.289526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61857e-b195-4139-89a9-1d08187ccf61 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.292086 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 457/933] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:29.297991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.298266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.298536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.316482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:29.317751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:29.403752 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 458/934] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:29.412862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e913d24-c213-4ad6-bfa7-fb1d8ad13022 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.421197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.469455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.470687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.471196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.471714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.488530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.490434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.492507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:29.520452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:29.521446 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:29.522379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:29.522379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:29.522379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:29.522379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:29.530302 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 477/935] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:29.533852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.549594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.553886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac354f-7d56-4c54-963e-2fe9684a0be1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.606846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.608120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.608604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.609569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.611262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.613407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:29.631363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:29.632494 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:29.633347 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:29.636767 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 459/936] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:29.642919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.655436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38393-85ef-4ae6-a1a7-ce79cdbda23c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.705429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.706689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.707578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.708343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.709321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:29.710037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.712394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.740645 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 478/937] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:29.741558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.768272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e1112-84a4-4851-8dce-243d00f510bf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.797505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.821292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.822251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.822533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.822805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.823569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] RBAC: Adding query filter params (name=compute) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:29.823852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.825243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.832348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:29.837934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 460/938] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:29.839561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.872581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155fa7-6d60-4dbb-9c16-2ca7d9801a24 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.910165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:29.911257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:29.911558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:29.911845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:29.921455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:29.923316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:29.942239 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:29.943246 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:29.944428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 479/939] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:29.949480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:29.962754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7039164-ad4f-4e29-8b16-34df8ea32ead None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:29.999427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.000567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.000567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.000848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.001581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:30.001988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.003398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bac9a-9eac-4d82-9b9c-764a7abf8e6c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.008931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 461/940] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:30.072410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3df91-9f68-4699-a9b0-6f529d709476 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.078201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302646f2-662c-477d-9e5d-15b8ba6a735b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.078888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302646f2-662c-477d-9e5d-15b8ba6a735b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.078888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302646f2-662c-477d-9e5d-15b8ba6a735b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.080498 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 462/941] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:30.086461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.086744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.087381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.106082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:30.107405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:30.111492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:30.117040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.117732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.118007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.118708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.120081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:30.120625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.122532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.137809 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 480/942] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:30.144754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:30.163958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:30.203659 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 463/943] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:30.221425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:30.286367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97452b-c59a-49fd-a216-021ad6e434f2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.328312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.329272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.329554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.329876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/03b02ac92ea443e3b329758bc367972e/roles/066f36c263bb462fb2851e0c795e0fd9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.332165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=03b02ac92ea443e3b329758bc367972e, role_id=066f36c263bb462fb2851e0c795e0fd9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.333644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.351143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146851f-6f9d-4d59-8719-042e2351082b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.351633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 481/944] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:30 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/03b02ac92ea443e3b329758bc367972e/roles/066f36c263bb462fb2851e0c795e0fd9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:37:30.400978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827412-d9c4-4737-8566-830b728241db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.401891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827412-d9c4-4737-8566-830b728241db None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.402164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827412-d9c4-4737-8566-830b728241db None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.402441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827412-d9c4-4737-8566-830b728241db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.403192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827412-d9c4-4737-8566-830b728241db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.404703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827412-d9c4-4737-8566-830b728241db None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-56827412-d9c4-4737-8566-830b728241db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:30.418718 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:30.420727 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:30.422751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 464/945] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:30.426608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:30.503954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:30.571037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecffd9e-ff99-41cc-b8c4-411203aee3bf None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.614835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.615666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.615957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.616238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.617107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:30.617494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.619078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.625826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 482/946] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:30.634003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827412-d9c4-4737-8566-830b728241db None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:30.696180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:30.766373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827412-d9c4-4737-8566-830b728241db None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.805770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.806455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.806731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.807056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.807829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:30.808143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.809569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.817202 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 465/947] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:30.824438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:30.945170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbddd76-3396-4183-9141-0786246d394b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:30.962581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:30.982269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:30.983016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:30.983300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:30.983652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:30.984502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] RBAC: Adding query filter params (interface=public, service_id=434a9de8caaf4600b7fb117638094068, region_id=RegionOne) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:30.984813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:30.986238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c44f8f-67d4-4442-b8e5-0b08ce8ef17c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:30.992872 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 483/948] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:30 2022] GET /identity/v3/endpoints?service_id=434a9de8caaf4600b7fb117638094068&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:31.002500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:31.123896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296d0-ddfc-4b22-81c7-0a31a206f975 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:31.136883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:31.171653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:31.172814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.173305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.173783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.174786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:31.176447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4ab11-5c89-435e-96d3-d4072c31a3f8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:31.186361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 466/949] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:31 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:37:31.277760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f770-9386-44a1-aa2b-d8a3220e9eb3 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.278226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f770-9386-44a1-aa2b-d8a3220e9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.278672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f770-9386-44a1-aa2b-d8a3220e9eb3 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.280915 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 484/950] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:31.288650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.289116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.289580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.315397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:31.318084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:31.420403 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 467/951] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:31.439980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80f770-9386-44a1-aa2b-d8a3220e9eb3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:31.562181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80f770-9386-44a1-aa2b-d8a3220e9eb3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:31.597102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:31.598160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.598666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.599143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.600091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:31.601834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:31.603592 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.common [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 20:37:31.624831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.sql.core [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:37:31.624831 ncdv-master-1 devstack@keystone.service[97803]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 20:37:31.624831 ncdv-master-1 devstack@keystone.service[97803]: [parameters: {'id': 'f6d560807274431d8eeea479c342886e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 20:37:31.624831 ncdv-master-1 devstack@keystone.service[97803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6d560807274431d8eeea479c342886e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6d560807274431d8eeea479c342886e. Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:37:31.633070 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 20:37:31.633914 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application yield resource Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise self.value Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application session.commit() Jun 04 20:37:31.635101 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.flush() Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application compat.raise_( Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:37:31.636427 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 20:37:31.637357 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:37:31.638171 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [parameters: {'id': 'f6d560807274431d8eeea479c342886e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:31.640315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:31.642209 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6d560807274431d8eeea479c342886e. Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:31.644518 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 485/952] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Jun 4 20:37:31 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:31.645783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:31.748662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:31.753140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23066b-8c6c-468c-bf69-a67f4ecb59f5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:31.792820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:31.793634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.793915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.794194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.801828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:31.803295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-8aa63802-8382-4c5c-80eb-91d4e527e859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:31.817793 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:31.820570 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:31.822608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 468/953] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:31.828030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:31.870781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:31.939629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb552c-55c8-4c03-a233-a366ef6bb295 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:31.974177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:31.974856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:31.975139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:31.975414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:31.976224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:31.976534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:31.978297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5033e-24b0-4051-b283-f679c3c7c34e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:32.001139 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 486/954] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:32.718969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde954b8-2715-432f-8bc7-d3d013396bf1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:32.719253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde954b8-2715-432f-8bc7-d3d013396bf1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:32.719817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde954b8-2715-432f-8bc7-d3d013396bf1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:32.721687 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 469/955] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:32.727404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96698-af5e-46fe-8f50-f846ddd53037 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:32.728319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96698-af5e-46fe-8f50-f846ddd53037 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:32.728812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96698-af5e-46fe-8f50-f846ddd53037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:32.747168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-19e96698-af5e-46fe-8f50-f846ddd53037 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:32.749136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19e96698-af5e-46fe-8f50-f846ddd53037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:32.821758 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 487/956] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:32.846822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde954b8-2715-432f-8bc7-d3d013396bf1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:32.959167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde954b8-2715-432f-8bc7-d3d013396bf1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:32.995784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:32.996453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:32.996739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:32.997016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:32.997759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:32.997955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54cc2-1470-4156-8c19-6b7d709701d7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:32.998261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54cc2-1470-4156-8c19-6b7d709701d7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:32.998549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54cc2-1470-4156-8c19-6b7d709701d7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:32.999268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:33.000654 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 488/957] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:33.006307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.006602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.006885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.017994 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 470/958] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:32 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:33.028894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:33.030197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:33.057429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:33.125113 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 489/959] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:33.156505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:33.186870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:33.276909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dba99e-256f-4d0a-882b-aa5ef65d65f9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:33.313560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:33.314390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.314671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.314948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.326490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:33.335305 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:33.336370 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:33.337237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 471/960] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:33.344690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:33.451954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d81e52-e734-417d-843a-43e4d70b107d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:33.496215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:33.497349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.497847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.498354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.499434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:33.500000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:33.501657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:33.512285 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 490/961] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:33.518961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:33.624471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:33.630469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652c2-4eb4-4de4-a49d-0d0316fcbee0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:33.666365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:33.667175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.667458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.667779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.678920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:33.680412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a5a7e4d2-f212-4a13-a037-45f4151ce57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:33.698780 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:33.699785 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:33.700697 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:33.700697 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:33.700697 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:33.700697 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:33.700697 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 472/962] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:33.707285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:33.725446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:33.813393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f8761-796c-4c32-b9ac-7ec8a5c7f8fc None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:33.850585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:33.851710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.852200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.852681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.853642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:33.854158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:33.856533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6255-21fd-4eb1-b75e-cb5b246a3ae8 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.856988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:33.857515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6255-21fd-4eb1-b75e-cb5b246a3ae8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.857996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6255-21fd-4eb1-b75e-cb5b246a3ae8 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.861031 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 473/963] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:33.869647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:33.870345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:33.870837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:33.878647 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 491/964] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:33.883147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:33.894649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:33.896272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:33.976648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:33.986539 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 474/965] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:34.011573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.017902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0879-a5b7-4bec-9f50-1539b45cee42 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.066988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.067863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.068518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.068801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.079245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.081165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:34.102967 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:34.104156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:34.109982 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 492/966] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:37:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:34.110622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.110697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.140218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77485368-a2f7-4468-85ca-4a8da52f37a0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.184884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.186114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.186848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.187966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.189084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.190954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:34.207990 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:34.209044 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:34.209876 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 475/967] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:34.227736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.234813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ac0a6-7072-4723-8fd6-83db0831006d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.279550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.280339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.280855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.280964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.281806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:34.282939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.283857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.285789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.305673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 493/968] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:34.311007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.369571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ec7f8-3553-4871-98be-52375c861771 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.411557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.417647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.418965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.419693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.420150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.421071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:34.421680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.421788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825bd1-032f-40d7-af03-9568524836bb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.423380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.435561 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 476/969] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:34.436272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.469361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.470070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.470357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.470631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.543246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.556104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.557622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42759a4c-43c9-4622-b8be-b6ef836ac2d0 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.574937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ff11-252c-410d-b28d-c40cd82f73a8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.614984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.615870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.616155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.616432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.617169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:34.617478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.619085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a88a-cc11-42a6-ab6d-8edcd9331a56 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.630230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 477/970] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:34.630230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8dec-85e9-4d42-bc5a-2d78547cb0e1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.630230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8dec-85e9-4d42-bc5a-2d78547cb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.630230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede8dec-85e9-4d42-bc5a-2d78547cb0e1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.630230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 478/971] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:34.632250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede8dec-85e9-4d42-bc5a-2d78547cb0e1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.689480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 494/972] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:34.690164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.690618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.690917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.708265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:34.709530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:34.711941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.764222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede8dec-85e9-4d42-bc5a-2d78547cb0e1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.788700 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 495/973] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:34.789994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.818649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.819342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.819665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.819947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.820705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:34.822688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:34.824784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:34.846242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 479/974] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:34.846972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:34.942131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9c0c-25ee-4a1e-b2c2-a20e58749272 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.987605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda5d2-96f8-494c-9859-0d9b86b1b228 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:34.990858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:34.991831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:34.992291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:34.992707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:34.998377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.009508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.011296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:35.033719 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:35.034729 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:35.035691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:35.035691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:35.035691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:35.035691 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:35.038397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 496/975] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:35.047467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.054329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.055305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.055690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.056070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.056917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.058640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.060182 ncdv-master-1 devstack@keystone.service[97804]: WARNING keystone.server.flask.common [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 20:37:35.079167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.sql.core [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:37:35.079167 ncdv-master-1 devstack@keystone.service[97804]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 20:37:35.079167 ncdv-master-1 devstack@keystone.service[97804]: [parameters: {'user_id': '333ac9371a6e429daf48044865bb52fb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 20:37:35.079167 ncdv-master-1 devstack@keystone.service[97804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result.read() Jun 04 20:37:35.097461 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:37:35.098493 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application yield resource Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise self.value Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application session.commit() Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 20:37:35.099835 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.flush() Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application compat.raise_( Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:37:35.100998 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:37:35.102126 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result.read() Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:37:35.103164 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [parameters: {'user_id': '333ac9371a6e429daf48044865bb52fb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:35.104275 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 04 20:37:35.105249 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 480/976] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Jun 4 20:37:34 2022] POST /identity/v3/users => generated 160 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:35.106363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.150358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.191490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edaa0c-7324-421b-a3a7-6023f339490e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.232920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbc2f2-79d2-4be1-81c7-1d2518cb286e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.233105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.233777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.234151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.234436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.235185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:35.235731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.238348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.259600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 497/977] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:35.261204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.286318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.287179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.287470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.287793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.299331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.301192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:35.321380 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:35.322581 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:37:35.323760 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:35.328749 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 481/978] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:35.329711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.372200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.399054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562487-9f17-43bf-b9f1-1d7cd085d579 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.455810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.465332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.466659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.467144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.467250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3118-8990-4fc6-9b73-fc2357201363 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.467763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.477941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.479756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d1ca8b4c-72da-40c2-aab9-c43e3e10cda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:35.494363 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:35.495479 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:35.496772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 498/979] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:35.501758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b8ef-391c-41b4-959b-8ce449a6a3ed None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.502047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b8ef-391c-41b4-959b-8ce449a6a3ed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.502329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b8ef-391c-41b4-959b-8ce449a6a3ed None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.503683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 499/980] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:35.504379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b8ef-391c-41b4-959b-8ce449a6a3ed None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.514159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.515284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.515754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.516545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.517899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:35.518688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.520554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7f78-3b18-4d8a-a7f2-e3a1c00717d1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.568607 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 482/981] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:35.570051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.570348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.570633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.597095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:35.598964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:35.626351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b8ef-391c-41b4-959b-8ce449a6a3ed None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.679680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.680776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.681215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.681646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.682716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:35.683175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.684849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.687292 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 483/982] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:35.700009 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 500/983] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:35.705974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.711139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.731541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.779160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:35.843170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da52d8-7e94-4f0d-9e2c-7fb921101040 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.846618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80fd9b-c25f-4173-ae9e-3a5b5bb9669f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:35.891972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.892792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.893078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.893788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.894472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.895934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.897967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:35.898518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:35.898789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:35.899067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:35.900531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] RBAC: Adding query filter params (role.id=066f36c263bb462fb2851e0c795e0fd9, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=03b02ac92ea443e3b329758bc367972e) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:35.900685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:35.902048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:35.911454 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:35.912651 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:35.913507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 501/984] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:35.919277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:35.919833 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 484/985] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/role_assignments?user.id=03b02ac92ea443e3b329758bc367972e&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=066f36c263bb462fb2851e0c795e0fd9 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:36.052246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f9bfd-9b3d-49ed-b2db-ad57a258b544 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:36.070046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:36.096133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:36.096807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:36.097088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:36.097367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:36.098093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:36.098403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:36.099848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:36.106123 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 502/986] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:36.112094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:36.212704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:36.236667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bb90-4418-4f1d-abf8-8825794bb6af None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:36.284143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:36.284823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:36.285100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:36.285382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:36.286103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:36.286407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:36.289956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:36.295860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 485/987] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:36.302524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:36.417545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed71957-441b-416e-95af-b02f55181695 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:36.451814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:36.452652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:36.453060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:36.453365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:36.454139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] RBAC: Adding query filter params (interface=public, service_id=33b8b83c77c346d3986dd44398ddb11a, region_id=RegionOne) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:36.454456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:36.455882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f749b-38fc-45f8-b265-901125fcc257 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:36.461602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 503/988] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:36 2022] GET /identity/v3/endpoints?service_id=33b8b83c77c346d3986dd44398ddb11a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:36.467021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:36.588259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41dce4-0c1d-490b-ab25-48f585272212 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:36.623925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:36.625024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:36.625285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:36.625586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:36.626275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:36.627683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae288f2-18bd-4d8b-8b5c-c1957d41aee3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:36.634558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 486/989] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:36 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:37:37.428987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c157b-c4fd-4230-b7b7-8ab924fae29e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:37.429507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c157b-c4fd-4230-b7b7-8ab924fae29e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:37.429585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c157b-c4fd-4230-b7b7-8ab924fae29e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:37.431034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 504/990] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:37.436802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:37.437779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:37.438029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:37.455909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:37.457105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:37.459405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:37.536029 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 487/991] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:37.561482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c157b-c4fd-4230-b7b7-8ab924fae29e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:37.612637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:37.680862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c157b-c4fd-4230-b7b7-8ab924fae29e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:37.716192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:37.717007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:37.717285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:37.717558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:37.718882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:37.720316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:37.732546 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:37.733612 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:37.734574 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:37.739537 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 505/992] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:37.740979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:37.856241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199287e-6f2a-465a-bb5d-5c02f47f4e7e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:37.892346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:37.893024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:37.893311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:37.893589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:37.894305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:37.894611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:37.896044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:37.901813 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 488/993] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:37.907712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.015337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523db0c-4bd2-4346-8e9c-962c4b9c9ebd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.022358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:38.052738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.053412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.053703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.053985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.054695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:38.054995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.056481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.061692 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 506/994] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:38.067789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.070760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:38.173209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ddd86-ec16-43c9-99b6-2078c7cec397 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.207185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.207864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.208154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.208429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.209234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] RBAC: Adding query filter params (interface=admin, service_id=434a9de8caaf4600b7fb117638094068, region_id=RegionOne) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:38.209549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.210961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7de68-d436-4d9c-92f3-a4ca03d3ece3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.216422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 489/995] 10.222.0.18 () {56 vars in 1249 bytes} [Sat Jun 4 20:37:38 2022] GET /identity/v3/endpoints?service_id=434a9de8caaf4600b7fb117638094068&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:38.222133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.313754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d4fb-fc9c-466e-953d-421d18833e87 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.314189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d4fb-fc9c-466e-953d-421d18833e87 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.314536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d4fb-fc9c-466e-953d-421d18833e87 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.316172 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 490/996] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:38.321327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.321624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.321902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.332585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d3fc-f48d-4cd7-8f46-e3d1c4d0eef1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.340328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:38.341548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:38.379691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.380694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.381120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.381412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.382113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.383532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.390681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 507/997] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:38 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:37:38.427639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:38.438759 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 491/998] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:38.463773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.506181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:38.588128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dedfa-d5d4-43d7-9ada-bb48cdb802a2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.626794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.627635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.627918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.628178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] PATH_INFO: `/v3/services/image` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.628844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.630255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:38.643727 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:38.644810 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:38.645768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 508/999] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jun 4 20:37:38 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:38.651871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.763719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cae21-af3d-4ac9-ae3e-ba342fc9d74e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.806748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.807430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.807744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.808076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.808795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] RBAC: Adding query filter params (name=image) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:38.809148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.810547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fb334-f763-48d3-b232-7abcfde73421 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.819605 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 492/1000] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:38.822342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:38.928175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:38.932893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923820e-8fa6-4fc9-90b8-55a13ae96294 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:38.970871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:38.971566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:38.971862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:38.972135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:38.972850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] RBAC: Adding query filter params (type=image) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:38.973158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:38.974549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632941-2ef4-4c32-add6-09263c086ae8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:38.979751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 509/1001] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:39.011598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce1ab-613c-45ec-a192-048a30f3a4a2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.011842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce1ab-613c-45ec-a192-048a30f3a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.012143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce1ab-613c-45ec-a192-048a30f3a4a2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.015546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 493/1002] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:39.020542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.020836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.021113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.041023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:39.042271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:39.126964 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 510/1003] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:39.152518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce1ab-613c-45ec-a192-048a30f3a4a2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:39.222419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:39.269855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce1ab-613c-45ec-a192-048a30f3a4a2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:39.311073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:39.312659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.312953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.313230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.313919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:39.315311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:39.328936 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:39.330031 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:39.330952 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 494/1004] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:39.336928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:39.444513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:39.454687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ac4fd-6a94-400a-81ec-1a4cc30b94d1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:39.490494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:39.491161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.491435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.491699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.492408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:39.492708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:39.494097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:39.504240 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 511/1005] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:39.505577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:39.628003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd855e50-1b3b-478f-a38d-d2557b2ed632 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:39.656409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:39.669326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:39.670025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.670310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.670587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.671672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:39.672188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:39.673644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f28197-c936-4f3c-a079-db68432839a7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:39.680117 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 495/1006] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:39.685882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:39.819790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedbc6d-eeb5-495f-9594-9050c05e1978 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:39.857058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:39.857739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:39.858023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:39.858379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:39.859974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:39.861412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81781a08-0b7b-4920-9c56-dcd7ef548c62 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:39.885528 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 512/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:40.801832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1af03-815e-4895-8c83-c9b4ba51da18 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:40.802519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1af03-815e-4895-8c83-c9b4ba51da18 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:40.802519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1af03-815e-4895-8c83-c9b4ba51da18 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:40.804332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 496/1008] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:40.810165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:40.810692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:40.810692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:40.829495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:40.830706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:40.838964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:40.910572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 513/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:40 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:40.935733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1af03-815e-4895-8c83-c9b4ba51da18 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:41.054200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1af03-815e-4895-8c83-c9b4ba51da18 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:41.089538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:41.090355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.090635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.090908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.091583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:41.093275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:41.106074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:41.107100 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 20:37:41.107973 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:41.112858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 497/1010] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Jun 4 20:37:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:41.114369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:41.219376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50f3f6-c628-46fd-a3e8-55019589b92a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:41.256148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:41.256821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.257099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.257379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.258089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:41.258395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:41.259848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5bcd-5206-4033-b20c-59ba0c3ddd40 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:41.265589 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 514/1011] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:41.271186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:41.334547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:41.356333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3746-1bc9-4df1-807b-7d3c2db2271b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.356652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3746-1bc9-4df1-807b-7d3c2db2271b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.356891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb3746-1bc9-4df1-807b-7d3c2db2271b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.358529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 515/1012] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:41.364276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.364554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.364828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.370175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:41.386438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e709-cfac-46ec-87f4-fcaf051c94e8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:41.389324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:41.390505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:41.422624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:41.423702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.424174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.424638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.425520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:41.426011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:41.427637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:41.433314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 498/1013] 10.222.0.18 () {56 vars in 1122 bytes} [Sat Jun 4 20:37:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:41.439940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:41.466472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 516/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:41 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:41.490214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:41.551975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d7529-a719-4591-8e9e-75ac12594e55 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:41.570334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:41.592134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:41.592712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.593034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.593303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.594166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:41.595421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5de4a-2c52-49b3-ba2d-920414cbe8ee None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:41.603658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0e2f8-9a67-44c4-9555-b95e41d7568c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:41.614709 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 499/1015] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:41.637654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:41.651443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:41.652205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:41.652540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:41.652842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:41.653595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:41.655089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187ff6-2685-4a62-af1e-06bbb3388faa None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:41.674313 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 517/1016] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:41 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:42.361414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3077-6ec9-48d0-bb13-27b7d20fae99 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:42.361952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3077-6ec9-48d0-bb13-27b7d20fae99 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:42.361952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c3077-6ec9-48d0-bb13-27b7d20fae99 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:42.363763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 500/1017] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:42.369901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:42.370462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:42.370539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:42.391769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:42.393068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:42.497063 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 518/1018] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:42.522710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c3077-6ec9-48d0-bb13-27b7d20fae99 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:42.632793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c3077-6ec9-48d0-bb13-27b7d20fae99 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:42.667441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:42.668294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:42.668579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:42.668855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:42.679317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:42.687811 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:42.688745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:42.689622 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:42.691601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 501/1019] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:42.695546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:42.799754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948839-6fc3-4ffc-8dc8-fef93fd8d5b2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:42.817150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:42.844031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:42.844735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:42.845021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:42.845298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:42.846083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:42.846459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:42.847947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:42.858243 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 519/1020] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:42.863707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:42.903424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:42.976665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3e466-f136-4fff-ac2b-b9784d74e826 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:43.013418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:43.014226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:43.014505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:43.014792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:43.025924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:43.027382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:43.047480 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:43.048554 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:43.054162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:43.054162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:43.054162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:43.054162 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:43.054162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 502/1021] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:43.055704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:43.165349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034badb7-d633-4b11-9de3-2c97ecc4f912 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:43.201897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:43.202600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:43.202887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:43.203167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:43.203929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:43.204236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:43.205616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:43.217906 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 520/1022] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:43.223522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:43.315354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:43.329826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47ea02-4fbe-422f-b165-64f4c01317aa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:43.366888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:43.367744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:43.368003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:43.368276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:43.381317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:43.382789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:43.397515 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:43.398531 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:43.399950 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:43.403871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 503/1023] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:37:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:43.405099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:43.444779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:43.524311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830369d-eadf-4ebd-bbcc-2b32d51b5ff4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:43.562186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:43.563063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:43.563345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:43.563691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:43.564500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:43.564811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:43.566285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:43.585447 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 521/1024] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:37:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:43.591018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:43.701472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a62e3-16b8-4d6c-91bb-4b16986f91e1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:43.741417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:43.742080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:43.742368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:43.742646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:43.762334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:43.815475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:43.816990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760336a6-2528-4ea6-b56d-f36e25ca7822 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:43.943561 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 504/1025] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:43.950285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.044509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd3a4c-4b6e-402e-bcb3-920d33f0cb36 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.044827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd3a4c-4b6e-402e-bcb3-920d33f0cb36 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.044998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd3a4c-4b6e-402e-bcb3-920d33f0cb36 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.048110 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 505/1026] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:44.052132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.054693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8346ee-52c6-4c0b-861c-cd4626f185d0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.054987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8346ee-52c6-4c0b-861c-cd4626f185d0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.055456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8346ee-52c6-4c0b-861c-cd4626f185d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.059586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cdd9d-189f-422b-8321-005782d12c80 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.072930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6e8346ee-52c6-4c0b-861c-cd4626f185d0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:44.074158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6e8346ee-52c6-4c0b-861c-cd4626f185d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:44.095432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.096316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.096605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.096884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.107172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.108975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.118712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-3abace9c-0da7-44d6-a3a9-6783cd47adb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:44.129760 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:44.130749 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:44.131699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:44.131699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:44.131699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:44.131699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:44.131699 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 522/1027] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:44.132817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711358-c3c8-4822-bc6c-75685993278b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.132817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711358-c3c8-4822-bc6c-75685993278b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.132983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711358-c3c8-4822-bc6c-75685993278b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.134373 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 523/1028] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:44.136540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10711358-c3c8-4822-bc6c-75685993278b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.148118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 506/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:44.149421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.150043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.150322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.168235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:44.169438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:44.236159 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 507/1030] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:44.237016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.239440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10711358-c3c8-4822-bc6c-75685993278b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.274420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.275428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.275796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.276067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.276788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:44.277097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.278476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.289927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 524/1031] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:44.294690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.300625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.346886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3b8bb-404e-4114-a575-101ea089ba79 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.356205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.384050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476693-bec7-430e-925c-25235627de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.384814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476693-bec7-430e-925c-25235627de9d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.385100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476693-bec7-430e-925c-25235627de9d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.385379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476693-bec7-430e-925c-25235627de9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.386558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476693-bec7-430e-925c-25235627de9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.388060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476693-bec7-430e-925c-25235627de9d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.394638 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 508/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:44.394638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476693-bec7-430e-925c-25235627de9d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.397870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d7f5-b203-48a9-8163-4a09d6df23f2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.432150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.432957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.433257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.433530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] PATH_INFO: `/v3/services/image` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.434184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.435561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:44.448507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:44.449796 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:44.450824 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 525/1033] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:44.452120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.501294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476693-bec7-430e-925c-25235627de9d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.525309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.540267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.541084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.541366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.541664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.549135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.550541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.559270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a892b3-2304-4b5f-8151-46833094e318 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:44.565178 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:44.566093 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:44.567001 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 509/1034] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:44.567529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.596356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.597035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.597318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.597588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.598298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.599772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.605027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.629307 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 526/1035] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:37:44 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:44.630771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.688893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eac5f-0457-4b56-92ab-10718bdc124a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.758561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.759915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.760636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.761568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.763033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:44.763757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.765328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.768887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dece1-3d58-4a09-9c22-139fe50f322d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.771591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 510/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:44.777921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.799398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.816513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.817312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.817652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.817937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.818748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:44.819065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.820592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.833830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 527/1037] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:44.841323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.903568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:44.907726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd4f8-0e33-4c86-ab57-e13286c17fd8 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:44.948257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:44.948979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:44.949413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:44.949683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:44.950436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] RBAC: Adding query filter params (type=image) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:44.950745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:44.952630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:44.958372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 511/1038] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:44.964512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:44.967740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51c1a-5f3b-42e4-8b75-193292a07714 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:45.004830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:45.005495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:45.005783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:45.006059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:45.006892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] RBAC: Adding query filter params (role.id=066f36c263bb462fb2851e0c795e0fd9, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:45.007218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:45.008738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:45.015130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 528/1039] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=066f36c263bb462fb2851e0c795e0fd9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:45.079274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666c48-dad8-4005-855d-ea2dad1c0757 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:45.121580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:45.122356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:45.122708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:45.123055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:45.124076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] RBAC: Adding query filter params (interface=public, service_id=1737ac0cdfe04378a93d40fefbe0ca8a, region_id=RegionOne) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:45.124476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:45.125970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd758e9-a967-43e4-b350-065310bbb8ca None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:45.137210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 512/1040] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:37:44 2022] GET /identity/v3/endpoints?service_id=1737ac0cdfe04378a93d40fefbe0ca8a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:45.138375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:45.193005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:45.256733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520b8f-2713-45aa-b476-aa2c07d4bd1f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:45.294429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:45.295368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:45.295987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:45.296556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:45.297450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:45.299033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0edc7-fb3e-47b7-b07a-0845fc31ce77 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:45.311596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 529/1041] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:37:45 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:37:47.089845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a1dd-189b-4999-abed-739a22e74519 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.090415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a1dd-189b-4999-abed-739a22e74519 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.090415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320a1dd-189b-4999-abed-739a22e74519 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.091860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 513/1042] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:47.097813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56594c-bfe0-4557-913a-be53ab0b276f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.098309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56594c-bfe0-4557-913a-be53ab0b276f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.098309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56594c-bfe0-4557-913a-be53ab0b276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.119645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-be56594c-bfe0-4557-913a-be53ab0b276f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:47.120848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be56594c-bfe0-4557-913a-be53ab0b276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:47.205529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 530/1043] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:47.231218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a1dd-189b-4999-abed-739a22e74519 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:47.262836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:47.352810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320a1dd-189b-4999-abed-739a22e74519 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:47.377972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d463-b0fe-4a15-b787-ca782457260c None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.378319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d463-b0fe-4a15-b787-ca782457260c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.378666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d463-b0fe-4a15-b787-ca782457260c None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.380341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 531/1044] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:47.385576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.385863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.386148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.400020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:47.400846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.401289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.401577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.402809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:47.404291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:47.406075 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 514/1045] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:47.406381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:47.407869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:47.411905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:47.451797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:47.491139 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 532/1046] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:47.517082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:47.534329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:47.542527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e108f6c-781e-450e-938b-b7da7247f305 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:47.581962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:47.582645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.582925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.583199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.584476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:47.586149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf60421-21a0-402a-b29b-6b6904e74d08 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:47.615176 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 515/1047] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:37:47 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:37:47.656549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9d5f-03e5-48e6-9d87-ef57af17ba58 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.656943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9d5f-03e5-48e6-9d87-ef57af17ba58 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.657157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9d5f-03e5-48e6-9d87-ef57af17ba58 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.658545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 516/1048] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:37:47.664602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.664887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.665161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.677474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97729-b118-4f25-8796-edc80c82fe6d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:47.683008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:47.684280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:47.733858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:47.735246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.735670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.736118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.756458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:47.770985 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:47.772517 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:47.779093 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 533/1049] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:47.783359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:47.803048 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 517/1050] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:47.824242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:47.828409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:47.926518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d32e7-5578-4b5c-9f6f-b7936508f6a5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:47.949924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:47.971393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415ecda-f8a1-4e7b-980c-4f3f9e220f24 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:47.973414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:47.974098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:47.974380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:47.974656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:47.975418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:47.975756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:47.977192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:47.987261 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 534/1051] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:47.994571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.020076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.021588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.022020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.022442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.023278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.026171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:48.044158 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:48.045413 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:37:48.046478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:48.051558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 518/1052] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Jun 4 20:37:47 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:48.055196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.113513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.122857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0a2c-4f97-47d7-ac4f-9ff8f6c1d5bf None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.160869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.161672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.161974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.162222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.175046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.176663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.181538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5d75-f6ab-46b1-a877-cdec92353fc7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:48.194438 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:48.196083 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:48.198018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:48.198018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:48.198018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:48.198018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:48.198018 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 535/1053] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:48.201778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.227669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.228561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.228997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.229385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.230437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:48.230632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.232712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.239710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 519/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:48.245426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.260155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.322109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb6ee-9fef-4d7b-a5c8-152ccababd85 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.361596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.362708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.363203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.363547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b45f-4bf2-43cd-8b32-3531519a87a3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.363962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.364769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:48.365182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.367021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.384929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 536/1055] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:48.388579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.393032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.418886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.419900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.420847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.421115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.422247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:48.422247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.424203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.434670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 520/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:48.435437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.514864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046aa9-9140-4581-a15c-208d996e0da5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.523271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.556804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e722b2d-947f-4e98-8f6d-7fae1f2383c2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.558991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.560317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.560602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.560879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.569398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.570875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:48.586449 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:48.588027 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:48.589682 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:48.592950 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 537/1057] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:48.593823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.606167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006194-c291-40be-819c-753a36b332cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.606835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006194-c291-40be-819c-753a36b332cf None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.607147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006194-c291-40be-819c-753a36b332cf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.607427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006194-c291-40be-819c-753a36b332cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.608275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006194-c291-40be-819c-753a36b332cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.609661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006194-c291-40be-819c-753a36b332cf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.640667 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 521/1058] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:48.670057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.731177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b047e9-f931-4372-b6a3-7d22f47ac5e7 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.790220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:48.791003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:48.791262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:48.791555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:48.792459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:48.792882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:48.796512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:48.826601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 538/1059] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:48.828385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006194-c291-40be-819c-753a36b332cf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:48.961160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006194-c291-40be-819c-753a36b332cf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:48.991097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:48.999065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:49.000048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:49.000385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:49.000631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:49.012496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:49.013968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:49.032257 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:49.033220 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:49.034763 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:49.034763 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:49.034763 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:49.034763 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:49.034763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 522/1060] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:49.039179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:49.145329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a218247-ece5-4104-953c-7f214d189d66 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:49.170750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:49.194882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:49.195605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:49.195874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:49.196165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:49.196905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:49.197213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:49.198615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:49.211553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 539/1061] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:49.217085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:49.323964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6e9b-c332-4266-8b25-1ae15d4e882a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:49.364851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:49.365673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:49.365958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:49.366227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:49.376803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:49.378318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:49.393203 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:49.394176 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:49.395074 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:49.396199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 523/1062] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:49.400825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:49.519587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032764-ef20-4aba-ae0a-6793124d8dbd None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:49.557817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:49.558489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:49.558771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:49.559044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:49.559868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:49.560178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:49.562002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352aea9-165d-4a63-81b9-1d480234c687 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:49.575188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 540/1063] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:49.581936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:49.632501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:49.695061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45d6d-3680-4329-ac60-c2a6b58f7f52 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:49.730534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:49.731453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:49.731769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:49.732049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/066f36c263bb462fb2851e0c795e0fd9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:49.735206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=1d53786e35f04229b4fdb375d5141b99, role_id=066f36c263bb462fb2851e0c795e0fd9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:49.736748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b88ec-f98f-4adb-993d-e6031703f149 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:49.755488 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 524/1064] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:49 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/1d53786e35f04229b4fdb375d5141b99/roles/066f36c263bb462fb2851e0c795e0fd9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:37:50.103283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464dba-32f2-40da-9aca-bbaae2e88f46 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.103536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464dba-32f2-40da-9aca-bbaae2e88f46 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.103775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25464dba-32f2-40da-9aca-bbaae2e88f46 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.105355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 541/1065] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:50.111034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.111303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.111613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.129017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:50.130214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:50.201212 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 525/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:50.226307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25464dba-32f2-40da-9aca-bbaae2e88f46 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:50.271115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:50.335938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25464dba-32f2-40da-9aca-bbaae2e88f46 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:50.379694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:50.380515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.380802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.381078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.392413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:50.400452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:50.401531 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:50.402409 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:50.407083 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 542/1067] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:50.408602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:50.443880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:50.525575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92cd4-7d1e-408a-9005-ef53216e3744 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:50.562689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:50.563362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.563677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.563955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.564718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:50.565094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:50.566488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:50.575704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 526/1068] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:50.581501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:50.685200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:50.690735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d8664-94fd-4717-b944-189270dfcca0 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:50.734208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:50.735610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.735900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.736175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] PATH_INFO: `/v3/users/bb2e761cce6d43cbb3696a1dfb347be5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.750917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2e761cce6d43cbb3696a1dfb347be5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:50.752412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149038a0-053b-4790-b60b-9dc75936ceb3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:50.758864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 543/1069] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:37:50 2022] GET /identity/v3/users/bb2e761cce6d43cbb3696a1dfb347be5 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:50.760308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:50.864325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:50.872153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ad4c-86da-4056-9d75-0cad089095cd None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:50.911432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:50.912148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:50.912433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:50.912700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:50.983951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:50.985333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.049655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1469c-2119-4c71-96d9-5cdb5f6612f1 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.049949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1469c-2119-4c71-96d9-5cdb5f6612f1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.050221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1469c-2119-4c71-96d9-5cdb5f6612f1 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.051789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 544/1070] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:51.058103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.058393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.058712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.075859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:51.077736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:51.085473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:51.099554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 527/1071] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 20:37:51.100619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:51.162028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 545/1072] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:37:51.185970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:51.218638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52daa7-c9ab-4755-b4b0-813d86222156 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:51.256001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:51.256760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.257057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.257359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.258508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:51.259984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.261868 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 528/1073] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:37:51 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:51.268706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:51.273054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:51.290640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79faa3cc-be89-436d-b71f-957ac0b44635 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:51.325494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:51.326159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.326431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.326706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.339825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:51.383533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45ee4-8dc2-4e1a-8ff9-7462e6a79017 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:51.408961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:51.410446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.422203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:51.422871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.423309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.423418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.424354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=19091971aa154dff9956d7ee3100b437, user.id=bb2e761cce6d43cbb3696a1dfb347be5) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:51.424602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:51.426035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.439547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 529/1074] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:51 2022] GET /identity/v3/role_assignments?user.id=bb2e761cce6d43cbb3696a1dfb347be5&scope.project.id=19091971aa154dff9956d7ee3100b437&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:51.520859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:51.542859 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 546/1075] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 20:37:51.549335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:51.675787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8632-6e8e-4252-a33a-21f7ea29b7e9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:51.704475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:51.714049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:51.714863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.715148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.715426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.726890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:51.728379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c28e34b1-219d-4467-99e9-4091e4887b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:51.746308 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:51.747334 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:51.754049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:51.754049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:51.754049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:51.754049 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:51.754049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 530/1076] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:51.756150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:51.865732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd4bb-e1c6-4ad0-a2b7-6871d0e9678c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:51.902579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:51.903270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:51.903541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:51.903937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:51.904689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:51.905124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:51.906563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe596906-cfae-45d1-b80d-597fd7cd1e85 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:51.920391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 547/1077] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:52.105629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57483-f3ae-4fa6-b262-8257966251b9 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.105865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57483-f3ae-4fa6-b262-8257966251b9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.106171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a57483-f3ae-4fa6-b262-8257966251b9 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.107594 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 531/1078] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:52.114051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.114308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.114553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.132937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:52.134155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:52.182975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:52.212300 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 548/1079] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:52.238123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a57483-f3ae-4fa6-b262-8257966251b9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:52.346077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a57483-f3ae-4fa6-b262-8257966251b9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:52.382172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:52.383053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.383283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.383594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.394076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:52.402428 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:52.403459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:52.404441 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 532/1080] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Jun 4 20:37:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:52.409927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:52.516918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd1124-2aea-4499-86fd-7d836d44dc81 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:52.554419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:52.555094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.555373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.555681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.556432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:52.556734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:52.558106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:52.566219 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 549/1081] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:37:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:52.572066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:52.613174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:52.680451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2004b9-f703-4e0c-bb39-1aa8d4fb5e39 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:52.717352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:52.718232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.718549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.718793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.730744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:52.732293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:52.752177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:52.753221 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:52.754135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:52.754135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:52.754135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:52.754135 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:52.754135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 533/1082] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:52.760197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:52.803579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:52.867952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a77200-974a-4205-b2ff-a96908dbbd84 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:52.904012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:52.904682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:52.904998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:52.905279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:52.906119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:52.906428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:52.907862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:52.919975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 550/1083] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:52.925999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.019865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:53.031377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167d00-9490-4693-ad61-d68d1cf89bcb None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:53.067123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:53.067955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.068234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.068504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.075607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:53.077176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:37:53.091327 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:53.092478 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:53.093459 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 534/1084] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Jun 4 20:37:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:53.098904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.199897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:53.204476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c362a-e56c-479c-b1bf-5af34dfd3fd3 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:53.239466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:53.240177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.240461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.240736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.241587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:53.241901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:53.243368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:53.261003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 551/1085] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:53.267063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.371449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56374e4-7c7c-40c1-bfb6-3b56cf497b6a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:53.408830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:53.409486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.409771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.410048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.429223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:53.478343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:53.479858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:53.586427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 535/1086] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:53.592429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.699227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c631178-3237-4870-8ff4-8490a176b67b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:53.734497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:53.735301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.735616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.735893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.746209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:53.747723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-99c1f5b3-477c-4296-b384-6e2b6af64c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:37:53.765486 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:53.766498 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:53.767412 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:37:53.767412 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:37:53.767412 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:37:53.767412 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:53.767412 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 552/1087] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:53.772660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.823190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:53.845965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452939-c63c-4962-b223-39c6e988549d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.846231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452939-c63c-4962-b223-39c6e988549d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.846506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452939-c63c-4962-b223-39c6e988549d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.848013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 553/1088] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:53.854431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.854717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.854993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.873855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:53.875186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:53.877305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:53.883029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a664cf-c2d7-427d-8bb4-fe64df8bffd3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:53.919133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:53.919839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:53.920127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:53.920395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:53.921262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:53.921570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:53.922985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:53.934878 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 536/1089] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:53.940829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:53.945615 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 554/1090] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:53.969678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.041156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1bc69-8446-4cf7-a186-7a6adcd9c166 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.051592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.070685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4285-4bac-4d37-987c-a95a40797505 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.078487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.079295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.079615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.079896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.087121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.088626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:37:54.103197 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:54.104195 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:54.105168 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 537/1091] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:37:54.105924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.106737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.107013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.107290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.110506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.114676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.118745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:54.127041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:54.128065 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:37:54.129191 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 555/1092] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:54.134239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.218220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e6f8-0b44-4bea-8a01-4c9fd50067db None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.238082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865896-cdfc-4d5d-9d2b-cc6c5093dc28 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.252427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.253103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.253389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.253668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.254645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:54.254965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.256449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.268514 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 538/1093] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:54.275354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.275810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.276509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.276800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.277078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.277853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:54.278290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.279642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.291079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 556/1094] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:54.297830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.309691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.364095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.392873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fadc13-ccc8-4f54-af4b-1c30b3fdf45d None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.407538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb9f1-c6ce-4db4-adb0-c266326156f5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.429114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.429783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.430070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.430342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.431196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] RBAC: Adding query filter params (role.id=066f36c263bb462fb2851e0c795e0fd9, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=1d53786e35f04229b4fdb375d5141b99) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:54.431537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.434525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.442001 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 539/1095] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:54 2022] GET /identity/v3/role_assignments?user.id=1d53786e35f04229b4fdb375d5141b99&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=066f36c263bb462fb2851e0c795e0fd9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:37:54.445111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.446005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.446286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.446545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] PATH_INFO: `/v3/users/bb2e761cce6d43cbb3696a1dfb347be5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.447918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] RBAC: Authorizing `identity:get_user(user_id=bb2e761cce6d43cbb3696a1dfb347be5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.449451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.451229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 557/1096] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:37:54 2022] GET /identity/v3/users/bb2e761cce6d43cbb3696a1dfb347be5 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:54.458025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.576300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.584923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eb81f-f1ec-4090-ba34-8ebd398ac8e6 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.621974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.622861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.623145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.623418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.625070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.626545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af44db-567c-4ef8-825f-2a87f6af2487 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.628538 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 540/1097] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:37:54 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:54.634751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:54.737766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6459-cf88-4f63-9c8c-0e199aeb8e97 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:54.764389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:54.772927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:54.773820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:54.774098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:54.774688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437/users/bb2e761cce6d43cbb3696a1dfb347be5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:54.776794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] RBAC: Authorizing `identity:create_grant(project_id=19091971aa154dff9956d7ee3100b437, user_id=bb2e761cce6d43cbb3696a1dfb347be5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:54.778228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98114266-d672-4b00-a5bb-025c11d133df None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:54.792775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 558/1098] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:37:54 2022] PUT /identity/v3/projects/19091971aa154dff9956d7ee3100b437/users/bb2e761cce6d43cbb3696a1dfb347be5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:37:57.133708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e568-6cce-4aca-9a0b-1faa1e3a3e97 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.134314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e568-6cce-4aca-9a0b-1faa1e3a3e97 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.134314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e568-6cce-4aca-9a0b-1faa1e3a3e97 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.135676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 541/1099] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:57.141477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.141958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.142063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.160545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:57.161787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:57.231267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 559/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:57.256922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e568-6cce-4aca-9a0b-1faa1e3a3e97 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:57.365899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e568-6cce-4aca-9a0b-1faa1e3a3e97 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:57.402447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:57.403160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.403439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.403747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.414297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:37:57.421896 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:57.422976 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:37:57.423930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 542/1101] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:57.429445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:57.537610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6d14e-37e7-438d-91bd-036847a7e86e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:57.556546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:57.574558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:57.575306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.575650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.575929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.576897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:57.577335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:57.578904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:57.587978 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 560/1102] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:57.594042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:57.619484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:57.702584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ec98-7a61-48d6-b2ef-01c20618e14c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:57.739825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:57.740713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.741006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.741282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] PATH_INFO: `/v3/users/bb2e761cce6d43cbb3696a1dfb347be5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.742503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] RBAC: Authorizing `identity:get_user(user_id=bb2e761cce6d43cbb3696a1dfb347be5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:57.743996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:57.745663 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 543/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:37:57 2022] GET /identity/v3/users/bb2e761cce6d43cbb3696a1dfb347be5 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:57.752084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:57.858127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dfc49-50b9-4621-b342-5d8b64d1476f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:57.892750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:57.893393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:57.893671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:57.893936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:57.943208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:57.964548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:57.965962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:58.071984 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 561/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:37:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:37:58.078346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:58.184832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:58.195330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753cd10-5283-4538-9989-53dd75dfb07a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:58.231574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:58.232368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:58.232648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:58.233087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:58.234634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:58.236130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca50bb-0960-4adf-89b5-87269342f742 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:58.237853 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 544/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:37:58 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:58.244337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:58.328804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:58.350691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9b2cc-eb2e-43a1-b9a1-0a2a2039390a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:58.390643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:58.391319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:58.391636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:58.391901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:58.392745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=19091971aa154dff9956d7ee3100b437, user.id=bb2e761cce6d43cbb3696a1dfb347be5) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:58.393055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:58.394535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8a82e-11bd-406f-aebb-b7b4f1e11a96 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:58.401960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 562/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:37:58 2022] GET /identity/v3/role_assignments?user.id=bb2e761cce6d43cbb3696a1dfb347be5&scope.project.id=19091971aa154dff9956d7ee3100b437&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:00.823903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662a0a-4def-4189-9063-83228b03f3e6 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:00.824800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662a0a-4def-4189-9063-83228b03f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:00.824800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662a0a-4def-4189-9063-83228b03f3e6 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:00.827560 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 545/1107] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:00.835973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:00.836415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:00.836566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:00.857968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:00.859391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:00.937490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 563/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:00.964359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662a0a-4def-4189-9063-83228b03f3e6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:01.076664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662a0a-4def-4189-9063-83228b03f3e6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:01.112030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:01.112813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:01.113090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:01.113360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:01.114649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:01.116122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e38f3-1267-4e33-a4f4-ac6fadefa308 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:01.117891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 546/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:01.127188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:01.211951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:01.237896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e19e04-9406-4b66-9f15-801d9cccfb63 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:01.278776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:01.279437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:01.279749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:01.280211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:01.280952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:01.282389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f80d51-a63f-4f7b-afc6-4ded44ea6132 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:01.306371 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 564/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:38:01 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:03.706759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7c53-03bf-44e8-85f2-b2635efda699 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:03.707343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7c53-03bf-44e8-85f2-b2635efda699 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:03.707343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7c53-03bf-44e8-85f2-b2635efda699 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:03.708740 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 547/1111] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:03.714969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:03.715452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:03.715576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:03.733788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:03.735031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:03.814544 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 565/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:03.840167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7c53-03bf-44e8-85f2-b2635efda699 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:03.870062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:03.948100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7c53-03bf-44e8-85f2-b2635efda699 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:03.985220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:03.985982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:03.986260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:03.986532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] PATH_INFO: `/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:03.988082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] RBAC: Authorizing `identity:get_role(role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:03.989467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:03.990840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 548/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:03 2022] GET /identity/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:03.997756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:04.064118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:04.107813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb44aac-418a-425c-93db-adbe8dae9872 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:04.145785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:04.146673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:04.146951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:04.147233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] PATH_INFO: `/v3/users/4deefdd56bdd43f6b83f0e48b5263f22` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:04.162686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=4deefdd56bdd43f6b83f0e48b5263f22)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:04.164221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:04.165953 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 566/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:03 2022] GET /identity/v3/users/4deefdd56bdd43f6b83f0e48b5263f22 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:04.172812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:04.274933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:04.282399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03043a-2db1-45e7-ba16-04624638ae74 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:04.317861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:04.318515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:04.318802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:04.319082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:04.390761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:04.392286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:04.487455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:04.495849 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 549/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:04.502237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:04.607147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a68d-cfda-4dff-91a1-912498bb7cf9 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:04.625248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:04.643878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:04.644758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:04.645042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:04.645314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:04.646675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:04.648204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b5a96-0ce0-4735-a8b5-090c6300b165 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:04.650305 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 567/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:04 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:04.657137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:04.772071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda2612-de33-490c-b04c-4fce7d446457 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:04.811238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:04.811906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:04.812186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:04.812467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:04.813329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=19091971aa154dff9956d7ee3100b437, user.id=4deefdd56bdd43f6b83f0e48b5263f22) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:04.813644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:04.815104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe18d7-8c45-4939-941e-6bf67367c100 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:04.821186 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 550/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:04 2022] GET /identity/v3/role_assignments?user.id=4deefdd56bdd43f6b83f0e48b5263f22&scope.project.id=19091971aa154dff9956d7ee3100b437&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:07.291131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691a5f-06ed-4d0f-872f-2a0a6675de40 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:07.291762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691a5f-06ed-4d0f-872f-2a0a6675de40 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:07.291762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a691a5f-06ed-4d0f-872f-2a0a6675de40 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:07.293633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 568/1118] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:07.300935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:07.301491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:07.301580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:07.321700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:07.323859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:07.392683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:07.409810 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 551/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:07.441743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a691a5f-06ed-4d0f-872f-2a0a6675de40 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:07.552424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a691a5f-06ed-4d0f-872f-2a0a6675de40 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:07.589641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:07.590660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:07.591005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:07.591365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] PATH_INFO: `/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:07.593886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] RBAC: Authorizing `identity:get_role(role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:07.595356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:07.596935 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 569/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:07 2022] GET /identity/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:07.603301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:07.719945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358a405-926c-4e21-90fa-68531f9edbd0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:07.762026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:07.763055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:07.763351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:07.763673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] PATH_INFO: `/v3/users/4deefdd56bdd43f6b83f0e48b5263f22` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:07.765465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] RBAC: Authorizing `identity:get_user(user_id=4deefdd56bdd43f6b83f0e48b5263f22)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:07.766957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:07.768908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 552/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:07 2022] GET /identity/v3/users/4deefdd56bdd43f6b83f0e48b5263f22 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:07.775914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:07.856364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:07.903182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bcdc-c402-4c30-8dc3-1586842c5e79 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:07.939521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:07.940577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:07.940922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:07.941192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:07.942455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:07.944038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca130-637a-4ca9-8b3f-e047d748cfe9 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:07.945824 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 570/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:07 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:07.955724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:08.019428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:08.067905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b093-0e09-4fbc-a092-1a29467e3d52 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:08.104623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:08.105524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:08.105803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:08.106075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437/users/4deefdd56bdd43f6b83f0e48b5263f22/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:08.108576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=19091971aa154dff9956d7ee3100b437, user_id=4deefdd56bdd43f6b83f0e48b5263f22, role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:08.109971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7b2d7-7960-47c2-bbba-f004216c66d8 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:08.124894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 553/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:38:07 2022] PUT /identity/v3/projects/19091971aa154dff9956d7ee3100b437/users/4deefdd56bdd43f6b83f0e48b5263f22/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:38:10.671586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ca15-aa39-4cb5-a716-63e315b45c37 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:10.672110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ca15-aa39-4cb5-a716-63e315b45c37 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:10.672110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ca15-aa39-4cb5-a716-63e315b45c37 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:10.673687 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 571/1124] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:10.680756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:10.681362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:10.681460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:10.704515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:10.705722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:10.789003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 554/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:10.815477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ca15-aa39-4cb5-a716-63e315b45c37 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:10.926021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ca15-aa39-4cb5-a716-63e315b45c37 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:10.949900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:10.962796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:10.963710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:10.963990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:10.964276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] PATH_INFO: `/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:10.965885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] RBAC: Authorizing `identity:get_role(role_id=837e1c743f9d42d7bfa215ae3f39d6b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:10.967430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:10.968984 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 572/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:10 2022] GET /identity/v3/roles/837e1c743f9d42d7bfa215ae3f39d6b2 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:10.975418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:11.025500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:11.085329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97f186-e0ba-4af8-b9a9-f5eca0fcf8f9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:11.122476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:11.123347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:11.123711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:11.124082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] PATH_INFO: `/v3/users/4deefdd56bdd43f6b83f0e48b5263f22` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:11.125276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] RBAC: Authorizing `identity:get_user(user_id=4deefdd56bdd43f6b83f0e48b5263f22)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:11.126749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:11.128541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 555/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:10 2022] GET /identity/v3/users/4deefdd56bdd43f6b83f0e48b5263f22 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:11.135428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:11.251525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274462-5acc-4d43-8314-e8d5087198b6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:11.289106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:11.289779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:11.290067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:11.290467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:11.361555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:11.373708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:11.375209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:11.498693 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 573/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:11.505404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:11.615591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ce9aa-1a57-4911-8b2c-443e45ed0182 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:11.631589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:11.654331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:11.655502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:11.655502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:11.655808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] PATH_INFO: `/v3/projects/19091971aa154dff9956d7ee3100b437` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:11.657033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=19091971aa154dff9956d7ee3100b437)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:11.658487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a23a5-3153-4cb5-a308-758ec2d60fb6 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:11.660346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 556/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:11 2022] GET /identity/v3/projects/19091971aa154dff9956d7ee3100b437 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:11.667547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:11.768413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:11.779393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2823e-8ed8-469e-af13-b26cad2397d6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:11.818556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:11.819226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:11.819501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:11.819803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:11.820837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] RBAC: Adding query filter params (role.id=837e1c743f9d42d7bfa215ae3f39d6b2, scope.project.id=19091971aa154dff9956d7ee3100b437, user.id=4deefdd56bdd43f6b83f0e48b5263f22) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:11.821169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:11.822891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab80acb-e7df-43f2-9615-7ac99f60d76c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:11.830850 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 574/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:11 2022] GET /identity/v3/role_assignments?user.id=4deefdd56bdd43f6b83f0e48b5263f22&scope.project.id=19091971aa154dff9956d7ee3100b437&role.id=837e1c743f9d42d7bfa215ae3f39d6b2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:14.258941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922063b5-d05c-4025-b92e-d7e752ef80cf None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.259611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922063b5-d05c-4025-b92e-d7e752ef80cf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.259708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922063b5-d05c-4025-b92e-d7e752ef80cf None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.262418 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 557/1131] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:14.269463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.269959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.270077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.288702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:14.289928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:14.362893 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 575/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:14.388137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922063b5-d05c-4025-b92e-d7e752ef80cf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:14.508510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922063b5-d05c-4025-b92e-d7e752ef80cf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.546237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.546885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.547167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.547486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.548734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.550189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dde523-77ac-4556-b1a7-7574f16e23c4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.551963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 558/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:14.560683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:14.658510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:14.677547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294239fa-3b67-4c4b-8657-e99d1ac5665b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.714847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.715558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.715859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.716129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.716871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.718612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c31e31-a1a9-4d09-96b9-59b9507d6b35 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.748771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 576/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:38:14 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:17.195429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e539-5627-4a52-96e4-23a12a8cde44 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.196216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e539-5627-4a52-96e4-23a12a8cde44 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.196216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424e539-5627-4a52-96e4-23a12a8cde44 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.197584 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 559/1135] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:17.203693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.204235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.204235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.222728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:17.223988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:17.296775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 577/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:17.323184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e539-5627-4a52-96e4-23a12a8cde44 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:17.379973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:17.441399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424e539-5627-4a52-96e4-23a12a8cde44 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:17.478975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:17.479840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.480094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.480404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.481621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:17.483182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353270-cc7c-4955-80ca-93e772305a66 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:17.484984 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 560/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:17.491141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:17.575423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:17.617405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b58b81-ea7e-46a7-bca6-553bf620b73f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:17.656994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:17.657707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.657992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.658269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.659130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:17.660698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9846-5a4a-4919-a5e4-ecc1ab95c8b8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:17.683159 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 578/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:38:17 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:20.189740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd27a-39d9-42d1-b518-410c2c0cb8c4 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:20.190372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd27a-39d9-42d1-b518-410c2c0cb8c4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:20.190372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd27a-39d9-42d1-b518-410c2c0cb8c4 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:20.191650 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 561/1139] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:20.197533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:20.198022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:20.198120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:20.217276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:20.219132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:20.296288 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 579/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:20.325133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd27a-39d9-42d1-b518-410c2c0cb8c4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:20.442706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd27a-39d9-42d1-b518-410c2c0cb8c4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:20.463904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:20.484710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:20.485574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:20.485856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:20.486130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:20.497922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:20.505772 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:20.507005 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:20.508078 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 562/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:20.515141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:20.573331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:20.623918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4aa1b-ab34-4c6f-aa53-63b68c729565 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:20.661503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:20.662206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:20.662536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:20.662844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:20.663705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:20.664014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:20.665521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:20.675136 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 580/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:20.681748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:20.786681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a981d7-bc1e-42d1-8812-0fb3d5e2d92b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:20.823176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:20.824086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:20.824367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:20.824640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] PATH_INFO: `/v3/users/35ca76adba1d4e16bb490e03a24ca268` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:20.838360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] RBAC: Authorizing `identity:get_user(user_id=35ca76adba1d4e16bb490e03a24ca268)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:20.839859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:20.841536 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 563/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:20 2022] GET /identity/v3/users/35ca76adba1d4e16bb490e03a24ca268 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:20.848550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:20.966115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5dc4-3a5c-4d9a-998e-2b52f36e6bc1 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:20.980304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:21.001307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:21.002000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:21.002243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:21.002521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:21.082991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:21.084380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:21.188609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 581/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:21.195576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:21.235976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:21.312597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c08da6-4f15-4991-b8eb-3c4c51ff692c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:21.349856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:21.350658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:21.350985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:21.351255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] PATH_INFO: `/v3/projects/86f2004f2c9846a7b60d737678ea5708` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:21.352588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=86f2004f2c9846a7b60d737678ea5708)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:21.354127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86943a-67ab-43a8-8709-8c76f0d3e2a2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:21.355969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 564/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:21 2022] GET /identity/v3/projects/86f2004f2c9846a7b60d737678ea5708 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:21.362976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:21.379967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:21.474047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966044-fad6-4c82-b0ea-4bf2fb934ad3 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:21.511303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:21.511993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:21.512280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:21.512546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:21.513381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=86f2004f2c9846a7b60d737678ea5708, user.id=35ca76adba1d4e16bb490e03a24ca268) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:21.513691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:21.515329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70021c74-17b4-4ab7-a5c9-4b17c05ea4ff None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:21.521367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 582/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:21 2022] GET /identity/v3/role_assignments?user.id=35ca76adba1d4e16bb490e03a24ca268&scope.project.id=86f2004f2c9846a7b60d737678ea5708&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:23.993797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb1c8-99d8-4043-bcd2-23312fbeb92d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.994435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb1c8-99d8-4043-bcd2-23312fbeb92d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.994435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceb1c8-99d8-4043-bcd2-23312fbeb92d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.995829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 565/1147] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:24.001691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.002221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.002335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.020783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:24.022017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:24.099854 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 583/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:24.124551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb1c8-99d8-4043-bcd2-23312fbeb92d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.241893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceb1c8-99d8-4043-bcd2-23312fbeb92d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.244499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.282159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.283028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.283316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.283621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.296024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:24.304537 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:24.305726 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:24.306806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 566/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:24.312684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.324703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.427666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2965-db6f-4dc5-b3c5-cbbac31515b7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.463693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.464391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.464677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.464938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.465723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:24.466036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.467667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.477870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 584/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:24.485035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.605277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b14b9-201f-4a2e-a46f-76419acbef91 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.649391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.650637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.651023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.651197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] PATH_INFO: `/v3/users/35ca76adba1d4e16bb490e03a24ca268` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.652584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] RBAC: Authorizing `identity:get_user(user_id=35ca76adba1d4e16bb490e03a24ca268)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.654083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.656042 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 567/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/users/35ca76adba1d4e16bb490e03a24ca268 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:24.665117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.752462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.789393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44721c8e-ba60-4d00-84b6-a0b57230900a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.829173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.830058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.830366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.830614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] PATH_INFO: `/v3/projects/86f2004f2c9846a7b60d737678ea5708` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.832074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] RBAC: Authorizing `identity:get_project(project_id=86f2004f2c9846a7b60d737678ea5708)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.833582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a170d-40e1-4f93-946d-08daadae8edd None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.835445 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 585/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/projects/86f2004f2c9846a7b60d737678ea5708 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:24.845226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.879834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.950626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ec11-bb61-4786-99e1-68e95e3d67ef None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.986206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.987099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.987376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.987686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] PATH_INFO: `/v3/projects/86f2004f2c9846a7b60d737678ea5708/users/35ca76adba1d4e16bb490e03a24ca268/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.989663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] RBAC: Authorizing `identity:create_grant(project_id=86f2004f2c9846a7b60d737678ea5708, user_id=35ca76adba1d4e16bb490e03a24ca268, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.991146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c663-dbce-4687-b665-0c32a84ca07f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:25.006489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 568/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:38:24 2022] PUT /identity/v3/projects/86f2004f2c9846a7b60d737678ea5708/users/35ca76adba1d4e16bb490e03a24ca268/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:38:27.573444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b54f8e-b983-4328-8873-2f1e406900be None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.574040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b54f8e-b983-4328-8873-2f1e406900be None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.574040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b54f8e-b983-4328-8873-2f1e406900be None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.575364 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 586/1154] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:27.582176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.582730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.582730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.600883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:27.602387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:27.683203 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 569/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:38:27.718734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b54f8e-b983-4328-8873-2f1e406900be None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:27.826016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b54f8e-b983-4328-8873-2f1e406900be None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:27.862334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:27.863141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.863422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.863731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.871682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:27.876695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:27.884944 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:27.886118 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:38:27.886995 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 587/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:27.893822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:27.925447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.018486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0d4f-a2fa-4058-b10b-e1a29f536cd2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.067490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.068310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.068748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.069171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.070176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:28.070606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.073198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.086610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 570/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:28.094287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.204473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251182d0-9db6-4996-b6da-d1d3e6a9ddb5 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.249668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.250846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.251131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.251409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] PATH_INFO: `/v3/users/35ca76adba1d4e16bb490e03a24ca268` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.252764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] RBAC: Authorizing `identity:get_user(user_id=35ca76adba1d4e16bb490e03a24ca268)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.254277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.256089 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 588/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/users/35ca76adba1d4e16bb490e03a24ca268 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:28.262356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.361810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.380514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61008b-742c-4357-b9d4-35193226703f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.417711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.418430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.418715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.419047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.531418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.534293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.626468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.644660 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 571/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:28.651223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.732363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.770657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9a8db-2f3b-411c-aea9-bb5e71e94d81 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.806348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.807195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.807552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.807899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] PATH_INFO: `/v3/projects/86f2004f2c9846a7b60d737678ea5708` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.809165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] RBAC: Authorizing `identity:get_project(project_id=86f2004f2c9846a7b60d737678ea5708)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.810648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0ffd3-0677-4960-9148-6e34bd507227 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.812563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 589/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/projects/86f2004f2c9846a7b60d737678ea5708 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:28.819004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.946178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7177a0-816d-402e-bb9e-409ba9ea829f None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.984527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.985224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.985512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.985927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.986766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=86f2004f2c9846a7b60d737678ea5708, user.id=35ca76adba1d4e16bb490e03a24ca268) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:28.987069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.988741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b50a64-6586-4f06-955d-b7efd82a4e82 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.997218 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 572/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/role_assignments?user.id=35ca76adba1d4e16bb490e03a24ca268&scope.project.id=86f2004f2c9846a7b60d737678ea5708&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:31.434416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716627c-1f5d-43ce-a39a-6e907ccb0a8d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:31.435000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716627c-1f5d-43ce-a39a-6e907ccb0a8d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:31.435000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716627c-1f5d-43ce-a39a-6e907ccb0a8d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:31.436587 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 590/1162] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:31.441962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:31.442436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:31.442528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:31.459738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:31.460938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:31.505342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:31.531082 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 573/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:31.565400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716627c-1f5d-43ce-a39a-6e907ccb0a8d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:31.682948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716627c-1f5d-43ce-a39a-6e907ccb0a8d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:31.719001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:31.719671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:31.719949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:31.720223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:31.723009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:31.790219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:31.791727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:31.891956 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 591/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:31.898300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:32.009760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0deeb-b366-480e-b61c-353f10eb04b7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:32.048562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:32.049368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.049647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.049917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.057234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:32.058709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-ba8025b3-ff94-4bcf-a3ff-17d6efb2ed2f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:32.073408 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:32.074609 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:32.075501 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 574/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:38:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:32.081158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:32.115453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:32.185994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1f91-1011-4a60-8320-a6d32d3329f6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:32.222555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:32.223224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.223500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.223802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.224525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:32.224826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:32.226220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba401-a091-4960-8dbd-1171bc0d5551 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:32.234443 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 592/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Jun 4 20:38:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:34.568899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7464-ac53-4494-ad9f-aba6bf50d3d1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.569486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7464-ac53-4494-ad9f-aba6bf50d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.569486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7464-ac53-4494-ad9f-aba6bf50d3d1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.570852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 575/1167] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:34.577126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225550d-8a1a-425f-ba48-4106df6d762e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.577934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225550d-8a1a-425f-ba48-4106df6d762e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.578319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225550d-8a1a-425f-ba48-4106df6d762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.601241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d225550d-8a1a-425f-ba48-4106df6d762e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:34.602442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d225550d-8a1a-425f-ba48-4106df6d762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:34.676183 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 593/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:34.700917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7464-ac53-4494-ad9f-aba6bf50d3d1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:34.743648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:34.811670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7464-ac53-4494-ad9f-aba6bf50d3d1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:34.847099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:34.847849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.848136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.848410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.849174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:34.850559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfa77f-1674-4db1-bd80-4c7d2d9c3d88 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:34.867410 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 576/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Sat Jun 4 20:38:34 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:37.212664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ab175-1c11-464d-be5f-d0d947dfbdd4 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.213262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ab175-1c11-464d-be5f-d0d947dfbdd4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.213262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ab175-1c11-464d-be5f-d0d947dfbdd4 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.214617 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 594/1170] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:37.221107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.221579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.221670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.240493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:37.242958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:37.328340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 577/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:37.354580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ab175-1c11-464d-be5f-d0d947dfbdd4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.385645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.462992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ab175-1c11-464d-be5f-d0d947dfbdd4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.501113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.501982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.502267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.502549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] PATH_INFO: `/v3/domains/2a4de1eb1a0741a297701bee2f324493` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.513408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a4de1eb1a0741a297701bee2f324493)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.514881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7340ee-a91d-4a3e-8acc-793319052832 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.516630 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 595/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/domains/2a4de1eb1a0741a297701bee2f324493 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:37.522894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.554336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.636782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b8d66-1de6-460e-bd70-f1f4de922ea4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.678063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61628005-4927-4b06-ae64-c627184d315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.678732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628005-4927-4b06-ae64-c627184d315c None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.679014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628005-4927-4b06-ae64-c627184d315c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.679272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628005-4927-4b06-ae64-c627184d315c None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.680023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61628005-4927-4b06-ae64-c627184d315c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.681458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61628005-4927-4b06-ae64-c627184d315c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.709987 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 578/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:38:37 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:40.078857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461e54-0534-4a73-b5df-cd44b9ec8486 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:40.079443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461e54-0534-4a73-b5df-cd44b9ec8486 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:40.079443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea461e54-0534-4a73-b5df-cd44b9ec8486 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:40.080831 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 596/1174] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:40.086495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:40.086881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:40.087056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:40.105664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:40.106875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:40.179751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 579/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:40.206057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461e54-0534-4a73-b5df-cd44b9ec8486 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:40.302428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:40.316645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea461e54-0534-4a73-b5df-cd44b9ec8486 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:40.353861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:40.354630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:40.354907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:40.355175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] PATH_INFO: `/v3/domains/2a4de1eb1a0741a297701bee2f324493` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:40.356387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2a4de1eb1a0741a297701bee2f324493)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:40.358430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85999233-99d2-4bb9-aa00-61904ca1af06 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:40.359829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 597/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Sat Jun 4 20:38:40 2022] GET /identity/v3/domains/2a4de1eb1a0741a297701bee2f324493 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:40.365793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:40.378159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:40.470319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ab001-a736-4532-953d-d7937bfbe296 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:40.506883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:40.507552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:40.507863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:40.508132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:40.508833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:40.510270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5cc54-eff5-446b-ab28-766353f43a31 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:40.535294 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 580/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:38:40 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:42.992838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd39e-c76c-4a40-bc24-de3de56a81b7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:42.993387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd39e-c76c-4a40-bc24-de3de56a81b7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:42.993387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd39e-c76c-4a40-bc24-de3de56a81b7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:42.994757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 598/1178] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:43.000755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:43.001200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:43.001300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:43.018949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:43.020192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:43.083429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:43.091944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 581/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:43.117663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccd39e-c76c-4a40-bc24-de3de56a81b7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:43.227716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccd39e-c76c-4a40-bc24-de3de56a81b7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:43.262550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:43.263265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:43.263544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:43.263882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:43.274928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:43.283090 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:43.284249 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:38:43.285154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 599/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:43.291004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:43.398073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d81f6-edd7-4253-8649-5bb9cf0d5e73 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:43.434404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:43.435101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:43.435410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:43.435698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:43.436567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:43.436887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:43.438276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:43.447470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 582/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:43.453892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:43.473749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:43.563187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ce4d-4b7d-4ec5-b28b-2b665e3ee0c2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:43.598955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:43.599857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:43.600141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:43.600414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] PATH_INFO: `/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:43.614155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b95ff0f4a61b42ba8376a0cbaadb20cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:43.615979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:43.617598 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 600/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:43 2022] GET /identity/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:43.626017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:43.700469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:43.744007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406799ad-346a-40e7-b4f9-85cae9d9d89e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:43.779906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:43.780559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:43.780846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:43.781120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:43.850529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:43.851957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:43.910491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:43.955476 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 583/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:43.961820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:44.044773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:44.072443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794647f-8a44-4178-bea2-8caac52459b2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:44.110188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:44.110966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:44.111248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:44.111547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] PATH_INFO: `/v3/projects/5b1a78f7ca88474db670839dc2d8448b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:44.112818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] RBAC: Authorizing `identity:get_project(project_id=5b1a78f7ca88474db670839dc2d8448b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:44.114267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d713b8-9159-44eb-b38b-c20056c5eccf None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:44.116052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 601/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:43 2022] GET /identity/v3/projects/5b1a78f7ca88474db670839dc2d8448b => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:44.122504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:44.232745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3b817-5a34-4962-99c8-968d58df2277 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:44.269951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:44.270616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:44.270900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:44.271183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:44.272054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=5b1a78f7ca88474db670839dc2d8448b, user.id=b95ff0f4a61b42ba8376a0cbaadb20cb) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:44.272370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:44.273838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef3db-71ad-4826-a639-c544c3669ab4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:44.280052 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 584/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:44 2022] GET /identity/v3/role_assignments?user.id=b95ff0f4a61b42ba8376a0cbaadb20cb&scope.project.id=5b1a78f7ca88474db670839dc2d8448b&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:46.584907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23e65-0098-49e6-95fb-14be02d64ea7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:46.585514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23e65-0098-49e6-95fb-14be02d64ea7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:46.585514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b23e65-0098-49e6-95fb-14be02d64ea7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:46.586826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 602/1186] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:46.592303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:46.592748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:46.592852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:46.610865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:46.612090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:46.629860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:46.682670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 585/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:46.706888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b23e65-0098-49e6-95fb-14be02d64ea7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:46.820153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b23e65-0098-49e6-95fb-14be02d64ea7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:46.859811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:46.860606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:46.860885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:46.861175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:46.872593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:46.880453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:46.881577 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:38:46.882466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 603/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:46.888145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:46.988667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a6f7b-a01a-4c8c-b1ff-8c7f13144a50 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.026150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.026826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.027110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.027384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.028173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:47.028479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.029887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.038380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 586/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:47.044593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.047961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.152959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5021-7d13-4c9e-b74c-72f832b7f1bb None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.190185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.191031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.191310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.191594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] PATH_INFO: `/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.192809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] RBAC: Authorizing `identity:get_user(user_id=b95ff0f4a61b42ba8376a0cbaadb20cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.194254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.195940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 604/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:47.202734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.222854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.315555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27771e99-02f8-4059-8c20-289ec78fdad0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.350983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.351878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.352157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.352441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] PATH_INFO: `/v3/projects/5b1a78f7ca88474db670839dc2d8448b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.353628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] RBAC: Authorizing `identity:get_project(project_id=5b1a78f7ca88474db670839dc2d8448b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.355069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0431499-3fe9-4ac1-a75f-819c779008db None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.356823 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 587/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/projects/5b1a78f7ca88474db670839dc2d8448b => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:47.363646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.434113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.468436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a6a5f-7bfa-4e21-866e-bee29397f85b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.505971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.506864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.507139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.507411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] PATH_INFO: `/v3/projects/5b1a78f7ca88474db670839dc2d8448b/users/b95ff0f4a61b42ba8376a0cbaadb20cb/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.509514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b1a78f7ca88474db670839dc2d8448b, user_id=b95ff0f4a61b42ba8376a0cbaadb20cb, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.510967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cd83b-a97f-4195-8241-d0b45f8d2fa6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.527596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 605/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:38:47 2022] PUT /identity/v3/projects/5b1a78f7ca88474db670839dc2d8448b/users/b95ff0f4a61b42ba8376a0cbaadb20cb/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:38:49.867552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fef03-b07b-40e2-8982-557503371a68 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:49.868152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fef03-b07b-40e2-8982-557503371a68 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:49.868152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fef03-b07b-40e2-8982-557503371a68 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:49.869520 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 588/1193] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:49.875114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:49.875595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:49.875688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:49.893827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:49.895045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:49.971789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 606/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:49.997853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fef03-b07b-40e2-8982-557503371a68 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.080261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.100353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fef03-b07b-40e2-8982-557503371a68 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.135487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.136214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.136492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.136767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.147303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:50.155185 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:50.156266 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:38:50.157267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 589/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:50.162777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.231367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.275701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f784cf-9839-4c6e-bd7e-3e5a461a27c8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.322357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.323008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.323425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.323732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.324571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:50.325013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.326487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.336780 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 607/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:50.345298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.456941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451e80a-c2b8-4be1-a6ca-1ecd1d46bc26 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.492682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.493551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.493815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.494089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] PATH_INFO: `/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.495295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] RBAC: Authorizing `identity:get_user(user_id=b95ff0f4a61b42ba8376a0cbaadb20cb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.496844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.498651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 590/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/users/b95ff0f4a61b42ba8376a0cbaadb20cb => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:50.504820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.606580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8651bb-158f-4464-ba37-ef427e91554d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.629747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.642380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.643036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.643316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.643624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.722366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.723755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.833115 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 608/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:50.841890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.861319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.955754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18a247-b2af-459f-8c5a-c48f28c339b7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.993822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.994605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.994883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.995152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] PATH_INFO: `/v3/projects/5b1a78f7ca88474db670839dc2d8448b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.996493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] RBAC: Authorizing `identity:get_project(project_id=5b1a78f7ca88474db670839dc2d8448b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.998002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e60a-12d7-4ffe-a516-a72e885dd37a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:51.000053 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 591/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/projects/5b1a78f7ca88474db670839dc2d8448b => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:51.006671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:51.035164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:51.128121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769637b-e119-43aa-bf99-13b329122f5e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:51.167715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:51.168402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:51.168683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:51.168954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:51.169788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=5b1a78f7ca88474db670839dc2d8448b, user.id=b95ff0f4a61b42ba8376a0cbaadb20cb) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:51.170123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:51.171606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576932-9e11-4778-ac0d-51d07bc8fcc1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:51.177530 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 609/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:51 2022] GET /identity/v3/role_assignments?user.id=b95ff0f4a61b42ba8376a0cbaadb20cb&scope.project.id=5b1a78f7ca88474db670839dc2d8448b&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:39:00.988815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=61 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:01.175036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=57 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:58.391361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae386a4-59b0-4d0e-aac9-f78620df86c3 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:58.392353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae386a4-59b0-4d0e-aac9-f78620df86c3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:58.392353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae386a4-59b0-4d0e-aac9-f78620df86c3 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:58.393677 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 592/1201] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:39:58.400995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:58.402377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:58.403081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:58.433049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:58.435677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:58.583789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 610/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:39:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:39:58.614417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae386a4-59b0-4d0e-aac9-f78620df86c3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:58.981647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae386a4-59b0-4d0e-aac9-f78620df86c3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:59.045883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:59.047309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.047872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.050907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.065405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:59.067467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:39:59.093732 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:39:59.095090 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:39:59.096299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:39:59.096299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:39:59.096299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:39:59.096299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:39:59.103870 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 593/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:39:59.105722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:59.286231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f3a19-4719-4c73-8d61-afc14171d784 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:59.334234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:59.344292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:59.345180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.345685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.345991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.346907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:39:59.347320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:59.348971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ba13b-7dae-4066-adaf-f5d9b3555c2f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:59.367356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 611/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:39:59.377036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:59.441012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:59.506169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6e50-835a-4918-b7aa-9462634df1b7 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:59.557637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:59.558532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.558824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.559156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.560486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:59.561643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b5a47-d52a-4f54-8cba-ca5449409e6e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:59.585369 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 594/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Jun 4 20:39:59 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:40:02.263781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c04bd-d21d-4022-81ac-1f66c46780ab None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.264551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c04bd-d21d-4022-81ac-1f66c46780ab None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.264551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c04bd-d21d-4022-81ac-1f66c46780ab None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.265786 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 612/1206] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:02.272127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.272701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.272701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.295678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:02.297456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:02.380513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 595/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:02.409083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c04bd-d21d-4022-81ac-1f66c46780ab None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:02.516975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c04bd-d21d-4022-81ac-1f66c46780ab None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:02.557402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:02.558256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.558553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.558819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.572672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:02.580705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:02.582435 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:02.583871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 613/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:02.588340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:02.632557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:02.716001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ebc44-241f-420b-bf7d-1014e4afa2fa None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:02.751362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:02.752073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.752346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.752627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.753383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:02.753691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:02.755136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:02.765158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 596/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:02.770407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:02.832081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:02.892311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf568d-b34e-4c05-9979-ed2ff0d4fd8b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:02.930704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:02.931522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.931817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.932096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.943447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:02.945165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:02.964926 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:02.966320 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:02.967627 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:02.967627 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:02.967627 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:02.967627 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:02.968698 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 614/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:02.974729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:03.094124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:03.097693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cb174-480c-4aed-aa3e-f2af1db9810c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:03.147401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:03.148406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:03.148868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:03.149190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:03.150070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:03.150397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:03.152365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:03.170491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 597/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:03.176516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:03.306593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04255335-ec7b-4c09-9571-35c3f3f57268 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:03.308377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:03.353469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:03.353469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:03.353802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:03.353802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:03.365012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:03.366757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:03.386150 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:03.392886 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:03.394281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 615/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:03.396258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:03.522686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c0ae-cfc6-4d84-9085-8a0802b13c31 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:03.569303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:03.570363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:03.570549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:03.571007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:03.572058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:03.572488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:03.574422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:03.603666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 598/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:03.606603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:03.755042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2856e9-d0af-44be-8b6a-6e3ef1d02346 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:03.805326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:03.806054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:03.806336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:03.806612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:03.844388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:03.896005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:03.897639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:04.031550 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 616/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:40:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:40:04.037563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:04.077971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:04.188727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4445a8f-7e6c-462a-a1e6-b1d05d2c753a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:04.233433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:04.234275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:04.234566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:04.234883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:04.246389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:04.248104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:04.269053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:04.270640 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:04.272362 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:04.272362 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:04.272362 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:04.272362 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:04.272362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 599/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:04.277367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:04.352639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:04.406358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549549b0-f459-4b9a-87a1-f2636869c9ba None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:04.445022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:04.445631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:04.445905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:04.446183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:04.446925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:04.447233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:04.448785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:04.467560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 617/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:04.471337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:04.556800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:04.591609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5af1c-924e-4bcb-8d60-806507511f6b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:04.636031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:04.636868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:04.637148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:04.637427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:04.646248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:04.648637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:04.670496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:04.671779 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:04.673161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:04.674499 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 600/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:04.680617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:04.803972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cdafd-2db4-4112-8639-48ffddc3d773 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:04.839374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:04.855643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:04.856579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:04.857081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:04.857465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:04.858361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:04.858779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:04.860304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7a7c-3411-4ba5-be27-2c5418b951e3 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:04.881757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 618/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:40:04.889019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:05.023825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae445d4-9b8d-4e0b-8685-95ff0152f185 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:05.073214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:05.081062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:05.081863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:05.082234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:05.082591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:05.083723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=3fecce52ceb3494185ea04b82d652f91) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:05.084104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:05.085858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0f20-3435-4863-a255-117c236c7635 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:05.092639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 601/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:40:04 2022] GET /identity/v3/role_assignments?user.id=3fecce52ceb3494185ea04b82d652f91&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:07.459299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d272-b590-421e-9ab5-845d6bce981f None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:07.459899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d272-b590-421e-9ab5-845d6bce981f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:07.459899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877d272-b590-421e-9ab5-845d6bce981f None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:07.461292 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 619/1220] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:07.468284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:07.468838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:07.468838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:07.490733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:07.491976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:07.585426 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 602/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:07.610959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877d272-b590-421e-9ab5-845d6bce981f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:07.744437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877d272-b590-421e-9ab5-845d6bce981f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:07.784629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:07.785416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:07.785740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:07.785962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:07.804199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:07.812928 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:07.814022 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:07.814999 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:07.822572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 620/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:07.822759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:07.942382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ecb9b-fe19-4462-a9e9-f0381ec08293 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:07.972411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:07.986966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:07.987967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:07.988354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:07.988703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:07.989696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] RBAC: Adding query filter params (name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:07.990117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:07.991838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:08.009044 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 603/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:40:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:08.010015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:08.064245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:08.151844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd6b2-64c0-4379-b9a0-2a3fb305fe2c None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:08.195781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:08.196798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.197177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.197579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:08.211099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:08.212920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:08.233397 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:08.234637 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:08.235915 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:08.235915 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:08.235915 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:08.235915 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:08.237432 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 621/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:08.243676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:08.366445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b47bd-1ec9-41d5-8873-94c122071a80 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:08.402123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:08.402800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.403078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.403404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:08.404255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:08.404575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:08.405960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:08.424126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 604/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:08.430161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:08.551526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:08.560964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6d5e7-5de1-4889-aa5b-ccd2569e240e None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:08.611132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:08.612736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.613203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.613695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] PATH_INFO: `/v3/users/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:08.629858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:08.632657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:08.663541 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:08.664815 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:08.665906 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 622/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:08.673102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:08.754100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:08.823832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6139-61a8-49c7-a548-bb291f945cee None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:08.862259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:08.862954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.863229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.863502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:08.864381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:08.864685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:08.866169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:08.886383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 605/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:08.893132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.022115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eda23-506e-49c5-837d-2f5f09e6602b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.066973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.067819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.068099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.068375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.080613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.082347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:09.103927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:09.105459 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:09.106775 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:09.106775 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:09.106775 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:09.106775 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:09.106775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 623/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:09.115642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.255638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1b026-1336-4291-a98c-6db366ed774e None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.258778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:09.298577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.299333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.299615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.299914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.300692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:09.301024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.302560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.316792 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 606/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:09.323153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.335240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:09.472696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181e8d7-5f60-4d3c-9488-0f62872ebf93 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.516145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.516762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.517034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.517304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.524809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.526672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:09.546923 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:09.548074 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:09.549158 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:09.549740 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 624/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:09.556265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.673765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7542f45-6e78-41a6-b5bd-00fb8c501b9a None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.712212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.712982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.713264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.713555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.714336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:09.714643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.716890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092787c-c385-4306-9ea6-18f2757eaeae None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.729723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 607/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:09.737085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.818874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:09.860939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2e2c-e195-4f61-b004-fe82977cdf4d None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.899185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.900251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.900593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.901255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/3fecce52ceb3494185ea04b82d652f91/roles/5d586f18b58441bba3685d73e5f31daa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.918235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=3fecce52ceb3494185ea04b82d652f91, role_id=5d586f18b58441bba3685d73e5f31daa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.920349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37698a96-4b47-45b2-8b3d-062896527809 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.936285 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 625/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:40:09 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/3fecce52ceb3494185ea04b82d652f91/roles/5d586f18b58441bba3685d73e5f31daa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:40:12.580123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acae7-489d-404b-9f1a-4222b239cdfd None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:12.580728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acae7-489d-404b-9f1a-4222b239cdfd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:12.580728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8acae7-489d-404b-9f1a-4222b239cdfd None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:12.582050 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 608/1233] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:12.587818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:12.588317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:12.588428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:12.612575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:12.613942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:12.708172 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 626/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:12.734803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8acae7-489d-404b-9f1a-4222b239cdfd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:12.764974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:12.854736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8acae7-489d-404b-9f1a-4222b239cdfd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:12.893199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:12.894338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:12.894614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:12.894891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:12.907270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:12.915193 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:12.917241 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:40:12.919145 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:12.922307 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 609/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Jun 4 20:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:12.923614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:12.978023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:13.053338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2938a57-7d9b-44b3-9fde-bf591c744453 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:13.099215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:13.100050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:13.100283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:13.100570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:13.101365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:13.101673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:13.103108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:13.113667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 627/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Jun 4 20:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:40:13.119778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:13.217147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:13.236051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724462-f2f8-4fdf-9d08-dda649adc7fc None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:13.287266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:13.288142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:13.288429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:13.288708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:13.303930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:13.305464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:13.325963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:13.327161 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:13.328191 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:13.328191 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:13.328191 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:13.328191 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:13.328191 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 610/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:13.333277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:13.455151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7699b7-3996-4482-982c-b96a685255d4 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:13.466187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:13.495196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:13.495781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:13.496071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:13.496353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:13.497142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:13.497487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:13.498885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:13.513429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 628/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:13.518980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:13.632214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785bd8f-6f46-45b3-9b55-4f33ba151cf9 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:13.669153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:13.670150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:13.670469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:13.670761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:13.674094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:13.680081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:13.681733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:13.697332 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:13.698584 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:13.699701 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:13.700881 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 611/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:13.706596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:13.816801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25193cf-6327-4754-a62c-35110674e9c6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:13.853723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:13.854450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:13.854776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:13.855118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:13.856181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:13.856654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:13.858345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:13.885827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 629/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:13.892929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:14.009806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f300467-2be2-45cb-bdbd-e0f99a4cea60 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:14.053405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:14.054184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.054547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.054826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.126575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:14.134202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:14.135783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:14.250687 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 612/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:40:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:40:14.257293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:14.292893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:14.403946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650796d-77c4-4325-8c40-a8751027c62b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:14.454743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:14.455999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.456482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.457012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.473250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:14.475214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:14.497829 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:14.498945 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:14.500017 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:14.500017 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:14.500017 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:14.500017 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:14.500017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 630/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:14.505575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:14.627372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:14.635960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d8732-839d-455a-a303-16ea70c40431 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:14.685286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:14.686385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.686870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.687349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.688534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:14.688956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:14.690757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:14.705274 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 613/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:14.714375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:14.817304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:14.847930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db299-c1b3-4696-8ad7-f7c00400d2fa None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:14.890969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:14.891772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.892058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.892334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.900471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:14.902326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:14.917707 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:14.919136 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:14.920596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 631/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:14.925282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:15.063421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88e04-720e-4c93-8d15-cb2daa0b9757 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:15.107235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:15.107981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:15.108277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:15.108558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:15.109355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:15.109681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:15.111180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619a5f-ed87-42dc-8e0d-9c02932924ef None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:15.125885 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 614/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:15.132828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:15.257905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d8410-adcc-41a4-aa80-3b82b401925a None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:15.304830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:15.305497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:15.305834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:15.306081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:15.306963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] RBAC: Adding query filter params (role.id=5d586f18b58441bba3685d73e5f31daa, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=3fecce52ceb3494185ea04b82d652f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:15.307249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:15.308956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4dbfb-5104-41f4-991f-c6650af3b6ad None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:15.315983 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 632/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:40:15 2022] GET /identity/v3/role_assignments?user.id=3fecce52ceb3494185ea04b82d652f91&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=5d586f18b58441bba3685d73e5f31daa => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:17.997093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea971d-110d-472d-922e-9294b2beeccf None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:17.997093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea971d-110d-472d-922e-9294b2beeccf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:17.997984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea971d-110d-472d-922e-9294b2beeccf None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:17.998855 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 615/1247] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:18.006031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:18.006871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:18.007095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:18.015220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:18.032850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:18.034531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:18.135116 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 633/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:18.163581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea971d-110d-472d-922e-9294b2beeccf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:18.197679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:18.318820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea971d-110d-472d-922e-9294b2beeccf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:18.359952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:18.360897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:18.361222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:18.361499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:18.378910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:18.399133 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:18.401625 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:18.403364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 616/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:18.409828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:18.550455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44afa4-226a-46ae-9df8-fdfc28d0025e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:18.589843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:18.596257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:18.596981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:18.597330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:18.597851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:18.598690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:18.599318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:18.601562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:18.616345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 634/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:18.617841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:18.728215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:18.756327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f31ce-e765-4629-a530-8969c951e7da None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:18.795229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:18.796066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:18.796377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:18.796675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:18.809126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:18.810798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:18.829883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:18.831127 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:18.832131 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:18.832131 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:18.832131 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:18.832131 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:18.832131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 617/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:18.837671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:18.955574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea283b-ba9b-4e66-8ace-dbf80c744829 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:18.997038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:18.997885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:18.998277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:18.998632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:18.999437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:18.999793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:19.001323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:19.018156 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 635/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:19.024802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:19.171048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a7fe-65ea-4412-a449-b0639287ccbf None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:19.206281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:19.218078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:19.218875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:19.219206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:19.219461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:19.228874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:19.230425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:19.248883 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:19.250439 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:19.252572 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 618/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:19.256912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:19.333785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:19.383951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38560f49-3d77-4a0c-8bb3-5cc56d3a7847 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:19.425914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:19.426589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:19.426872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:19.427145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:19.428024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:19.428332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:19.429802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:19.451269 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 636/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:40:19.458318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:19.564398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be2f2-7647-47eb-a13e-a5fc3dafb8ba None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:19.601513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:19.603220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:19.603220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:19.603220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:19.665995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:19.680381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:19.681889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:19.795894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 619/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:40:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:40:19.802198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:19.914828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438940dc-4c70-49a0-be59-feb4d934abc2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:19.932592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:19.958457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:19.959293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:19.959624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:19.959896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:19.971221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:19.972731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:19.993461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:19.995018 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:19.996362 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:19.996362 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:19.996362 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:19.996362 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:20.000907 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 637/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:20.002154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:20.110123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:20.124136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5814a2-bdf3-40e5-a8c3-3a10a5433cfa None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:20.162975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:20.163735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.164012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.164368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.165365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:20.165788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:20.167655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:20.181664 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 620/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:40:20.188254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:20.309308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5805a-0e79-4b9f-8e75-e06d4f0e6598 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:20.347030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:20.347867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.348162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.348421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.355136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:20.356961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:20.373415 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:20.374336 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:20.375258 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 638/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:20.380779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:20.505852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e81b-8195-4e16-993b-6e20c102280c None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:20.544627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:20.545298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.545575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.545846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.546643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:20.546947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:20.548424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2cdd-d953-459f-9120-4234f0679f86 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:20.561259 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 621/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:20.568578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:20.598607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:20.693530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cea7-6367-4a81-a0ad-dcd0c6a17c36 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:20.743308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:20.744006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.744288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.744560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.745395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=3fecce52ceb3494185ea04b82d652f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:20.745704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:20.747467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80041318-2367-4b21-a6af-685cc9d5f4f2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:20.754560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 639/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:40:20 2022] GET /identity/v3/role_assignments?user.id=3fecce52ceb3494185ea04b82d652f91&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:23.222219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfdcbe-178c-49f4-81f3-5e5829e9ff04 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:23.222219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfdcbe-178c-49f4-81f3-5e5829e9ff04 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:23.222219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfdcbe-178c-49f4-81f3-5e5829e9ff04 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:23.222219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 622/1261] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:23.226098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:23.226536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:23.226729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:23.244897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:23.246252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:23.318034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 640/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:23.343742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfdcbe-178c-49f4-81f3-5e5829e9ff04 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:23.355868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:23.459349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfdcbe-178c-49f4-81f3-5e5829e9ff04 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:23.495134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:23.495882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:23.496163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:23.496434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:23.508232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:23.516400 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:23.517592 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:23.518692 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 623/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:23.525005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:23.547447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:23.632456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6236-02b5-466e-a398-36f476b7fc93 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:23.668134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:23.669209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:23.669502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:23.669780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:23.670530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:23.670840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:23.672258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:23.680929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 641/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:23.687267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:23.755776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:23.790469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6d40a-48d9-4467-8cc5-e95f934a5582 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:23.825766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:23.826560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:23.826838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:23.827112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:23.838454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:23.839946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:23.858750 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:23.859886 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:23.860813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:23.860813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:23.860813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:23.860813 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:23.860813 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 624/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:23.866628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:23.953766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:23.974590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323952e-abb3-4a33-a7eb-e6b5b9d49ec8 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:24.008827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:24.009369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:24.009666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:24.009948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:24.010674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:24.010977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:24.012469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:24.025427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 642/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:24.031857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:24.139076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237909-6bfa-4dcb-9841-693e2ae908c2 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:24.160875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:24.177305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:24.178132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:24.178408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:24.178679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:24.187660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:24.189147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:24.204923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:24.206663 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:24.208546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 625/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:24.212555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:24.355454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f78ac-32b7-4420-ac0f-ecdaf5c5c171 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:24.393616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:24.394355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:24.394632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:24.394900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:24.395865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:24.396169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:24.397637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:24.408800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:24.420434 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 643/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:24.426380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:24.603897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee447-62a4-48fd-bb92-24a1869462c4 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:24.643586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:24.644295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:24.644573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:24.644845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:24.656868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:24.658358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:24.676418 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:24.678056 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:24.679857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:24.679857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:24.679857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:24.679857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:24.679857 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 626/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:40:24.685055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:24.814298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885509f5-78a0-4f43-b84f-b1e195794e06 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:24.852221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:24.852897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:24.853181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:24.853453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:24.854185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:24.854488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:24.855913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:24.868281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 644/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:24.875494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:24.911121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:24.981636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a28f4-0493-43c1-850c-796391e56ab0 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:25.018155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:25.018962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.019241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.019525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.027080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:25.029060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:25.043909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:25.044971 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:25.045909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 627/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:25.051454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:25.123139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:25.166281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddcef-b039-4e30-a59c-f09d7c59a3e2 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:25.201894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:25.202567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.202834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.203118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.203942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:25.204252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:25.205705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0218dd3-d3e9-44ed-9d33-98131c46fa5c None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:25.218534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 645/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:25.224879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:25.323255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:25.333304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2021-27af-487f-b77d-03ad8a3f5dad None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:25.370401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:25.371302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.371650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.371924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] PATH_INFO: `/v3/projects/36edf7db2659419aa39f259141009a4a/users/3fecce52ceb3494185ea04b82d652f91/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.374265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] RBAC: Authorizing `identity:create_grant(project_id=36edf7db2659419aa39f259141009a4a, user_id=3fecce52ceb3494185ea04b82d652f91, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:25.375767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f88ff-0ec1-4284-aeea-66c63530f155 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:25.390751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 628/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Jun 4 20:40:25 2022] PUT /identity/v3/projects/36edf7db2659419aa39f259141009a4a/users/3fecce52ceb3494185ea04b82d652f91/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:40:27.816933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3bd5e-643c-4901-9db6-dc891d3caf87 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:27.817654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3bd5e-643c-4901-9db6-dc891d3caf87 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:27.817654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3bd5e-643c-4901-9db6-dc891d3caf87 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:27.818849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 646/1274] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:27.824771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:27.825216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:27.825318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:27.843308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:27.844591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:27.917889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 629/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:27.943855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3bd5e-643c-4901-9db6-dc891d3caf87 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.059371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3bd5e-643c-4901-9db6-dc891d3caf87 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.080547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:28.097890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.098695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.098975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.099248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.109712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:40:28.117599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:28.118667 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:28.119850 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 647/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Jun 4 20:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:28.126348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.213533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:28.236245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e33919-862b-41bc-9cff-0ebf1019020b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.272485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.273156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.273431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.273699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.274425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:28.274726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.276489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.285010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 630/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:28.291083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.396858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebdd41-8d8f-4706-b25a-93e482d160e6 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.431639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.432433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.432710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.432981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.443800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.445266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:28.464041 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:28.465248 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:28.467062 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:28.467062 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:28.467062 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:28.467062 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:28.467062 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 648/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:28.471599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.581208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6afe4-3fd3-4f53-a967-060dce431062 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.617791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.618454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.618727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.618999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.619754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:28.620057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.621434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.636493 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 631/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:28.642917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.677307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:28.758872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac0b34-848f-49ae-b48e-02901e5a9227 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.797625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.798437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.798710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.798979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.807302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.808823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:40:28.824217 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:28.825899 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:28.827359 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 649/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:28.832325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.836420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:28.934455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bde4c2-7f8f-40f7-ba84-3fdf7a5b2cf1 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.974685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.975357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.975668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.975937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.976777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:28.977081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.978528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.998400 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 632/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:29.005223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:29.115393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:29.130068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487834-a44d-4467-b5a9-7e9704fa0c6b None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:29.165817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:29.166465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:29.166742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:29.167008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:29.260195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:29.262984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:29.385207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:29.397882 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 650/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Jun 4 20:40:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:40:29.404416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:29.469169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:29.510450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25b72-1342-45c4-a04f-c4a45a97ea57 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:29.551755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:29.552571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:29.552857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:29.553136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:29.564437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:29.565920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:40:29.584521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:29.585607 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:29.586580 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:40:29.586580 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:40:29.586580 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:40:29.586580 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:29.586580 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 633/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:29.591888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:29.695377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4580e-bdfd-4096-849f-af48314f4970 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:29.731531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:29.732194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:29.732481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:29.732753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:29.733461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:29.733773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:29.735154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:29.747814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 651/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Jun 4 20:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:29.753821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:29.862388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37312c4-479e-4238-af10-8df573ed9db3 None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:29.878105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:29.900185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:29.901330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:29.901603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:29.901875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:29.909482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:29.910942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:40:29.925259 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:29.926423 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 20:40:29.927598 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 634/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Jun 4 20:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:29.933090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:29.987854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:30.048113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1981e5-cf1d-4320-9193-9482fa7008ff None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:30.092070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:30.092784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:30.093071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:30.093353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:30.094157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:30.094470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:30.095963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dafc06-8a3e-4687-9c7e-d6f144d4c823 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:30.109051 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 652/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Jun 4 20:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:30.115433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:30.224424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b971bf-5452-41d3-9db1-e9b7b20a1d0b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:30.260609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:30.261261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:30.261540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:30.261821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:30.262931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] RBAC: Adding query filter params (role.id=6cf06574abcf4310a389a3111ad8c511, scope.project.id=36edf7db2659419aa39f259141009a4a, user.id=3fecce52ceb3494185ea04b82d652f91) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:30.263244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:30.264714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f33edd-ed3c-455e-88fa-ea608bf58474 None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:30.270726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 635/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Jun 4 20:40:30 2022] GET /identity/v3/role_assignments?user.id=3fecce52ceb3494185ea04b82d652f91&scope.project.id=36edf7db2659419aa39f259141009a4a&role.id=6cf06574abcf4310a389a3111ad8c511 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:32.683200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8507-05ea-4a33-83a2-9167223ae131 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:32.683823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8507-05ea-4a33-83a2-9167223ae131 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:32.683823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd8507-05ea-4a33-83a2-9167223ae131 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:32.685274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 653/1288] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:32.690924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:32.691424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:32.691655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:32.709716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:32.710943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:32.744371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:32.784772 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 636/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:32.809297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd8507-05ea-4a33-83a2-9167223ae131 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:32.923192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd8507-05ea-4a33-83a2-9167223ae131 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:33.068607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:33.103888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:33.104708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.104993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.105267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] PATH_INFO: `/v3/services/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.106052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:33.107656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:33.120936 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:33.123753 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:33.125437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 654/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:40:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:33.129200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:33.234212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c323a-6d6a-4c08-be77-91f0fb3d881b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:33.271099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:33.271800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.272088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.272373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.273090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] RBAC: Adding query filter params (name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:33.273398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:33.274795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a77a-e768-4962-9520-c677a055011d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:33.280494 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 637/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jun 4 20:40:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:33.286538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:33.404154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605d75d-174d-4e85-b3da-c56f89b5ab8f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:33.442360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:33.443033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.443312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.443593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.444373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:33.444667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:33.446065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b807ac-0168-416f-851f-512bd323b8d1 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:33.451928 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 655/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jun 4 20:40:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:35.838827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd458c0-acb2-4076-9fff-b0e7a7004792 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:35.839444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd458c0-acb2-4076-9fff-b0e7a7004792 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:35.839444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd458c0-acb2-4076-9fff-b0e7a7004792 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:35.841197 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 638/1293] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:35.848029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611c9a-1ba8-46b5-aca7-0d3f79fbe337 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:35.848824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611c9a-1ba8-46b5-aca7-0d3f79fbe337 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:35.848824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611c9a-1ba8-46b5-aca7-0d3f79fbe337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:35.866440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-34611c9a-1ba8-46b5-aca7-0d3f79fbe337 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:35.867679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-34611c9a-1ba8-46b5-aca7-0d3f79fbe337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:35.901114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:35.942449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 656/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:35.967891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd458c0-acb2-4076-9fff-b0e7a7004792 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:36.002474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:36.103360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd458c0-acb2-4076-9fff-b0e7a7004792 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:36.164604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:36.165641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:36.166075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:36.166526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:36.167773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:36.170610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b6fb4-999d-40a6-93f6-9eb4ef00581a None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:36.189785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 639/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Jun 4 20:40:35 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:40:38.583744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193860a2-0df4-45af-899e-32a44a269a56 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:38.584321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193860a2-0df4-45af-899e-32a44a269a56 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:38.584321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193860a2-0df4-45af-899e-32a44a269a56 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:38.585813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 657/1296] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:38.592691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:38.593220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:38.593593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:38.619143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:38.621070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:38.715890 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 640/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:38.742029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193860a2-0df4-45af-899e-32a44a269a56 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:38.900550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193860a2-0df4-45af-899e-32a44a269a56 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:38.958322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:38.959743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:38.960236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:38.960720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:38.961913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:38.964492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:38.988026 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:38.989270 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:38.990273 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 658/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:40:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:38.996943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:39.019216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:39.131759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c30c-a0bd-4060-9288-a0d25aab5652 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:39.170853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:39.171646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:39.171978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:39.172296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:39.173065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] RBAC: Adding query filter params (name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:39.173414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:39.174872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:39.180916 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 641/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jun 4 20:40:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:39.187368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:39.230378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:39.311357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5e9fb-d997-4ce4-9f1e-aa02a0534695 None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:39.346941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:39.347654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:39.347945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:39.348251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:39.349044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] RBAC: Adding query filter params (interface=public, service_id=5bc3774f57e04407bc7375b92b185273, region_id=RegionOne) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:39.349360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:39.350777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b5e5b-9465-4bae-aacf-34acb20432db None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:39.357175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 659/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Jun 4 20:40:39 2022] GET /identity/v3/endpoints?service_id=5bc3774f57e04407bc7375b92b185273&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:40:39.364123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:39.461354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:39.482985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3476ba-4d01-4646-9d2a-78eb688f3f5b None admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:39.520531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:39.521423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:39.521706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:39.521985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:39.522698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:39.524154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a12192-08c2-4900-adfd-3b5c807da31d None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:39.532413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 642/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Jun 4 20:40:39 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:40:41.967234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b376-91f7-42bb-9b41-44aa09695041 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:41.967885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b376-91f7-42bb-9b41-44aa09695041 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:41.967885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b376-91f7-42bb-9b41-44aa09695041 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:41.969225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 660/1302] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:40:41.975123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:41.975666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:41.975802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:41.994360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:41.995645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:42.072986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 643/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:40:42.117711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b376-91f7-42bb-9b41-44aa09695041 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:42.235881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:42.243352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b376-91f7-42bb-9b41-44aa09695041 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:42.282871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:42.283736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:42.284018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:42.284297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] PATH_INFO: `/v3/services/placement` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:42.284946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:42.286347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:40:42.299250 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:40:42.301341 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 20:40:42.303290 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 661/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Jun 4 20:40:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:40:42.308799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:42.408903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:42.436212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7e05-6315-4fe4-bf9f-beb022d15b98 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:42.472638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:42.473322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:42.473608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:42.473885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:42.474610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] RBAC: Adding query filter params (name=placement) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:40:42.474925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:42.476365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f582875-b89e-4f8e-92cc-16a5efd50e2f None admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:42.482459 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 644/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Jun 4 20:40:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:40:42.491723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:42.605191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3b29-6172-4b29-8b1b-bff0955b760f None admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:42.645756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:42.646428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:42.646704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:42.646956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:42.647754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:42.649161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd07a-3883-48f2-b458-31c2110a2fa4 None admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:42.672501 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 662/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Jun 4 20:40:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:40:52.478898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=30 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:52.668030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:58.874379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0ad2-5b07-4731-a544-cc75bfa18bab None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:58.874925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0ad2-5b07-4731-a544-cc75bfa18bab None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:58.874925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0ad2-5b07-4731-a544-cc75bfa18bab None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:58.876327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 645/1307] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:58.881930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33e17-f23e-43be-811d-90b93c06da81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:58.882336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33e17-f23e-43be-811d-90b93c06da81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:58.882424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33e17-f23e-43be-811d-90b93c06da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.044177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aab33e17-f23e-43be-811d-90b93c06da81 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:59.048603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aab33e17-f23e-43be-811d-90b93c06da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:59.259306 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 663/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:59.311663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:59.312354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:59.312865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.315084 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 646/1309] 10.222.0.18 () {54 vars in 964 bytes} [Sat Jun 4 20:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:59.320945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0030-2f01-4f0b-9fa5-ff0adb1818fc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:59.321237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0030-2f01-4f0b-9fa5-ff0adb1818fc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:59.321506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0030-2f01-4f0b-9fa5-ff0adb1818fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.431281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fccb0030-2f01-4f0b-9fa5-ff0adb1818fc None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:59.433648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fccb0030-2f01-4f0b-9fa5-ff0adb1818fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:59.467895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:59.530300 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 664/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jun 4 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:59.539926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:59.541797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:59.691781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8d38-e28d-4e13-a0b3-9adf82c14708 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:59.773456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:59.774044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:59.774325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:59.774601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.776841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:59.840567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:59.911157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:59.912692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5f728-b48e-42f0-b78a-dd10d96cf6f7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:59.933596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 647/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:02.724838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad681aa-cf4b-44b9-bb74-4db9b06415c7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:02.725412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad681aa-cf4b-44b9-bb74-4db9b06415c7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:02.725412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad681aa-cf4b-44b9-bb74-4db9b06415c7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:02.726945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 665/1312] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:02.732836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21842-345c-495a-96f7-f71d2d19aa04 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:02.733332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21842-345c-495a-96f7-f71d2d19aa04 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:02.733514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21842-345c-495a-96f7-f71d2d19aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:02.835224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ba21842-345c-495a-96f7-f71d2d19aa04 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:02.837001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ba21842-345c-495a-96f7-f71d2d19aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:02.944830 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 648/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:03.001253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:03.001705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:03.001987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:03.003429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 666/1314] 10.222.0.18 () {54 vars in 964 bytes} [Sat Jun 4 20:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:03.010419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d281c-0b05-461b-812d-4bf61d171b9d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:03.011417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d281c-0b05-461b-812d-4bf61d171b9d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:03.011737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d281c-0b05-461b-812d-4bf61d171b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:03.024529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:03.118389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cc2d281c-0b05-461b-812d-4bf61d171b9d None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:03.120816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc2d281c-0b05-461b-812d-4bf61d171b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:03.247293 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 649/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jun 4 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:03.257524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:03.259238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:03.379760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69730d0a-587d-463a-a8d6-9a4879a36061 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:03.458935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:03.461892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:03.462739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:03.463055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:03.463940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:03.466329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:03.585625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:03.587248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1147b-74e7-458e-85a2-8d76dcab5930 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:03.608109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 667/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:06.538247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:06.538832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:06.538832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:06.540231 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 650/1317] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:06.546720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0706-b54f-4374-ae3a-5c3c686db1f0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:06.547212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0706-b54f-4374-ae3a-5c3c686db1f0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:06.547306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0706-b54f-4374-ae3a-5c3c686db1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:06.618698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-878b0706-b54f-4374-ae3a-5c3c686db1f0 None None] MFA Rules not processed for user `a53dae70db28467caf7de0ef4bf03539`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:06.620610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-878b0706-b54f-4374-ae3a-5c3c686db1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:06.676726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:06.723221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 668/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:06.764498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:06.766049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:06.883255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2f6f-a826-4cc1-ac07-fed1f6b8719e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:06.886959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:06.967668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:06.968319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:06.968599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:06.968877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:06.970534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:07.086617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:07.088106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac458518-4648-48a4-8f4f-4f429da84e70 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:07.107782 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 651/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:10.187567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.188140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.188140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.189529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 669/1320] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:10.195154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1870b-cf39-4e85-8c53-48c3c096e7ce None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.195595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1870b-cf39-4e85-8c53-48c3c096e7ce None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.195735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1870b-cf39-4e85-8c53-48c3c096e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.238024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:10.264075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-71b1870b-cf39-4e85-8c53-48c3c096e7ce None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:10.265284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-71b1870b-cf39-4e85-8c53-48c3c096e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:10.376897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 652/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:10.418948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:10.420545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:10.546645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff7a3d-ab5f-49cd-9666-67e59acc3716 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:10.629667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:10.630333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.631236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.631236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.632648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:10.641526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:10.762115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:10.763622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709ef7-2c33-446d-b3f8-362a215183c4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:10.785033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 670/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:13.844593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:13.845170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:13.845170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:13.846529 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 653/1323] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:13.852370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180ddd-4d78-4796-9afe-a7269d10dd31 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:13.852867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180ddd-4d78-4796-9afe-a7269d10dd31 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:13.852957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180ddd-4d78-4796-9afe-a7269d10dd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:13.922904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d5180ddd-4d78-4796-9afe-a7269d10dd31 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:13.924170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d5180ddd-4d78-4796-9afe-a7269d10dd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:13.984308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:14.027788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 671/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:14.065330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:14.066916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:14.181149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12982519-f5c5-49c5-910f-d1730487f5df None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:14.194681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:14.266824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:14.267479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:14.267777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:14.268053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:14.269701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:14.397310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:14.398663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9477dfd-8132-45ad-8d11-90a7816c9786 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:14.419733 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 654/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:16.820598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:16.821178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:16.821464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:16.824260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 672/1326] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:16.830466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2b70-eb28-43ca-a96c-830cd65a4027 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:16.831693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2b70-eb28-43ca-a96c-830cd65a4027 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:16.831693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec2b70-eb28-43ca-a96c-830cd65a4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:16.883010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:16.904980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fcec2b70-eb28-43ca-a96c-830cd65a4027 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:16.906193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fcec2b70-eb28-43ca-a96c-830cd65a4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:17.013632 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 655/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:17.054327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:17.055941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:17.172601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d7a1c-f60e-4251-b9e0-265e37d75693 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:17.252140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:17.252801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:17.253082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:17.253473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:17.255247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:17.273962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:17.373680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:17.373680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5d476-d55a-4772-9766-adf45678213e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:17.391053 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 673/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:19.875601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:19.876193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:19.876193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:19.877587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 656/1329] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:19.883537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b235fb-4b98-4f84-8033-c9fd5c916153 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:19.884090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b235fb-4b98-4f84-8033-c9fd5c916153 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:19.884090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b235fb-4b98-4f84-8033-c9fd5c916153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:19.957395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a5b235fb-4b98-4f84-8033-c9fd5c916153 None None] MFA Rules not processed for user `a53dae70db28467caf7de0ef4bf03539`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:19.958606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a5b235fb-4b98-4f84-8033-c9fd5c916153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:20.028218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:20.061680 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 674/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:20.102374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:20.104111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:20.217387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341128-1cea-4a48-8411-cc2d1f1bc8a1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:20.239441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:20.295186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:20.296032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:20.296314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:20.296604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:20.298270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:20.415234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:20.417098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda951-844d-4b21-833d-bf0f8aecb922 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:20.437089 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 657/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:23.034546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:23.034976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:23.035125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:23.038520 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 675/1332] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:23.044261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83671-3b65-4359-90c4-50104296794d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:23.044735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83671-3b65-4359-90c4-50104296794d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:23.044850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83671-3b65-4359-90c4-50104296794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:23.119563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:23.123381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-20e83671-3b65-4359-90c4-50104296794d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:23.125415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20e83671-3b65-4359-90c4-50104296794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:23.232975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 658/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:42:23.269684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:23.271220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:23.392983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb3d8-604b-4d74-b0c9-a71217d7d8d0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:23.473113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:23.473774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:23.474052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:23.474322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:23.476018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:23.505346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:23.606377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:23.607862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dc3dd-b271-4fea-bd78-f3c4d30bbf56 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:23.629752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 676/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:42:26.075279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:26.075926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:26.075926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:26.077254 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 659/1335] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:26.082693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b9bc-4c9d-4a35-a19e-7b475548d254 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:26.083129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b9bc-4c9d-4a35-a19e-7b475548d254 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:26.083222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2b9bc-4c9d-4a35-a19e-7b475548d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:26.152365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d6e2b9bc-4c9d-4a35-a19e-7b475548d254 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:26.153584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d6e2b9bc-4c9d-4a35-a19e-7b475548d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:26.232309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:26.255334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 677/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:26.297269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:26.298881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:26.411066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3f1b3-b9a5-4bfa-9375-fc006eb3e18e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:26.440873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:26.489998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:26.490641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:26.490920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:26.491220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:26.492862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:26.612483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:26.614077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9d68-8959-419b-b1da-c3b38729796e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:26.634520 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 660/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:42:29.319898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:29.320526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:29.320526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:29.321845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 678/1338] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:29.327475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332b56-325a-4f60-9354-cee530061d21 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:29.327949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332b56-325a-4f60-9354-cee530061d21 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:29.328088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332b56-325a-4f60-9354-cee530061d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:29.398065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3b332b56-325a-4f60-9354-cee530061d21 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:29.399224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3b332b56-325a-4f60-9354-cee530061d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:29.409310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:29.514726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 661/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:29.552618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:29.556737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:29.686572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f714d-67f0-4e71-b1a6-373a057fde71 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:29.690834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:29.691491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:29.691811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:29.692086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:29.694056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:29.802598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:29.804120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7efb5-a1ef-4447-a48d-791d1c8107bb service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:29.814961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:29.826047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 679/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:34.400214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:34.402126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:34.402126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:34.402581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 662/1341] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:34.408728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbc42-a381-471b-b81e-2759e3852591 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:34.409247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbc42-a381-471b-b81e-2759e3852591 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:34.409247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbc42-a381-471b-b81e-2759e3852591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:34.458867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a79bbc42-a381-471b-b81e-2759e3852591 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:34.460099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a79bbc42-a381-471b-b81e-2759e3852591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:34.546898 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 680/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:34.607600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:34.609876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:34.624705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53e9d-d555-4192-8358-0aba25235621 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:34.628356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:34.628802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:34.629064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:34.629340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:34.640325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:34.642029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97e3b2-abf9-4faf-a2c7-f7e370cd2002 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:34.653390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 663/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:42:37.757076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c490-7934-4aec-8c48-7d3c004c48a1 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:37.757641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c490-7934-4aec-8c48-7d3c004c48a1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:37.757641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c490-7934-4aec-8c48-7d3c004c48a1 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:37.759034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 681/1344] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:37.764926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b97e8-cc5b-47b6-b36c-55b0699d9352 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:37.765423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b97e8-cc5b-47b6-b36c-55b0699d9352 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:37.765609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b97e8-cc5b-47b6-b36c-55b0699d9352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:37.796763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-702b97e8-cc5b-47b6-b36c-55b0699d9352 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:37.797979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-702b97e8-cc5b-47b6-b36c-55b0699d9352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:37.806505 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 664/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:37.845882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c490-7934-4aec-8c48-7d3c004c48a1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:37.858962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c490-7934-4aec-8c48-7d3c004c48a1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:37.862727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:37.863461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:37.863805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:37.864075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:37.875694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:37.877170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072aa31-c176-497b-9da4-025d055d79ab service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:37.887383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 682/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:42.342395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57205d-560d-43db-8789-77f72a561e4f None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:42.342936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57205d-560d-43db-8789-77f72a561e4f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:42.342936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57205d-560d-43db-8789-77f72a561e4f None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:42.344390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 665/1347] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:42.350226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d36c-c514-4901-8ee2-663b2bb70db5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:42.350726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d36c-c514-4901-8ee2-663b2bb70db5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:42.350726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01d36c-c514-4901-8ee2-663b2bb70db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:42.370174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8f01d36c-c514-4901-8ee2-663b2bb70db5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:42.371391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f01d36c-c514-4901-8ee2-663b2bb70db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:42.380492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 683/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:42.421257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57205d-560d-43db-8789-77f72a561e4f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:42.432910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57205d-560d-43db-8789-77f72a561e4f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:42.436871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:42.437562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:42.437849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:42.438151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:42.447943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:42.449386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6eb33-328b-43dc-b878-3d774bb88a2c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:42.459399 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 666/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:48.138282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687540-fee4-497c-b12c-53e2b8ad76db None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:48.139102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687540-fee4-497c-b12c-53e2b8ad76db None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:48.139571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64687540-fee4-497c-b12c-53e2b8ad76db None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:48.141464 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 684/1350] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:48.147813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76c20-1b69-4688-87d9-c4a895e1eddc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:48.148893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76c20-1b69-4688-87d9-c4a895e1eddc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:48.149390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76c20-1b69-4688-87d9-c4a895e1eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:48.258268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f8e76c20-1b69-4688-87d9-c4a895e1eddc None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:48.260172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f8e76c20-1b69-4688-87d9-c4a895e1eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:48.318234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:48.367743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 667/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:52.363970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=56 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:53.154975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842b0b-bcd0-4c47-bccb-24e3a9cfb82d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:53.155641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842b0b-bcd0-4c47-bccb-24e3a9cfb82d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:53.155886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842b0b-bcd0-4c47-bccb-24e3a9cfb82d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:53.157494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 685/1352] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:53.166947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972efbb-8c12-4909-9f30-293e3b2fb5c9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:53.167458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972efbb-8c12-4909-9f30-293e3b2fb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:53.167743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972efbb-8c12-4909-9f30-293e3b2fb5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:53.186496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a972efbb-8c12-4909-9f30-293e3b2fb5c9 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:53.187915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a972efbb-8c12-4909-9f30-293e3b2fb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:53.196843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 668/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:55.028767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac85f-dcdb-4bd1-81f6-b596fd90ca4b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:55.029350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac85f-dcdb-4bd1-81f6-b596fd90ca4b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:55.029350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac85f-dcdb-4bd1-81f6-b596fd90ca4b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:55.030709 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 686/1354] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:55.036373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2137e-311f-4e54-a6a1-d99ab1d77c43 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:55.036914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2137e-311f-4e54-a6a1-d99ab1d77c43 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:55.037136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2137e-311f-4e54-a6a1-d99ab1d77c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:55.057773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-33f2137e-311f-4e54-a6a1-d99ab1d77c43 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:55.059288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-33f2137e-311f-4e54-a6a1-d99ab1d77c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:55.069213 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 669/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:42:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:58.756156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa348-40f0-4a3b-bd78-30baf9e93dd7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:58.756775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa348-40f0-4a3b-bd78-30baf9e93dd7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:58.757598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa348-40f0-4a3b-bd78-30baf9e93dd7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:58.759454 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 687/1356] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:58.765064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187ce3-8031-4ab1-8576-b261faac2706 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:58.766434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187ce3-8031-4ab1-8576-b261faac2706 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:58.766717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21187ce3-8031-4ab1-8576-b261faac2706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:58.791984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-21187ce3-8031-4ab1-8576-b261faac2706 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:58.793393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21187ce3-8031-4ab1-8576-b261faac2706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:58.801500 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 670/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:58.861117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239caf82-c76b-43e7-bb83-442dd71c75e0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:58.861574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239caf82-c76b-43e7-bb83-442dd71c75e0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:58.861954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239caf82-c76b-43e7-bb83-442dd71c75e0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:58.863620 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 688/1358] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jun 4 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:42:58.872690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ee6f-b9e6-4374-bd74-46b486b1bc6d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:58.873184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ee6f-b9e6-4374-bd74-46b486b1bc6d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:58.873779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ee6f-b9e6-4374-bd74-46b486b1bc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:58.930883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f1f6ee6f-b9e6-4374-bd74-46b486b1bc6d None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:58.932395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f1f6ee6f-b9e6-4374-bd74-46b486b1bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:59.028633 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 671/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:42:59.036946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239caf82-c76b-43e7-bb83-442dd71c75e0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:59.051498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239caf82-c76b-43e7-bb83-442dd71c75e0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:59.057736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:59.058497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:59.058881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:59.059253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:59.068787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:59.070489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ba2ae-3b0a-4246-8c75-975ad60cdff7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:59.080651 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 689/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:01.731803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c509-d4d8-436c-9d77-5cc7c2351e84 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:01.732747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c509-d4d8-436c-9d77-5cc7c2351e84 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:01.733036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8c509-d4d8-436c-9d77-5cc7c2351e84 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:01.734411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 672/1361] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:01.740068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492c7-79d6-4330-9d9c-6b6b383cb177 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:01.740520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492c7-79d6-4330-9d9c-6b6b383cb177 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:01.740625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791492c7-79d6-4330-9d9c-6b6b383cb177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:01.760891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-791492c7-79d6-4330-9d9c-6b6b383cb177 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:01.762843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-791492c7-79d6-4330-9d9c-6b6b383cb177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:01.772088 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 690/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:01.822156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c509-d4d8-436c-9d77-5cc7c2351e84 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:01.837136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8c509-d4d8-436c-9d77-5cc7c2351e84 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:01.843370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:01.844078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:01.844365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:01.844644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:01.854067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:01.855851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c652f-55f0-4505-90a0-a515955740ea service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:01.866924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 673/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:04.619103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987407-2118-418c-9b2d-7cf77ffe8bd0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:04.619858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987407-2118-418c-9b2d-7cf77ffe8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:04.619858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987407-2118-418c-9b2d-7cf77ffe8bd0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:04.621363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 691/1364] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:04.630697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a0e-0770-4fa6-a1b5-0ee915b8bc9c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:04.631705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a0e-0770-4fa6-a1b5-0ee915b8bc9c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:04.631705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9a0e-0770-4fa6-a1b5-0ee915b8bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:04.652714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-886d9a0e-0770-4fa6-a1b5-0ee915b8bc9c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:04.653932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-886d9a0e-0770-4fa6-a1b5-0ee915b8bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:04.662276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 674/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:04.710923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e48f-78dd-460a-bad4-e6f0bc9c3b92 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:04.711206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e48f-78dd-460a-bad4-e6f0bc9c3b92 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:04.711706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9e48f-78dd-460a-bad4-e6f0bc9c3b92 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:04.718446 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 692/1366] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jun 4 20:43:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:04.730349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b162a1-9c07-4f9f-838e-d398efb2bb97 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:04.730894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b162a1-9c07-4f9f-838e-d398efb2bb97 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:04.731329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b162a1-9c07-4f9f-838e-d398efb2bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:04.760991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b6b162a1-9c07-4f9f-838e-d398efb2bb97 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:04.762254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6b162a1-9c07-4f9f-838e-d398efb2bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:04.776761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 675/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:04.785164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e48f-78dd-460a-bad4-e6f0bc9c3b92 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:04.804876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9e48f-78dd-460a-bad4-e6f0bc9c3b92 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:04.810217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:04.810895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:04.811181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:04.811464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:04.821815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:04.823484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b31b8-e80f-464c-8ee0-8f6e4ab765bb service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:04.838402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 693/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:07.390001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401bab-767c-4cad-98e5-e3c8676be98e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:07.391012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401bab-767c-4cad-98e5-e3c8676be98e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:07.391298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60401bab-767c-4cad-98e5-e3c8676be98e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:07.394718 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 676/1369] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:07.408004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca7bd-4533-4394-9e15-b174fa147680 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:07.410052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca7bd-4533-4394-9e15-b174fa147680 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:07.410536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca7bd-4533-4394-9e15-b174fa147680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:07.434011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e6fca7bd-4533-4394-9e15-b174fa147680 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:07.435256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e6fca7bd-4533-4394-9e15-b174fa147680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:07.445618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 694/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:07.495649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60401bab-767c-4cad-98e5-e3c8676be98e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:07.515404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60401bab-767c-4cad-98e5-e3c8676be98e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:07.521498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:07.522377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:07.522818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:07.523415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:07.537961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:07.540060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2b17e-eeaf-4722-9d81-24489c974a06 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:07.553914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 677/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:43:10.214502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb1f3-093f-4856-a833-bf952684c893 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:10.253251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb1f3-093f-4856-a833-bf952684c893 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:10.253251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfb1f3-093f-4856-a833-bf952684c893 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:10.253251 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 695/1372] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:10.253583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834801-d584-40c1-b516-db7f04bde2e6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:10.253583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834801-d584-40c1-b516-db7f04bde2e6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:10.253583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834801-d584-40c1-b516-db7f04bde2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:10.253583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e5834801-d584-40c1-b516-db7f04bde2e6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:10.253583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5834801-d584-40c1-b516-db7f04bde2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:10.272880 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 678/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:43:10.318725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb1f3-093f-4856-a833-bf952684c893 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:10.335496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfb1f3-093f-4856-a833-bf952684c893 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:10.342195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:10.343360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:10.343939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:10.344457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:10.355950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:10.358721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d561fdc-bd47-4428-bf3a-8701b3bd51c2 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:10.375107 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 696/1374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:11.778460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a66-7b54-4c15-9387-c55a4e14af53 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:11.779042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a66-7b54-4c15-9387-c55a4e14af53 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:11.779042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a66-7b54-4c15-9387-c55a4e14af53 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:11.780484 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 679/1375] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:11.789859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f81cc-04aa-4f6d-bd53-aa219a5f7276 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:11.791487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f81cc-04aa-4f6d-bd53-aa219a5f7276 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:11.791957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f81cc-04aa-4f6d-bd53-aa219a5f7276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:11.819180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6a5f81cc-04aa-4f6d-bd53-aa219a5f7276 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:11.821074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a5f81cc-04aa-4f6d-bd53-aa219a5f7276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:11.841565 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 697/1376] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:12.151716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a492-b238-4c71-8f66-51ca4212b105 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:12.152403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a492-b238-4c71-8f66-51ca4212b105 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:12.152403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710a492-b238-4c71-8f66-51ca4212b105 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:12.153761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 680/1377] 10.222.0.18 () {54 vars in 963 bytes} [Sat Jun 4 20:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:12.159240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07cc67-71a7-4e3b-952c-70ead274a977 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:12.159557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07cc67-71a7-4e3b-952c-70ead274a977 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:12.159841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07cc67-71a7-4e3b-952c-70ead274a977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:12.213576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5e07cc67-71a7-4e3b-952c-70ead274a977 None None] MFA Rules not processed for user `57831f8b23c243ff9223b08588949da4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:12.214924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e07cc67-71a7-4e3b-952c-70ead274a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:12.279941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 698/1378] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Jun 4 20:43:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:12.288139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710a492-b238-4c71-8f66-51ca4212b105 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:12.300310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710a492-b238-4c71-8f66-51ca4212b105 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:12.304291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:12.305173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:12.305759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:12.306234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:12.317199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:12.318903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1e1bb-7b5c-4b3a-9cb8-7a26f1b564b5 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:12.330686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 681/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:13.125438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6c18-2c4f-4870-a3b1-fbcbad4e337d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:13.126186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6c18-2c4f-4870-a3b1-fbcbad4e337d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:13.126186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e6c18-2c4f-4870-a3b1-fbcbad4e337d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:13.133029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc1dc-fc1a-4fca-bc46-2a9194d3e58a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:13.136586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc1dc-fc1a-4fca-bc46-2a9194d3e58a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:13.137061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc1dc-fc1a-4fca-bc46-2a9194d3e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:13.138827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 699/1380] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:13.161476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ca9dc1dc-fc1a-4fca-bc46-2a9194d3e58a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:13.163649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca9dc1dc-fc1a-4fca-bc46-2a9194d3e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:13.180292 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 682/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:43:13.223877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6c18-2c4f-4870-a3b1-fbcbad4e337d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:13.239204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e6c18-2c4f-4870-a3b1-fbcbad4e337d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:13.245197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:13.246207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:13.246488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:13.246760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:13.256462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:13.258085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14472ddc-e834-4227-b613-7e7a526b55b2 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:13.270699 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 700/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:15.771738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b0e4c-e834-42a5-9db2-83582bcaa4ff None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:15.772406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b0e4c-e834-42a5-9db2-83582bcaa4ff None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:15.772406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b0e4c-e834-42a5-9db2-83582bcaa4ff None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:15.773666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 683/1383] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:15.780023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f82d-7313-4ebb-aa35-7852b8e6cb7c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:15.784154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f82d-7313-4ebb-aa35-7852b8e6cb7c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:15.784154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f82d-7313-4ebb-aa35-7852b8e6cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:15.799413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-73d3f82d-7313-4ebb-aa35-7852b8e6cb7c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:15.800652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-73d3f82d-7313-4ebb-aa35-7852b8e6cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:15.809500 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 701/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:15.853233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b0e4c-e834-42a5-9db2-83582bcaa4ff None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:15.863036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:15.868768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b0e4c-e834-42a5-9db2-83582bcaa4ff None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:15.874230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:15.874870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:15.875153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:15.875435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:15.884111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:15.885717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d0c7d-1396-4baf-abd9-d9c218885e0b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:15.895335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 684/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:18.313227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90c335-ef3b-412d-b757-c872d04d5b87 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:18.314256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90c335-ef3b-412d-b757-c872d04d5b87 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:18.314768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90c335-ef3b-412d-b757-c872d04d5b87 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:18.316163 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 702/1386] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:18.322390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cceb57-a42b-40be-a1bb-fdbb841a5dfa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:18.322963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cceb57-a42b-40be-a1bb-fdbb841a5dfa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:18.322963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cceb57-a42b-40be-a1bb-fdbb841a5dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:18.342419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-44cceb57-a42b-40be-a1bb-fdbb841a5dfa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:18.343650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-44cceb57-a42b-40be-a1bb-fdbb841a5dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:18.352207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 685/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:18.400291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90c335-ef3b-412d-b757-c872d04d5b87 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:18.417285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90c335-ef3b-412d-b757-c872d04d5b87 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:18.423821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:18.424477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:18.424940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:18.425230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:18.436087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:18.437705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ef260-76cf-43ae-8b1f-aedcc24dd07e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:18.450026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 703/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:20.935409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369a2a-d7a6-4e55-812b-1094fb1d94ed None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:20.936024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369a2a-d7a6-4e55-812b-1094fb1d94ed None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:20.936024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60369a2a-d7a6-4e55-812b-1094fb1d94ed None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:20.937419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 686/1389] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:20.944343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134dff-a884-4e96-91fd-b6389c0b99a2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:20.945302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134dff-a884-4e96-91fd-b6389c0b99a2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:20.945591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134dff-a884-4e96-91fd-b6389c0b99a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:20.965209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1c134dff-a884-4e96-91fd-b6389c0b99a2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:20.971580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c134dff-a884-4e96-91fd-b6389c0b99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:20.984999 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 704/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:21.034035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60369a2a-d7a6-4e55-812b-1094fb1d94ed None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:21.050500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60369a2a-d7a6-4e55-812b-1094fb1d94ed None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:21.056473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:21.057350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:21.057519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:21.057977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:21.066785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:21.068286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff5420-f923-4ef7-8e69-77ab19a3af42 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:21.078810 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 687/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:23.595927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53934b-a81a-4a49-b8cb-565828726a09 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:23.596532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53934b-a81a-4a49-b8cb-565828726a09 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:23.596735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53934b-a81a-4a49-b8cb-565828726a09 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:23.598757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 705/1392] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:23.606063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f835-e3a9-4aef-ab86-356db65b80c8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:23.607084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f835-e3a9-4aef-ab86-356db65b80c8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:23.607084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280f835-e3a9-4aef-ab86-356db65b80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:23.632468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1280f835-e3a9-4aef-ab86-356db65b80c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:23.634928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1280f835-e3a9-4aef-ab86-356db65b80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:23.655015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 688/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:23.710622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53934b-a81a-4a49-b8cb-565828726a09 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:23.720383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:23.730546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53934b-a81a-4a49-b8cb-565828726a09 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:23.736665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:23.737358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:23.737654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:23.737950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:23.747487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:23.749210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ea68a-815f-4ea3-9140-1cc63c257473 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:23.759966 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 706/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:26.376527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce1f8-1f21-473c-a3d2-f7fbcc09e2f2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:26.377397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce1f8-1f21-473c-a3d2-f7fbcc09e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:26.377397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ce1f8-1f21-473c-a3d2-f7fbcc09e2f2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:26.378875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 689/1395] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:26.385249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b62502-b057-4381-857f-7ab0c1ab4906 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:26.385249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b62502-b057-4381-857f-7ab0c1ab4906 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:26.385249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b62502-b057-4381-857f-7ab0c1ab4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:26.405975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-85b62502-b057-4381-857f-7ab0c1ab4906 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:26.415646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85b62502-b057-4381-857f-7ab0c1ab4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:26.424621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 707/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:26.472531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ce1f8-1f21-473c-a3d2-f7fbcc09e2f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:26.490561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ce1f8-1f21-473c-a3d2-f7fbcc09e2f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:26.497857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:26.498491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:26.498805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:26.499072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:26.509019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:26.510692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb67a5c-012d-43ab-acc7-52ac7ab4f840 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:26.522240 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 690/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:29.010564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954f4b-3ee2-444c-ac77-17fdabbb72fb None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.011174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954f4b-3ee2-444c-ac77-17fdabbb72fb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.011174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954f4b-3ee2-444c-ac77-17fdabbb72fb None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.012634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 708/1398] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:29.018536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e1dd-2786-43fe-beae-1ac3390826fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.019128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e1dd-2786-43fe-beae-1ac3390826fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.019128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e1dd-2786-43fe-beae-1ac3390826fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.041178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4377e1dd-2786-43fe-beae-1ac3390826fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:29.042577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4377e1dd-2786-43fe-beae-1ac3390826fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:29.052800 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 691/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:29.100903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954f4b-3ee2-444c-ac77-17fdabbb72fb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:29.116614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954f4b-3ee2-444c-ac77-17fdabbb72fb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:29.123407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:29.124110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.124395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.124662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.129382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060059-6e6e-4624-a10b-68680e9508a2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.129663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060059-6e6e-4624-a10b-68680e9508a2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.129954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060059-6e6e-4624-a10b-68680e9508a2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.131652 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 692/1400] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:29.138716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd3d9-4d95-49ec-9be6-c7954808d005 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.139050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd3d9-4d95-49ec-9be6-c7954808d005 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.139282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deacd3d9-4d95-49ec-9be6-c7954808d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.140708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:29.142402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67722b-00cb-4e7c-853a-07c06103fc6e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:29.155976 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 709/1401] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:29.161241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-deacd3d9-4d95-49ec-9be6-c7954808d005 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:29.162477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-deacd3d9-4d95-49ec-9be6-c7954808d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:29.173362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 693/1402] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:29.234009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce190-3f1a-4da9-9b8d-6c83aa2e0a76 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.234299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce190-3f1a-4da9-9b8d-6c83aa2e0a76 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.234575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce190-3f1a-4da9-9b8d-6c83aa2e0a76 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.236092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 710/1403] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jun 4 20:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:29.243014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4b9b7-6a9b-45d6-a26d-3b800867cd1d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.243302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4b9b7-6a9b-45d6-a26d-3b800867cd1d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.243647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4b9b7-6a9b-45d6-a26d-3b800867cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.305992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b4d4b9b7-6a9b-45d6-a26d-3b800867cd1d None None] MFA Rules not processed for user `828a7d4e334d459cb88fc2ba20894623`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:29.307385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b4d4b9b7-6a9b-45d6-a26d-3b800867cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:29.382019 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 694/1404] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jun 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:29.390682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce190-3f1a-4da9-9b8d-6c83aa2e0a76 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:29.403472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce190-3f1a-4da9-9b8d-6c83aa2e0a76 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:29.407434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:29.408151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.408613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.408900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:29.420759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:29.422302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2fe4e-40a3-4582-9555-7be50518fd8c service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:29.437155 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 711/1405] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:29.988536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce210-c94e-433a-9b51-9be772e1ed98 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:29.988793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce210-c94e-433a-9b51-9be772e1ed98 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:29.989081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce210-c94e-433a-9b51-9be772e1ed98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:30.043017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3b4ce210-c94e-433a-9b51-9be772e1ed98 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:30.044269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3b4ce210-c94e-433a-9b51-9be772e1ed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:30.093945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:30.114785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 695/1406] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:43:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:30.162432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a5ec-feaf-43e3-a27c-937854c3304b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:30.162950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a5ec-feaf-43e3-a27c-937854c3304b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:30.162950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a5ec-feaf-43e3-a27c-937854c3304b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:30.164428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 712/1407] 10.222.0.18 () {54 vars in 942 bytes} [Sat Jun 4 20:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:30.171335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e0e7-d2c8-4fa2-89b9-dc26fa923801 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:30.171676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e0e7-d2c8-4fa2-89b9-dc26fa923801 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:30.171968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60e0e7-d2c8-4fa2-89b9-dc26fa923801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:30.223265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ec60e0e7-d2c8-4fa2-89b9-dc26fa923801 None None] MFA Rules not processed for user `d40d4b6dcab740c39553774b3daed388`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:30.224561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ec60e0e7-d2c8-4fa2-89b9-dc26fa923801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:30.298745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 696/1408] 10.222.0.18 () {58 vars in 1039 bytes} [Sat Jun 4 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:30.376287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787a5ec-feaf-43e3-a27c-937854c3304b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:30.401544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787a5ec-feaf-43e3-a27c-937854c3304b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:30.407083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:30.407800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:30.408087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:30.408363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:30.417795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:30.419385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba8d2-36a0-41da-9969-5d0200ea799b service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:30.427839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 713/1409] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:43:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 20:43:40.295656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=50 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:40.424477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=26 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:54.035530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8ebf-a5aa-4c3f-8b49-f79559e91d5b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:54.036209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8ebf-a5aa-4c3f-8b49-f79559e91d5b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:54.036209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d8ebf-a5aa-4c3f-8b49-f79559e91d5b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:54.037769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 697/1410] 10.222.0.18 () {54 vars in 918 bytes} [Sat Jun 4 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:54.044185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba451-6670-476a-81b6-433d8149efed None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:54.044962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba451-6670-476a-81b6-433d8149efed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:54.044962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ba451-6670-476a-81b6-433d8149efed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:54.066671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-343ba451-6670-476a-81b6-433d8149efed None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:54.068163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-343ba451-6670-476a-81b6-433d8149efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:54.078808 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 714/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jun 4 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:43:54.094551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333744-edf7-4397-ac96-bb394cca334d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:54.094829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333744-edf7-4397-ac96-bb394cca334d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:54.095112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d333744-edf7-4397-ac96-bb394cca334d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:54.096553 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 698/1412] 10.222.0.18 () {54 vars in 918 bytes} [Sat Jun 4 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:54.102054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721aa2e-14d5-45cc-af08-a63d5891b4ba None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:54.102368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721aa2e-14d5-45cc-af08-a63d5891b4ba None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:54.102649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721aa2e-14d5-45cc-af08-a63d5891b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:54.122288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4721aa2e-14d5-45cc-af08-a63d5891b4ba None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:54.123498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4721aa2e-14d5-45cc-af08-a63d5891b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:54.133333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 715/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jun 4 20:43:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:56.995563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cfc30-0299-4b06-adb9-13a1a38e0896 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:56.996260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cfc30-0299-4b06-adb9-13a1a38e0896 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:56.996260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cfc30-0299-4b06-adb9-13a1a38e0896 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:56.997473 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:57.003077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab44-2436-44a9-8784-6a1504ab56b4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:57.003539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab44-2436-44a9-8784-6a1504ab56b4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:57.003663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eab44-2436-44a9-8784-6a1504ab56b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:57.023354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ae0eab44-2436-44a9-8784-6a1504ab56b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:57.024617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae0eab44-2436-44a9-8784-6a1504ab56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:57.033605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:57.082856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cfc30-0299-4b06-adb9-13a1a38e0896 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:57.103413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cfc30-0299-4b06-adb9-13a1a38e0896 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:57.109956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:57.110595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:57.110905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:57.111181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:57.120559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:57.122168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279a506-72d9-4aa7-90b6-cafbe4e7542e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:57.133532 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 700/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:58.162556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a411-9fc8-4cf3-8071-5df36bba10b0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:58.163148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a411-9fc8-4cf3-8071-5df36bba10b0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:58.163148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a411-9fc8-4cf3-8071-5df36bba10b0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:58.164569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:58.170144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382447-8c5c-45f4-81a6-776c5d169ae9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:58.170646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382447-8c5c-45f4-81a6-776c5d169ae9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:58.170776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382447-8c5c-45f4-81a6-776c5d169ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:58.190380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c3382447-8c5c-45f4-81a6-776c5d169ae9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:58.191628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3382447-8c5c-45f4-81a6-776c5d169ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:58.200687 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:58.388421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a411-9fc8-4cf3-8071-5df36bba10b0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:58.405618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a411-9fc8-4cf3-8071-5df36bba10b0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:58.411447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:58.412148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:58.412434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:58.412690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:58.422036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:58.423692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a40e8e-7f93-4c87-909e-91dc6e0443ec service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:58.434200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 718/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:59.386138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbca8-7d73-492e-8150-e8a2d58dd586 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:59.386677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbca8-7d73-492e-8150-e8a2d58dd586 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:59.386789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbca8-7d73-492e-8150-e8a2d58dd586 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:59.388944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:59.395363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19994e-1fed-4503-8738-e6a5ef8e7a56 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:59.395866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19994e-1fed-4503-8738-e6a5ef8e7a56 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:59.395960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19994e-1fed-4503-8738-e6a5ef8e7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:59.415828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0c19994e-1fed-4503-8738-e6a5ef8e7a56 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:59.417037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c19994e-1fed-4503-8738-e6a5ef8e7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:59.425176 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:59.579872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbca8-7d73-492e-8150-e8a2d58dd586 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:59.595576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbca8-7d73-492e-8150-e8a2d58dd586 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:59.601557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:59.602066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:59.602399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:59.602642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:59.610974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:59.612619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3605ad0-2947-476f-bc3e-1d767224594d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:59.622490 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 703/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:00.567775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6ac-867a-4a5e-bd0e-3a897ab2adbb None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:00.568364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6ac-867a-4a5e-bd0e-3a897ab2adbb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:00.568364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6ac-867a-4a5e-bd0e-3a897ab2adbb None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:00.569939 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:00.575296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11dcc-5b2a-481c-94bd-7be6372f1e83 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:00.575755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11dcc-5b2a-481c-94bd-7be6372f1e83 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:00.575880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11dcc-5b2a-481c-94bd-7be6372f1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:00.594639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3fb11dcc-5b2a-481c-94bd-7be6372f1e83 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:00.595900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3fb11dcc-5b2a-481c-94bd-7be6372f1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:00.604351 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:00.758417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403e6ac-867a-4a5e-bd0e-3a897ab2adbb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:00.775301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403e6ac-867a-4a5e-bd0e-3a897ab2adbb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:00.781786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:00.782451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:00.782739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:00.783015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:00.792655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:00.794302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56edfeb-d2dd-45e0-b3bd-616823359bd1 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:00.804721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 721/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:01.737629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478bddf-4d0d-4d77-813a-8eccb12c6542 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:01.738235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478bddf-4d0d-4d77-813a-8eccb12c6542 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:01.738235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478bddf-4d0d-4d77-813a-8eccb12c6542 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:01.739597 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:01.745120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2429-51b1-4e6e-ab64-e908b385ca1a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:01.745574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2429-51b1-4e6e-ab64-e908b385ca1a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:01.745669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2429-51b1-4e6e-ab64-e908b385ca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:01.764641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89ab2429-51b1-4e6e-ab64-e908b385ca1a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:01.765869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89ab2429-51b1-4e6e-ab64-e908b385ca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:01.774775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:01.939008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478bddf-4d0d-4d77-813a-8eccb12c6542 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:01.956194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478bddf-4d0d-4d77-813a-8eccb12c6542 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:01.964661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:01.965346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:01.965616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:01.965893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:01.975537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:01.977576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d489750-7bf5-4ffe-ac32-eee4b7f618c8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:01.988107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 706/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:02.853390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400b06-38e5-4d57-951e-a3cc2718c856 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:02.853999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400b06-38e5-4d57-951e-a3cc2718c856 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:02.853999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37400b06-38e5-4d57-951e-a3cc2718c856 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:02.855282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:02.860763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dcf8-5fc0-48e4-9783-3304b02e1c41 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:02.861205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dcf8-5fc0-48e4-9783-3304b02e1c41 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:02.861303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dcf8-5fc0-48e4-9783-3304b02e1c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:02.880229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-eed7dcf8-5fc0-48e4-9783-3304b02e1c41 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:02.881426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eed7dcf8-5fc0-48e4-9783-3304b02e1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:02.889719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:03.050053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37400b06-38e5-4d57-951e-a3cc2718c856 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:03.066176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37400b06-38e5-4d57-951e-a3cc2718c856 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:03.072216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:03.072859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:03.073141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:03.073411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:03.081779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:03.083356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca318cd7-d520-4ce4-8421-4adcf0fdac76 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:03.093002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 724/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:03.985250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843afb8-5891-420b-8d19-5ed09051d9ce None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:03.986103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843afb8-5891-420b-8d19-5ed09051d9ce None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:03.986103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843afb8-5891-420b-8d19-5ed09051d9ce None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:03.988115 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:44:03.993485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21978f9-8113-4c32-99dc-6291d4e7bb1e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:03.993949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21978f9-8113-4c32-99dc-6291d4e7bb1e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:03.994045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21978f9-8113-4c32-99dc-6291d4e7bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:04.013135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b21978f9-8113-4c32-99dc-6291d4e7bb1e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:04.014341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b21978f9-8113-4c32-99dc-6291d4e7bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:04.022807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:04.180926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843afb8-5891-420b-8d19-5ed09051d9ce None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:04.196838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843afb8-5891-420b-8d19-5ed09051d9ce None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:04.203255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:04.203943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:04.204209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:04.204486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:04.213734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:04.215259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd1b2c-a2ed-4faa-bcf0-9ea316ddd02e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:04.224967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 709/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:05.084680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3ec1-3fc2-4072-8e86-48013a2b81a8 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:05.085383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3ec1-3fc2-4072-8e86-48013a2b81a8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:05.085383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3ec1-3fc2-4072-8e86-48013a2b81a8 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:05.087045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:05.092210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8f07-7fcc-4fc0-9856-0a94d22936b2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:05.092661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8f07-7fcc-4fc0-9856-0a94d22936b2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:05.092824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8f07-7fcc-4fc0-9856-0a94d22936b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:05.111594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4acb8f07-7fcc-4fc0-9856-0a94d22936b2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:05.112808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4acb8f07-7fcc-4fc0-9856-0a94d22936b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:05.122296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:05.281528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3ec1-3fc2-4072-8e86-48013a2b81a8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:05.299343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3ec1-3fc2-4072-8e86-48013a2b81a8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:05.306408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:05.306937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:05.307224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:05.307502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:05.316654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:05.318235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11cf8e-6a1f-4edd-b0a5-f22a9992638a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:05.328644 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 727/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:06.215931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b3e-93db-4427-a164-063244328a28 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:06.216495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b3e-93db-4427-a164-063244328a28 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:06.216495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b3e-93db-4427-a164-063244328a28 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:06.217872 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:06.223857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34a78-3953-4edf-b87b-36a2abc2977f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:06.224347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34a78-3953-4edf-b87b-36a2abc2977f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:06.224453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34a78-3953-4edf-b87b-36a2abc2977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:06.249925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-72b34a78-3953-4edf-b87b-36a2abc2977f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:06.251190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72b34a78-3953-4edf-b87b-36a2abc2977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:06.260751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:06.426485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85b3e-93db-4427-a164-063244328a28 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:06.443922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85b3e-93db-4427-a164-063244328a28 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:06.453153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:06.454138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:06.454479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:06.454751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:06.466105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:06.467749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91549a6a-c3f6-40cf-bdbb-ccff5aebd0c5 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:06.480597 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 712/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:08.667899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63cfc8-7b87-49b1-962a-786265548c9f None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:08.668458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63cfc8-7b87-49b1-962a-786265548c9f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:08.668458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63cfc8-7b87-49b1-962a-786265548c9f None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:08.669740 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:08.676404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c5d-6475-466b-8dcf-3c040ae4289e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:08.677150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c5d-6475-466b-8dcf-3c040ae4289e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:08.677304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01c5d-6475-466b-8dcf-3c040ae4289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:08.697614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-38d01c5d-6475-466b-8dcf-3c040ae4289e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:08.698823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-38d01c5d-6475-466b-8dcf-3c040ae4289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:08.708046 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:08.750063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63cfc8-7b87-49b1-962a-786265548c9f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:08.762320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63cfc8-7b87-49b1-962a-786265548c9f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:08.766240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:08.766906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:08.767188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:08.767463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:08.778400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:08.779911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89245760-3d58-488e-8b3f-fd4cd1bf9cc1 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:08.791545 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 730/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:11.270063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc839c2-e9f2-48c6-9100-0b7625f02813 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:11.270617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc839c2-e9f2-48c6-9100-0b7625f02813 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:11.270709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc839c2-e9f2-48c6-9100-0b7625f02813 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:11.272098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:11.279518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3bae-7865-4ba9-a545-f400895179eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:11.279975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3bae-7865-4ba9-a545-f400895179eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:11.280084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c3bae-7865-4ba9-a545-f400895179eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:11.299555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4e8c3bae-7865-4ba9-a545-f400895179eb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:11.301076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4e8c3bae-7865-4ba9-a545-f400895179eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:11.309718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:11.357277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc839c2-e9f2-48c6-9100-0b7625f02813 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:11.372080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc839c2-e9f2-48c6-9100-0b7625f02813 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:11.376771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:11.377334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:11.377613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:11.377887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:11.388256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:11.389722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7868f-6519-430d-b36e-cd2daa779e7c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:11.400386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 715/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:14.144697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad316-04ea-4ca7-aed2-4aa2946950e8 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:14.145421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad316-04ea-4ca7-aed2-4aa2946950e8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:14.145421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad316-04ea-4ca7-aed2-4aa2946950e8 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:14.146634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:44:14.154138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd763-4b65-4007-99d0-3c4b407f1866 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:14.154708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd763-4b65-4007-99d0-3c4b407f1866 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:14.155002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdd763-4b65-4007-99d0-3c4b407f1866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:14.174786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e2fdd763-4b65-4007-99d0-3c4b407f1866 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:14.176193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2fdd763-4b65-4007-99d0-3c4b407f1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:14.184862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:14.225703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad316-04ea-4ca7-aed2-4aa2946950e8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:14.237352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad316-04ea-4ca7-aed2-4aa2946950e8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:14.241246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:14.242513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:14.242798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:14.243078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:14.252942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:14.254409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393c16-97da-4a99-97f8-a7f877deac14 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:14.265715 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 733/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:16.760635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383741f8-6361-42ee-85ba-b0f30e68770b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:16.761258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383741f8-6361-42ee-85ba-b0f30e68770b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:16.761258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383741f8-6361-42ee-85ba-b0f30e68770b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:16.762576 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:16.768868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009f48-7e6d-4a6f-b911-a4a98801e2b5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:16.769393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009f48-7e6d-4a6f-b911-a4a98801e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:16.769393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009f48-7e6d-4a6f-b911-a4a98801e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:16.789372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89009f48-7e6d-4a6f-b911-a4a98801e2b5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:16.790597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89009f48-7e6d-4a6f-b911-a4a98801e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:16.800494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:44:16.841283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383741f8-6361-42ee-85ba-b0f30e68770b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:16.853576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383741f8-6361-42ee-85ba-b0f30e68770b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:16.857551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:16.858345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:16.858630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:16.858909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:16.868965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:16.870415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4bfbe-c712-46f7-9e33-73bc9412db05 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:16.880354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 718/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:19.351996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35550ad-f9db-4f2d-987c-7d1de5adb722 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:19.352613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35550ad-f9db-4f2d-987c-7d1de5adb722 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:19.352613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35550ad-f9db-4f2d-987c-7d1de5adb722 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:19.354160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:19.359883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613e3c-d769-419f-a773-750699bb7836 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:19.360417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613e3c-d769-419f-a773-750699bb7836 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:19.360521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92613e3c-d769-419f-a773-750699bb7836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:19.380357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-92613e3c-d769-419f-a773-750699bb7836 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:19.381982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92613e3c-d769-419f-a773-750699bb7836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:19.390956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:19.438379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35550ad-f9db-4f2d-987c-7d1de5adb722 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:19.451817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35550ad-f9db-4f2d-987c-7d1de5adb722 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:19.456203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:19.456855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:19.457138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:19.457411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:19.468269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:19.469722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af26b05-0b5e-4551-af95-d88b0633710d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:19.480413 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 736/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:21.909784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5687-e2d4-4065-8985-c50ad81061c7 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:21.910387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5687-e2d4-4065-8985-c50ad81061c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:21.910387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5687-e2d4-4065-8985-c50ad81061c7 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:21.911813 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:21.917586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514292-9c58-4a46-a3d0-a46aa03dafd8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:21.918179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514292-9c58-4a46-a3d0-a46aa03dafd8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:21.918179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514292-9c58-4a46-a3d0-a46aa03dafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:21.924217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=70 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:21.936700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-38514292-9c58-4a46-a3d0-a46aa03dafd8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:21.937900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38514292-9c58-4a46-a3d0-a46aa03dafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:21.946835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:21.987352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5687-e2d4-4065-8985-c50ad81061c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:21.993515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=64 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:22.000766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5687-e2d4-4065-8985-c50ad81061c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:22.004584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:22.005239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:22.005522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:22.005804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:22.016133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:22.017587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151ceca-8eff-479e-b87c-fa587a3e66a1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:22.028750 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 721/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:24.468076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6dd3-06a6-4c41-abe0-3e27efbd3f8c None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:24.468678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6dd3-06a6-4c41-abe0-3e27efbd3f8c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:24.468678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c6dd3-06a6-4c41-abe0-3e27efbd3f8c None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:24.470035 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:24.476264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5674-50a3-4a0d-b1d4-ed1d3d386060 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:24.476812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5674-50a3-4a0d-b1d4-ed1d3d386060 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:24.476812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5674-50a3-4a0d-b1d4-ed1d3d386060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:24.498688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-17be5674-50a3-4a0d-b1d4-ed1d3d386060 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:24.499941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-17be5674-50a3-4a0d-b1d4-ed1d3d386060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:24.509372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:24.548828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6dd3-06a6-4c41-abe0-3e27efbd3f8c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:24.560312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c6dd3-06a6-4c41-abe0-3e27efbd3f8c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:24.563877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:24.564527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:24.564807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:24.565084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:24.574851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:24.576341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99775817-9dee-4877-b2e9-85ba75f25bcc service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:24.586352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 739/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:26.996153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22cf4-93ee-4add-9d87-be832372a0f4 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:26.996776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22cf4-93ee-4add-9d87-be832372a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:26.996776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e22cf4-93ee-4add-9d87-be832372a0f4 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:26.998097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:27.003999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f10b-cbbe-4a70-9d2c-4ac3d5296b68 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:27.004422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f10b-cbbe-4a70-9d2c-4ac3d5296b68 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:27.004557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2f10b-cbbe-4a70-9d2c-4ac3d5296b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:27.023349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-56a2f10b-cbbe-4a70-9d2c-4ac3d5296b68 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:27.024588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-56a2f10b-cbbe-4a70-9d2c-4ac3d5296b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:27.033621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:27.073153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e22cf4-93ee-4add-9d87-be832372a0f4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:27.092131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e22cf4-93ee-4add-9d87-be832372a0f4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:27.095997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:27.096634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:27.096919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:27.097188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:27.107938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:27.109373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f24e6-69e9-4b54-8336-b5ce486edf1d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:27.119638 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 724/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:29.523060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95923-4ad0-4d53-b72e-2ca8a78eec39 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:29.523651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95923-4ad0-4d53-b72e-2ca8a78eec39 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:29.523651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa95923-4ad0-4d53-b72e-2ca8a78eec39 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:29.525049 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:29.531402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d0a1-0c6c-452a-ba4a-d0bc08fccef7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:29.531949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d0a1-0c6c-452a-ba4a-d0bc08fccef7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:29.531949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d0a1-0c6c-452a-ba4a-d0bc08fccef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:29.551204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7540d0a1-0c6c-452a-ba4a-d0bc08fccef7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:29.552475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7540d0a1-0c6c-452a-ba4a-d0bc08fccef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:29.561442 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:29.602163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa95923-4ad0-4d53-b72e-2ca8a78eec39 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:29.614397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa95923-4ad0-4d53-b72e-2ca8a78eec39 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:29.618544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:29.619184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:29.619464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:29.619797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:29.629111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:29.630533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189c975-ded4-4357-baf9-6383d266f979 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:29.640356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 742/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:32.004893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274641f-1e25-4f34-81c9-e05119802a33 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:32.005494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274641f-1e25-4f34-81c9-e05119802a33 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:32.005494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274641f-1e25-4f34-81c9-e05119802a33 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:32.007072 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:32.013029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e99e2-5930-4f95-a6f9-8bff50be195d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:32.013540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e99e2-5930-4f95-a6f9-8bff50be195d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:32.013540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e99e2-5930-4f95-a6f9-8bff50be195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:32.040133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-936e99e2-5930-4f95-a6f9-8bff50be195d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:32.041413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-936e99e2-5930-4f95-a6f9-8bff50be195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:32.050806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:32.091238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274641f-1e25-4f34-81c9-e05119802a33 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:32.105010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274641f-1e25-4f34-81c9-e05119802a33 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:32.110836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:32.111757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:32.112225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:32.112593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:32.126727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:32.128550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c18ba9-c38d-40cc-9e7c-a5e37ce97ede service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:32.140086 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 727/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:42.034286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=20 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:42.135360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=23 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:05.605543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06678a-7935-4038-ab02-4107c615f5d0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:05.606423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06678a-7935-4038-ab02-4107c615f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:05.606423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06678a-7935-4038-ab02-4107c615f5d0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:05.608633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 744/1471] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:05.615663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3893-4d54-4436-a715-b379513b8831 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:05.616185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3893-4d54-4436-a715-b379513b8831 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:05.616185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3893-4d54-4436-a715-b379513b8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:05.636389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c08c3893-4d54-4436-a715-b379513b8831 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:05.637605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c08c3893-4d54-4436-a715-b379513b8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:05.646017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 728/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:05.707015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122452-bdd0-41e5-bdbf-93b6e0e95a69 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:05.707319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122452-bdd0-41e5-bdbf-93b6e0e95a69 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:05.707654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122452-bdd0-41e5-bdbf-93b6e0e95a69 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:05.709039 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 745/1473] 10.222.0.18 () {54 vars in 962 bytes} [Sat Jun 4 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:05.714243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474390ad-bf83-4c99-bade-b99a64d06848 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:05.714496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474390ad-bf83-4c99-bade-b99a64d06848 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:05.714794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474390ad-bf83-4c99-bade-b99a64d06848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:05.734665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-474390ad-bf83-4c99-bade-b99a64d06848 None None] MFA Rules not processed for user `828a7d4e334d459cb88fc2ba20894623`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:05.735925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-474390ad-bf83-4c99-bade-b99a64d06848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:05.743871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 729/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jun 4 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:05.751473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122452-bdd0-41e5-bdbf-93b6e0e95a69 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:05.765803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122452-bdd0-41e5-bdbf-93b6e0e95a69 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:05.772759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:05.774010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:05.774483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:05.774939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:05.790534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:05.792027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c436-09e1-4d37-adb1-47b00c496176 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:05.802466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 746/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:08.294841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cbf-f1b0-43fb-802e-7d9d390f7d5c None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:08.295451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cbf-f1b0-43fb-802e-7d9d390f7d5c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:08.295451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83cbf-f1b0-43fb-802e-7d9d390f7d5c None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:08.296801 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 730/1476] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:08.303950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d4b3-d194-4879-98ec-29a988151989 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:08.304427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d4b3-d194-4879-98ec-29a988151989 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:08.304525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90d4b3-d194-4879-98ec-29a988151989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:08.323921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3f90d4b3-d194-4879-98ec-29a988151989 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:08.325130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f90d4b3-d194-4879-98ec-29a988151989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:08.335158 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 747/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:08.360191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83cbf-f1b0-43fb-802e-7d9d390f7d5c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:08.376173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83cbf-f1b0-43fb-802e-7d9d390f7d5c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:08.382284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:08.382952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:08.383229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:08.383500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:08.384262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:08.386001 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:45:08.386001 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:45:08.386001 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:45:08.387130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1c72-f15f-4bbb-ba8e-5fd8cbc2fdaf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:08.407637 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 731/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Jun 4 20:45:08 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:45:10.809425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07844bc-8e49-42b3-bc17-4368ccd948f5 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:10.810321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07844bc-8e49-42b3-bc17-4368ccd948f5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:10.810321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07844bc-8e49-42b3-bc17-4368ccd948f5 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:10.812420 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 748/1479] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:10.821311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547d7c5-534c-44d9-9b39-6efac4faea27 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:10.821767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547d7c5-534c-44d9-9b39-6efac4faea27 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:10.821911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547d7c5-534c-44d9-9b39-6efac4faea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:10.848293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8547d7c5-534c-44d9-9b39-6efac4faea27 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:10.849869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8547d7c5-534c-44d9-9b39-6efac4faea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:10.861734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 732/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:10.909571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07844bc-8e49-42b3-bc17-4368ccd948f5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:10.925122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07844bc-8e49-42b3-bc17-4368ccd948f5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:10.931749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:10.932393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:10.932679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:10.932952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:10.942171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:10.944286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4d531-0d6c-4e0e-8a74-6060bfcd05cf service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:10.954488 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 749/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:13.613735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699021-1a76-4ba4-b9f3-fed19d487b6b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:13.614587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699021-1a76-4ba4-b9f3-fed19d487b6b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:13.614912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d699021-1a76-4ba4-b9f3-fed19d487b6b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:13.616540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 733/1482] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:13.622244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cadc0-bd3e-4160-bb01-9ecb3fdb7d6f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:13.622763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cadc0-bd3e-4160-bb01-9ecb3fdb7d6f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:13.622763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cadc0-bd3e-4160-bb01-9ecb3fdb7d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:13.644372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-268cadc0-bd3e-4160-bb01-9ecb3fdb7d6f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:13.645581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-268cadc0-bd3e-4160-bb01-9ecb3fdb7d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:13.657647 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 750/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:13.697483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699021-1a76-4ba4-b9f3-fed19d487b6b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:13.712763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d699021-1a76-4ba4-b9f3-fed19d487b6b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:13.717689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:13.718347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:13.718632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:13.718909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:13.729727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:13.731177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde26ccb-9c51-4bdb-9801-9f2200133758 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:13.741380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 734/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:16.184531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84e02-6cb5-4b5f-bce3-6748342bfe95 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:16.185822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84e02-6cb5-4b5f-bce3-6748342bfe95 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:16.185822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f84e02-6cb5-4b5f-bce3-6748342bfe95 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:16.186475 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 751/1485] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:16.192643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ef63-427c-4d39-b42d-4d8a520ec2da None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:16.193083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ef63-427c-4d39-b42d-4d8a520ec2da None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:16.193480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ef63-427c-4d39-b42d-4d8a520ec2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:16.212817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d2e5ef63-427c-4d39-b42d-4d8a520ec2da None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:16.214048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d2e5ef63-427c-4d39-b42d-4d8a520ec2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:16.222693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 735/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:16.266948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f84e02-6cb5-4b5f-bce3-6748342bfe95 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:16.287982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f84e02-6cb5-4b5f-bce3-6748342bfe95 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:16.292284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:16.292932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:16.293215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:16.293483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:16.303409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:16.304886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684557-5ddb-4f06-b62f-256ba76c1d72 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:16.314448 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 752/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:18.843842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca69b-22ae-42a5-be35-ee032c17b821 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:18.844453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca69b-22ae-42a5-be35-ee032c17b821 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:18.844453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca69b-22ae-42a5-be35-ee032c17b821 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:18.845923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 736/1488] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:18.852013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062553-ce07-4f86-ac54-2769ba9ae553 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:18.852507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062553-ce07-4f86-ac54-2769ba9ae553 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:18.852621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062553-ce07-4f86-ac54-2769ba9ae553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:18.875924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5a062553-ce07-4f86-ac54-2769ba9ae553 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:18.877204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5a062553-ce07-4f86-ac54-2769ba9ae553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:18.886063 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 753/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:45:18.930081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca69b-22ae-42a5-be35-ee032c17b821 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:18.949494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca69b-22ae-42a5-be35-ee032c17b821 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:18.956123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:18.957113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:18.957473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:18.957852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:18.968180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:18.969821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a22193-47d7-4bc2-aa8d-aef641b482b0 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:18.980231 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 737/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:21.560656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306777-00c3-474f-9cc4-022486a9a340 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:21.561551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306777-00c3-474f-9cc4-022486a9a340 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:21.561551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306777-00c3-474f-9cc4-022486a9a340 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:21.563771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 754/1491] 10.222.0.18 () {54 vars in 926 bytes} [Sat Jun 4 20:45:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:21.572857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25ddc-9e14-46f0-8ede-a44980b5568d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:21.573340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25ddc-9e14-46f0-8ede-a44980b5568d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:21.573443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be25ddc-9e14-46f0-8ede-a44980b5568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:21.600433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3be25ddc-9e14-46f0-8ede-a44980b5568d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:21.601552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3be25ddc-9e14-46f0-8ede-a44980b5568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:21.611014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 738/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Sat Jun 4 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:21.654851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306777-00c3-474f-9cc4-022486a9a340 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:21.669337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306777-00c3-474f-9cc4-022486a9a340 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:21.673485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:21.674163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:21.674449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:21.674711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:21.686523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:21.688736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70ff48-2f73-4d02-a2e7-ba3b93e2f198 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:21.701683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 755/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:45:31.592453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=33 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:31.696877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=33 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:49.509344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1174470-c980-482a-b632-6857a3791935 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.509968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1174470-c980-482a-b632-6857a3791935 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.509968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1174470-c980-482a-b632-6857a3791935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.529471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a1174470-c980-482a-b632-6857a3791935 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:49.530660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1174470-c980-482a-b632-6857a3791935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:49.539112 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 739/1494] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:46:49.550022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.550579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.550579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.574478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:49.575653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:49.588454 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 756/1495] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:49.595626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1174470-c980-482a-b632-6857a3791935 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.606403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1174470-c980-482a-b632-6857a3791935 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.611784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.612455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.612735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.613028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.613789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:46:49.614229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.615333 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.615333 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:46:49.615333 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:46:49.616292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.628292 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 740/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:46:49.637017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.646592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a36a9-29d8-4364-bcfa-b27af598f731 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.652347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.652996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.653278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.653553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.654252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.656056 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.656056 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:46:49.656056 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:46:49.657269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.699787 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 757/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:46:49 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:46:49.704165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.714996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f367d8-21f1-47c9-9468-4de49b754eda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.779211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.780143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.780423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.780765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.781835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.783436 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.783436 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:46:49.783436 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:46:49.784907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.807615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 741/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:46:49 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:46:49.811939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.822783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2574501-0143-41ad-b94e-9cf898d7c1a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.828059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.828706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.828985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.829274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.829971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.831091 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.831091 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:46:49.831091 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:46:49.832014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.845181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 758/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:46:49.849918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.860448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c01d8-d4a4-41bb-b3d1-42079a03ec18 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.866224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.866889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.867169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.867445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.868214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.869240 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.869240 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:46:49.869240 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:46:49.870119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459b269-e26b-4b92-a10e-cfaea339177e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.884637 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 742/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:46:49.889702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:49.906406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d526b52-99ea-4d7f-ad50-986f51afce6f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:49.921299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:49.922202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.922510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.922790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] PATH_INFO: `/v3/projects/9381e39f1f0b42eaacecedff2f7bde3f/users/0b7f99948569433e822cfbb3e342a0a8/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:49.946442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9381e39f1f0b42eaacecedff2f7bde3f, user_id=0b7f99948569433e822cfbb3e342a0a8, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:49.948369 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:49.948369 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:46:49.948369 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:46:49.953383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c32866-c3b2-4004-b275-52075a6e7a81 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:49.970257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 759/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:46:49 2022] PUT /identity/v3/projects/9381e39f1f0b42eaacecedff2f7bde3f/users/0b7f99948569433e822cfbb3e342a0a8/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:46:49.985453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa567-01a4-4376-80f0-18f952043b20 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:49.985866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa567-01a4-4376-80f0-18f952043b20 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:49.986253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590aa567-01a4-4376-80f0-18f952043b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.013964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-590aa567-01a4-4376-80f0-18f952043b20 None None] MFA Rules not processed for user `0b7f99948569433e822cfbb3e342a0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:50.015205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-590aa567-01a4-4376-80f0-18f952043b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:50.088064 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 743/1502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:50.103313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598192-1f9c-457d-b5d8-ac24d8581875 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.103728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598192-1f9c-457d-b5d8-ac24d8581875 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.104084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2598192-1f9c-457d-b5d8-ac24d8581875 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.106149 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 760/1503] 10.222.0.18 () {54 vars in 963 bytes} [Sat Jun 4 20:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:50.111428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56743-516d-43b2-aff4-ee7bd964de0f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.111751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56743-516d-43b2-aff4-ee7bd964de0f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.112029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56743-516d-43b2-aff4-ee7bd964de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.133449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-aca56743-516d-43b2-aff4-ee7bd964de0f None None] MFA Rules not processed for user `57831f8b23c243ff9223b08588949da4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:50.134720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aca56743-516d-43b2-aff4-ee7bd964de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:50.183211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:50.194761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 744/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Jun 4 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:50.206626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2598192-1f9c-457d-b5d8-ac24d8581875 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:50.220027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2598192-1f9c-457d-b5d8-ac24d8581875 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:50.224737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:50.225379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.225656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.225934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.236570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:50.238785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:50.252423 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 761/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:50.305213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bcdbc-fc39-4bec-8965-a14b740ef893 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.305552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bcdbc-fc39-4bec-8965-a14b740ef893 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.305935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bcdbc-fc39-4bec-8965-a14b740ef893 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.307990 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 745/1506] 10.222.0.18 () {52 vars in 829 bytes} [Sat Jun 4 20:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:50.312791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:50.376797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3c682-b58e-4d70-bb26-a2d97bec8399 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:50.381529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:50.382408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.382689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.383232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] PATH_INFO: `/v3/users/0b7f99948569433e822cfbb3e342a0a8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.384463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7f99948569433e822cfbb3e342a0a8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:50.385606 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:50.385606 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:46:50.385606 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:46:50.386720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:50.457606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7f99948569433e822cfbb3e342a0a8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:50.471609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7f99948569433e822cfbb3e342a0a8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:50.472497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7f99948569433e822cfbb3e342a0a8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:50.473210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7f99948569433e822cfbb3e342a0a8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:50.493941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7f99948569433e822cfbb3e342a0a8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:50.498370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:50.513438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 762/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:46:50 2022] DELETE /identity/v3/users/0b7f99948569433e822cfbb3e342a0a8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:46:50.517997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.518487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.518592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.541620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:50.543358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:50.612021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 746/1508] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:50.622075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:50.623691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:50.694765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ffccd-1059-4bf7-86b7-f07ca799c48e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:50.698488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:50.699133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:50.699411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:50.699717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:50.713497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:50.716455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553ca4-e3eb-4654-9524-7308eb53498f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:50.728227 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 763/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:51.210236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:51.212019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:51.224535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d91f1-5c4f-4e13-a708-f577d1387e4e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:51.229382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:51.230362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:51.230646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:51.231043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] PATH_INFO: `/v3/projects/9381e39f1f0b42eaacecedff2f7bde3f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:51.232166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9381e39f1f0b42eaacecedff2f7bde3f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:51.233202 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:46:51.233202 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:46:51.233202 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:46:51.234387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:51.310311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9381e39f1f0b42eaacecedff2f7bde3f', 'request_id': 'req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:51.331200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9381e39f1f0b42eaacecedff2f7bde3f', 'request_id': 'req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:51.338255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9381e39f1f0b42eaacecedff2f7bde3f', 'request_id': 'req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:51.356267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] The token cache is being invalidate because project 9381e39f1f0b42eaacecedff2f7bde3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:46:51.356553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:51.357311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2954dd9-1fa0-4eca-ba7f-faef0800ff64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:46:51.363551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 747/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:46:51 2022] DELETE /identity/v3/projects/9381e39f1f0b42eaacecedff2f7bde3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:47:00.723349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:01.353003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:00.711740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329085aa-7cae-48aa-b788-f815ba4789fc None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:00.712386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329085aa-7cae-48aa-b788-f815ba4789fc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:00.712386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329085aa-7cae-48aa-b788-f815ba4789fc None None] PATH_INFO: `/v3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:00.713674 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 764/1511] 10.222.0.42 () {54 vars in 925 bytes} [Sat Jun 4 20:50:00 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:50:00.721343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e88d7-b706-4a34-9e24-ece5088a2778 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:00.721969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e88d7-b706-4a34-9e24-ece5088a2778 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:00.721969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e88d7-b706-4a34-9e24-ece5088a2778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:00.743469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-124e88d7-b706-4a34-9e24-ece5088a2778 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:00.745061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-124e88d7-b706-4a34-9e24-ece5088a2778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:00.819548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 748/1512] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jun 4 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:04.909925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563bfc-7f8d-44cb-ba18-e7feeaaa02bc None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:04.910771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563bfc-7f8d-44cb-ba18-e7feeaaa02bc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:04.910771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563bfc-7f8d-44cb-ba18-e7feeaaa02bc None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:04.912642 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 765/1513] 10.222.0.18 () {54 vars in 960 bytes} [Sat Jun 4 20:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:50:04.918558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5879-f6b0-4b94-803c-98d628461b18 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:04.920659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5879-f6b0-4b94-803c-98d628461b18 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:04.920659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b5879-f6b0-4b94-803c-98d628461b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:04.945420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4e6b5879-f6b0-4b94-803c-98d628461b18 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:04.946779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4e6b5879-f6b0-4b94-803c-98d628461b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:04.958079 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 749/1514] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Jun 4 20:50:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:04.968382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1563bfc-7f8d-44cb-ba18-e7feeaaa02bc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:04.985590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1563bfc-7f8d-44cb-ba18-e7feeaaa02bc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:04.992221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:04.992957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:04.993297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:04.993602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:05.006425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:05.009034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad80ad-440a-4776-9861-2ef13788927d service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:05.027403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 766/1515] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:14.938202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=32 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:15.017613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:15.869395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaf96-096f-436f-9502-b822ef29e83d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:15.869701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaf96-096f-436f-9502-b822ef29e83d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:15.869937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaaf96-096f-436f-9502-b822ef29e83d None None] PATH_INFO: `/v3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:15.871314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 750/1516] 10.222.0.15 () {54 vars in 925 bytes} [Sat Jun 4 20:50:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:50:15.878779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a7bc-1871-4a7d-88d4-ab543ed2de5e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:15.879068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a7bc-1871-4a7d-88d4-ab543ed2de5e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:15.879348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a7bc-1871-4a7d-88d4-ab543ed2de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:15.900221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8474a7bc-1871-4a7d-88d4-ab543ed2de5e None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:15.901442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8474a7bc-1871-4a7d-88d4-ab543ed2de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:15.914789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 767/1517] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:25.332544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaaf96-096f-436f-9502-b822ef29e83d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:25.350854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaaf96-096f-436f-9502-b822ef29e83d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:25.357069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:25.357743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:25.358065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:25.358387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:25.368770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:25.370410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73e02-6f0d-4956-abc3-4416fecfdd9b service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:25.381397 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 751/1518] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:25.893649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:35.376413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:43.327470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:43.328054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:43.328054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:43.329469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 768/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:43.335129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45bf03-3e06-4ef3-a117-13e56126e8bd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:43.335669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45bf03-3e06-4ef3-a117-13e56126e8bd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:43.335767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45bf03-3e06-4ef3-a117-13e56126e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:43.358633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ba45bf03-3e06-4ef3-a117-13e56126e8bd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:43.359939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ba45bf03-3e06-4ef3-a117-13e56126e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:43.441600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 752/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:43.619331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:43.621318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:43.700816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8344a-c071-4b0d-84fe-547ad4a8d547 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:43.706776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:43.707431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:43.707750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:43.708019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:43.717310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:43.718918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8e5c5-b47a-4ffa-99ef-cb5657e81abc service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:43.729300 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 769/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:50:44.643713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5258e-6618-439c-ac4d-1b87e45b3ea1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:44.644410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5258e-6618-439c-ac4d-1b87e45b3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:44.644410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5258e-6618-439c-ac4d-1b87e45b3ea1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:44.645597 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:44.651722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e49c0-47b4-4cf0-8322-8d9da6138a7b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:44.652301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e49c0-47b4-4cf0-8322-8d9da6138a7b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:44.652301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e49c0-47b4-4cf0-8322-8d9da6138a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:44.671764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-518e49c0-47b4-4cf0-8322-8d9da6138a7b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:44.672990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-518e49c0-47b4-4cf0-8322-8d9da6138a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:44.681768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:50:44.849240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5258e-6618-439c-ac4d-1b87e45b3ea1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:44.865874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5258e-6618-439c-ac4d-1b87e45b3ea1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:44.871802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:44.872478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:44.872745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:44.873015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:44.883092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:44.884736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f1d75-d53b-4950-b488-10695695fb91 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:44.895739 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 754/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:48.958139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:48.958783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:48.958783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:48.960459 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:48.967265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394563-6a63-4308-bc73-545e5757c20d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:48.968106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394563-6a63-4308-bc73-545e5757c20d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:48.968106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394563-6a63-4308-bc73-545e5757c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:48.994371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d8394563-6a63-4308-bc73-545e5757c20d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:48.995639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8394563-6a63-4308-bc73-545e5757c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:49.004322 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:49.046323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:49.048791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:49.133905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72bd4-03d3-4bbd-863d-78aa1ee1ac35 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:49.137797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:49.138455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:49.138740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:49.139018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:49.149692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:49.151146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad6a5-d9fd-4efa-b8c0-b5654373f5e2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:49.162875 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 772/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:51.472199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47ab-567a-4faf-9853-a2f415cea933 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:51.473649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47ab-567a-4faf-9853-a2f415cea933 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:51.473649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47ab-567a-4faf-9853-a2f415cea933 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:51.474470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:51.480686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6508-21cc-4b58-ac0b-33fd73b0c638 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:51.481171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6508-21cc-4b58-ac0b-33fd73b0c638 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:51.481279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e6508-21cc-4b58-ac0b-33fd73b0c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:51.523273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3f4e6508-21cc-4b58-ac0b-33fd73b0c638 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:51.524542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f4e6508-21cc-4b58-ac0b-33fd73b0c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:51.534610 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:51.578085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f47ab-567a-4faf-9853-a2f415cea933 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:51.590920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f47ab-567a-4faf-9853-a2f415cea933 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:51.596132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:51.596811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:51.597092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:51.597369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:51.607354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:51.608836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9735429-40d3-4442-9fe6-7738bc71c3d7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:51.618439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 757/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:51:01.516336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=66 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:51:01.614316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=42 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:51:44.768133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fc1a-cc9d-4b22-aacb-c6024e7472b5 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:51:44.768794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fc1a-cc9d-4b22-aacb-c6024e7472b5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:51:44.768794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4fc1a-cc9d-4b22-aacb-c6024e7472b5 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:51:44.770427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 774/1531] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:51:44.776788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04ee9-4f92-409d-a916-50051dea0abf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:51:44.777335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04ee9-4f92-409d-a916-50051dea0abf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:51:44.777335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d04ee9-4f92-409d-a916-50051dea0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:51:44.798884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b9d04ee9-4f92-409d-a916-50051dea0abf None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:51:44.800248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9d04ee9-4f92-409d-a916-50051dea0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:51:44.810415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 758/1532] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:51:54.792586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:23.282970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.284061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.284621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.306950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:23.308192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:23.320266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 775/1533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:23.329836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.330798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.331355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.367067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:23.368646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:23.390021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 759/1534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:23.401577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.421731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3e69d-d1c4-4e45-b877-401021b7312b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.431432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.432155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.432444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.432725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.433491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:23.433802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.434896 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:23.434896 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:52:23.434896 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:52:23.435906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.459731 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 776/1535] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:23.468155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.482697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112392-31c3-4c6a-9310-6b3c2ac61a39 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.490047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.490937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.491218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.491490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.492229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.493288 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:23.493288 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:52:23.493288 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:52:23.494508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.535700 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 760/1536] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:23.540356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.557985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19837940-7e10-4849-a73a-a615f94111ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.652380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.653087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.653383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.653657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.654362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.655397 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:23.655397 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:52:23.655397 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:52:23.657390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.691464 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 777/1537] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:23.696101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.710429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae70f8-611b-4a25-93f4-5d0ba3925539 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.728437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.729154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.729435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.729709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.730464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.732230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2033b-04ab-4cc0-b6cb-0301b0d3b545 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.747369 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 761/1538] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:23.752921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.772273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5020c-37e0-42c5-abc2-9d81a923aa0f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.780547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.781247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.781536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.781868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.782670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.784792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.784959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070131-da5c-46be-af6c-a1293882fc21 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.785042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070131-da5c-46be-af6c-a1293882fc21 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.785422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2070131-da5c-46be-af6c-a1293882fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.802611 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 778/1539] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:23.806874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:23.812316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e2070131-da5c-46be-af6c-a1293882fc21 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:23.813533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2070131-da5c-46be-af6c-a1293882fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:23.821911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27d171-085e-4acd-90b4-7678738dfeb1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:23.826979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:23.830998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.832358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.832813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] PATH_INFO: `/v3/projects/0d9e0c4a4f7b409bab8b012092f7d1f2/users/6c28978004214999bd5ff400f05fdc73/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.834051 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 762/1540] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:52:23.843673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.844124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.844412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.855650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9e0c4a4f7b409bab8b012092f7d1f2, user_id=6c28978004214999bd5ff400f05fdc73, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:23.858339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ff44d-03d1-4977-a9e7-407cf0a3f0e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:23.879180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:23.880418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:23.889140 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 779/1541] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:23 2022] PUT /identity/v3/projects/0d9e0c4a4f7b409bab8b012092f7d1f2/users/6c28978004214999bd5ff400f05fdc73/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:52:23.907868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:23.908188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:23.908432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:23.958354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] MFA Rules not processed for user `6c28978004214999bd5ff400f05fdc73`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:23.959628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:23.979424 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 763/1542] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:23.989050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.004649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbbf8e-bd6e-41b8-b696-f437f49089b5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.016340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.017330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.017623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.017913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.018865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.019184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.020934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.050760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 764/1543] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.059134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.082025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d74d7c-1b29-4652-bd2d-89a125d3a006 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.092291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 780/1544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.096646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.096998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.097462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.097755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.098040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.098769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.101185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51f493-6618-4db5-9e9e-578d2926c534 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.127226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d5e32-dcf0-491a-8650-1c2e39b1d3b5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.135093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.135799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.136136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.136413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.137111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.139361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7b88e-e613-4b0a-bab2-ef7353a69019 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.173056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 765/1545] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:52:24.174969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08598-f395-4fdb-8dad-e0eae96aa5ed None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.175574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08598-f395-4fdb-8dad-e0eae96aa5ed None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.176282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b08598-f395-4fdb-8dad-e0eae96aa5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.204181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 781/1546] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.206124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.206561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.206982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.215529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-20b08598-f395-4fdb-8dad-e0eae96aa5ed None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.215529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20b08598-f395-4fdb-8dad-e0eae96aa5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.217129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:24.237518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.238941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.300204 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 766/1547] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.301660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f02f-0384-4b06-b7e9-6792fd63fbc6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.301955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f02f-0384-4b06-b7e9-6792fd63fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.302240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f02f-0384-4b06-b7e9-6792fd63fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.320825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af63f02f-0384-4b06-b7e9-6792fd63fbc6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.321931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af63f02f-0384-4b06-b7e9-6792fd63fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.326006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 782/1548] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.326672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.330386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 767/1549] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.331814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.332097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.332444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.344436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e9d7e-db71-4b95-9c49-e85399fd1a7c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.352199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.353806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.353806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.354359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.355104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.356321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.357213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf11fe-50d9-4250-820d-a6531a137534 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.357980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.373545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 768/1550] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.374515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.385652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8257e9c-42f5-45f8-95c8-8553165e90ef None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.390229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.390901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.391186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.391481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.392327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.394398 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 783/1551] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/users => generated 295 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.394591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bf4fd-2d8f-4dfe-b128-ef0265951536 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.398280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d68aa-194e-445c-a7ad-be07ac860758 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.398592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d68aa-194e-445c-a7ad-be07ac860758 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.398879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d68aa-194e-445c-a7ad-be07ac860758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.401971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:24.418793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ed0d68aa-194e-445c-a7ad-be07ac860758 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.419017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 769/1552] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/users => generated 298 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.420445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed0d68aa-194e-445c-a7ad-be07ac860758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.423031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62829-ad64-4989-80fa-282b3ecca269 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.423365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62829-ad64-4989-80fa-282b3ecca269 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.423699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a62829-ad64-4989-80fa-282b3ecca269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.428862 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 784/1553] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.430098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79d1e-bf9e-40bb-82bf-ee42febc79c8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.430378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79d1e-bf9e-40bb-82bf-ee42febc79c8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.430647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79d1e-bf9e-40bb-82bf-ee42febc79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.442716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d3a62829-ad64-4989-80fa-282b3ecca269 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.443987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d3a62829-ad64-4989-80fa-282b3ecca269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.448626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a3f79d1e-bf9e-40bb-82bf-ee42febc79c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.449826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a3f79d1e-bf9e-40bb-82bf-ee42febc79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.452259 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 770/1554] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.453294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101c4a-dae5-420d-800c-d296dfa11f48 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.453581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101c4a-dae5-420d-800c-d296dfa11f48 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.453857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8101c4a-dae5-420d-800c-d296dfa11f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.458352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 785/1555] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.461255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.461648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.461973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.473412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c8101c4a-dae5-420d-800c-d296dfa11f48 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.474819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8101c4a-dae5-420d-800c-d296dfa11f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.480815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.482178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.482620 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 771/1556] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.484039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.484272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.484551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.490741 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 786/1557] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.492062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.502554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2637310-a088-4fd9-b08b-2e76a9a00dca None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.503806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.505088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.508430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.509085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.509364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.510140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.510415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.512067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65583149-3d19-40da-bb75-47c0458896e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.513427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 772/1558] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.514282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.525775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 787/1559] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:24.525775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.526042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcef95-595f-42ae-a07b-eb6aa1d4f293 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.526136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.526136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.529454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.530129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.530414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.530692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.531429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.533124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b35ad-6305-4a0f-83c2-2573eb1b31dd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.543812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 773/1560] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:24.544161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.545131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.545429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.545705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.545845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.554648 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 788/1561] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.556373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.565052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:24.565925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290b5d8-4716-4d07-84cf-7a01fd0bab8c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.566619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:24.570466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.571176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.571405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.571714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.572441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.572745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.574337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.574670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 774/1562] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:24.578566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.584841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232162d-e4c4-4608-bfc6-c32e09bd4794 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.591490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 789/1563] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.591490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.593327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.594065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.594360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.594624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.595352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.595693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.597434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.602034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363966-5350-4106-9326-9e2fcfddb790 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.606505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.607484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.607484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.607767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.608455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.608755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.609470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 775/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.610279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.610371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.621729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fae7a-ed1a-49d2-b413-93af19048ec7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.622844 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 790/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.623713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.626839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.627590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.628089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.628515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.629310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.629901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.631385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.633653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061c5e-efac-4a14-a04c-918318584b8a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.638553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.639205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.639484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.639789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.640568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.642113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.644892 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 776/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.645232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.656657 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 791/1567] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:24.656657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.657684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45e894-7f76-4ab0-9cd1-bb7fb6f99bda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.662742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.663795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.664083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.664291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611149da-8e79-4f39-bacc-b4bcecf1d4fe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.664382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] PATH_INFO: `/v3/projects/fc2cac01bd5043c39d678555c481266f/users/b31c087a046b40cca85dd462b3aaecc4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.669080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.669666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.669946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.670215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.670930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.671233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.672871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.679190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2cac01bd5043c39d678555c481266f, user_id=b31c087a046b40cca85dd462b3aaecc4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.680274 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:24.680274 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:52:24.680274 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:52:24.682219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.684840 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 792/1568] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.685640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.695793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc535-9688-40fb-9536-d9530e035d1c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.700644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.701322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.701600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.701842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.702587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:24.702866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.703460 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 777/1569] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:24 2022] PUT /identity/v3/projects/fc2cac01bd5043c39d678555c481266f/users/b31c087a046b40cca85dd462b3aaecc4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:24.704567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.704764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.722576 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 793/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:24.722576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.734141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00234076-fdf8-4139-a0a8-0fdb9a6a1510 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.767331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f063-39e6-4d7f-a486-b5844243b7d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.772425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.773088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.773371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.773650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.774400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.775327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:24.776388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.791310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.792081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.792364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.792632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.793342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.795345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.808565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 778/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.808565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.825118 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 794/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.826599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.871356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:24.888421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cff2f-0ae5-4ed9-8eca-b599ea3a7786 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.893129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.893898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.894180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.894489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.895184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.897246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d52b-9f06-4a7c-9810-34cf426a5757 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:24.897524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.903191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:24.903893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:24.904171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:24.904441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:24.905124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:24.908062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:24.928178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 779/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.929410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.945466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 795/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:24.945466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:24.994908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40093dd-dde3-4c98-91b6-3e913f6aa520 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.007938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7e60-ebf8-4cac-8a12-f718fcb68efa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.013553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.014372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.014660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.014978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.015912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.017869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.049475 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 796/1575] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:24 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.053951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.060548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.061474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.061743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.062023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] PATH_INFO: `/v3/projects/b2009577e16e48458dd3eebf04938841/users/71d0d753d0314e44b9cd7fba3ab1cd26/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.079035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2009577e16e48458dd3eebf04938841, user_id=71d0d753d0314e44b9cd7fba3ab1cd26, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.082059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.097719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 780/1576] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:24 2022] PUT /identity/v3/projects/b2009577e16e48458dd3eebf04938841/users/71d0d753d0314e44b9cd7fba3ab1cd26/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:25.104724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.105378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.124178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88420f-116a-4f52-9b6d-cb14673ebf1d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.169201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1275bb-c8a4-4ec1-8f1d-4baa14f164cd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.173968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.174629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.174984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.175264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.176006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.177910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.182561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.183432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.184164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.184553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.184844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.185636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.187634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.197637 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 797/1577] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.201578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.207606 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 781/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.208494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.212181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc66d-d36c-4b20-8b0f-f2eb19e869ae admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.271534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab173-a832-4ccd-a614-d9b1f4fd01f6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.274459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.275150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.275434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.275764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.276141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.276466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.276807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.277088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.277358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.278034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.278461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.279967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.304120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 798/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.304120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.304405 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 782/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.304405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.313132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4108-0299-48d4-b0fc-1ee55d2ac2ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.314872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf69f2-1a12-48a6-8a41-29b07108efb5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.318089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.318826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.319175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.319547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.319652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.320257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.320399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.320544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.320825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.321537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.322589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.323436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa202a-86ee-4b92-9c28-73d650f108ce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.344131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 783/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.344777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.347951 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 799/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.354240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.354523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.354799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.355417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274398a-ceae-4218-b01f-af0f2e46f452 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.360702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.361604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.361861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.363109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.363849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.365931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.384238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] MFA Rules not processed for user `71d0d753d0314e44b9cd7fba3ab1cd26`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:25.385625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:25.389654 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 784/1583] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.389654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.400493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d847-2485-47e6-8cbd-99730541fc73 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.405005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.405882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.406163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.406441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] PATH_INFO: `/v3/projects/fc2cac01bd5043c39d678555c481266f/users/b31c087a046b40cca85dd462b3aaecc4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.408393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2cac01bd5043c39d678555c481266f, user_id=b31c087a046b40cca85dd462b3aaecc4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.411255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.422696 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 785/1584] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:25 2022] PUT /identity/v3/projects/fc2cac01bd5043c39d678555c481266f/users/b31c087a046b40cca85dd462b3aaecc4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:25.423726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.440129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.464912 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 800/1585] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:25.465918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.476653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c4622-d8ce-4a85-b1aa-d89d6922af8a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.487714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a66fa-c3c3-42d4-baee-b4cbdd624906 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.492468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.493139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.493419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.493700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.494388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.496345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.525060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 786/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.525060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.533811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951a502-70e7-4666-9865-b08353c6d799 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.539411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.540141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.540429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.540710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.541451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.542970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.543094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.543786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.544163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.544582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.545412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.547354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.558137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 787/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.558137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.558608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 801/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.562308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.567899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd1bc-dbf4-4483-a5a7-2a616a86b722 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.572624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.572747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc033-7a05-4e8e-93c2-e3c692b56747 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.573302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.573720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.574007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.574735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.576382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.577349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.577940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:INSERT=14 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.578135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.578484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.578825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.579673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.581857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c8ad0-0e9e-4608-b7b2-e06bc9c26050 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.589017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 788/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.590776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.595361 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 802/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.595361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.595361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.595361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.601766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207bf6-748b-45e4-be6e-f6d4be56f9f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.606363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.607028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.607323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.607636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.608369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.609985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.620719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] MFA Rules not processed for user `b31c087a046b40cca85dd462b3aaecc4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:25.621352 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 789/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.622209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.624278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:25.631940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ce842-c67a-47f6-b606-6e92ab861bdc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.636940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.637584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.637863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.638138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.638814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.640723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.669600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 790/1592] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.670428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.694793 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 803/1593] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:25.695817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.708810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b02936-1ceb-4956-9248-b385d27b8a8f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.737392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bc242-bd75-4ad6-a5dd-fd1e3eb9770f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.742000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.742674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.742966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.743247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.744016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.745634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.755825 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 791/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.756728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.766004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.766286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f98b70-345b-4120-8ab8-1fcdcef926ac admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.772022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.772887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.773397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.773591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.773886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.774295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.774572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.774843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.775598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.775824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.777238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.777696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.793974 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 804/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.794149 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 792/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.794270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.794359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.800191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737a5d9-725c-4db0-a493-c2a826260c6b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.800502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc759a0-f831-4867-b0c3-7170234180a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.804966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.805130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.805635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.805739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.806005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.806117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.806279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.806524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.807003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.807262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.808635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.808883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.819199 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 805/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.820223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.820332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 793/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.820777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.830785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a652d-e797-4386-9ad8-b197829be3b2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.832392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7fd1d-e4c1-4987-a17d-1cc05beb6e68 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.836655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.836863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.837373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.837515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.837657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.837794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.837933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.838116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.838626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.838780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.840393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f63db-dd06-4631-a69e-3dda497a9327 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.840661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.852400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 806/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.853800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f748-b6a7-4a8f-bb7f-b7a06e8d57ce None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.854089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f748-b6a7-4a8f-bb7f-b7a06e8d57ce None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.854364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2f748-b6a7-4a8f-bb7f-b7a06e8d57ce None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.855809 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 807/1600] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jun 4 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:25.856859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2f748-b6a7-4a8f-bb7f-b7a06e8d57ce None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.866883 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 794/1601] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:25 2022] POST /identity/v3/users => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:25.867736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.873350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2f748-b6a7-4a8f-bb7f-b7a06e8d57ce None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.877006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e824b-2792-4add-8b07-ab10a57829e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.878527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.878765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.879062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.879333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.880085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.881734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.882182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.883587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.883587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.883779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] PATH_INFO: `/v3/projects/afaae81a01be4c73acb908aae5be8312/users/90a9faf4a615437ca499c0ccbc1e7563/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.892295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 808/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:25.893080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.901274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afaae81a01be4c73acb908aae5be8312, user_id=90a9faf4a615437ca499c0ccbc1e7563, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.903490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e19e2-4e57-4ffa-8df5-d0fe419ee381 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:25.904046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.908630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:25.909718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:25.910068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:25.910364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] PATH_INFO: `/v3/projects/2c103d8a8d72475980015967d95817b1/users/ea9032fda1d24a71a887d0a9573b7ce4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:25.919890 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 795/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:25 2022] PUT /identity/v3/projects/afaae81a01be4c73acb908aae5be8312/users/90a9faf4a615437ca499c0ccbc1e7563/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:25.923731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.926497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c103d8a8d72475980015967d95817b1, user_id=ea9032fda1d24a71a887d0a9573b7ce4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:25.929211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:25.945167 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 809/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:25 2022] PUT /identity/v3/projects/2c103d8a8d72475980015967d95817b1/users/ea9032fda1d24a71a887d0a9573b7ce4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:25.948339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:25.981481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.986306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8915-a373-4beb-84aa-45d58051e01d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.017572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcb08c-d6d3-4384-93f4-7f4a88dbdf94 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.022795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.023726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.024003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.024276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] PATH_INFO: `/v3/projects/0ec59a0aa994409c95c5c0e98ecfb8ef/users/25f3f9fb63ef4771977be23373810489/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.042374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec59a0aa994409c95c5c0e98ecfb8ef, user_id=25f3f9fb63ef4771977be23373810489, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.044634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.045224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.045562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.045855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.046113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] PATH_INFO: `/v3/projects/744b968fdf1748b3889e0cbe831ea56e/users/a2b068d9458042abbbde0ade6677b25d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.060296 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 810/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:25 2022] PUT /identity/v3/projects/0ec59a0aa994409c95c5c0e98ecfb8ef/users/25f3f9fb63ef4771977be23373810489/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:26.061105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.064445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b968fdf1748b3889e0cbe831ea56e, user_id=a2b068d9458042abbbde0ade6677b25d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.068309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5f76a-cdb3-4df5-b369-19983c3b7c52 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.085197 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 796/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:25 2022] PUT /identity/v3/projects/744b968fdf1748b3889e0cbe831ea56e/users/a2b068d9458042abbbde0ade6677b25d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:26.092192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.092565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.092905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.111488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.112713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.135744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2b0e-55e8-4a72-8934-db2e168c0510 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.156041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.181908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 797/1607] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.182770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.194851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.195789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.196071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.196347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c/users/9f701c69994f4445b32c5b500d687260/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.212326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f37a307cd1843549d1e715ed0ee917c, user_id=9f701c69994f4445b32c5b500d687260, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.215006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.230961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 811/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:26 2022] PUT /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c/users/9f701c69994f4445b32c5b500d687260/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:26.232080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.247426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fadb1-b786-44c3-96d4-a88c71a81a6c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.268302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.294693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f221af-91c2-4c19-8855-d004c988d99d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.299185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.300226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.300603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.300887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] PATH_INFO: `/v3/projects/3794e2ea301c4644aa5724a8ba8103e0/users/62084e68550f4225a3eacf221579316b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.306566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.307232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.307542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.307808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.308557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.310150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555869c7-6a6f-448a-aa9e-3d35bd9f43ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.316123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3794e2ea301c4644aa5724a8ba8103e0, user_id=62084e68550f4225a3eacf221579316b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.318770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad25dd-5646-42e1-b216-8eccbcccec55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.320381 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 798/1609] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:26.321452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a826-7a38-4754-8523-b19594a3023a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.321921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a826-7a38-4754-8523-b19594a3023a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.322016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0a826-7a38-4754-8523-b19594a3023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.334003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 812/1610] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:26 2022] PUT /identity/v3/projects/3794e2ea301c4644aa5724a8ba8103e0/users/62084e68550f4225a3eacf221579316b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:26.335746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf5e2-5d41-41e5-8682-de74c1d3006c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.336035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf5e2-5d41-41e5-8682-de74c1d3006c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.336310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bf5e2-5d41-41e5-8682-de74c1d3006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.350013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a8c0a826-7a38-4754-8523-b19594a3023a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.351864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a8c0a826-7a38-4754-8523-b19594a3023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.366260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fa2bf5e2-5d41-41e5-8682-de74c1d3006c None None] MFA Rules not processed for user `ea9032fda1d24a71a887d0a9573b7ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.367399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fa2bf5e2-5d41-41e5-8682-de74c1d3006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.415583 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 799/1611] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.416934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.417230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.417501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.447607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] MFA Rules not processed for user `25f3f9fb63ef4771977be23373810489`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.448835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.465734 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 813/1612] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.467855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b94c-5013-451e-8a14-a122f6aa19d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.468145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b94c-5013-451e-8a14-a122f6aa19d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.468421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b94c-5013-451e-8a14-a122f6aa19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.499134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e0c2b94c-5013-451e-8a14-a122f6aa19d1 None None] MFA Rules not processed for user `a2b068d9458042abbbde0ade6677b25d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.500411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e0c2b94c-5013-451e-8a14-a122f6aa19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.510068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.518114 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 800/1613] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.519677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.579121 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 814/1614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.580449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.580736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.581148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.586674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.607714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10725-6bae-4f09-976c-296f488a27ca None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.609422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] MFA Rules not processed for user `9f701c69994f4445b32c5b500d687260`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.610676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.613626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.614320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.614593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.614887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.675923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 815/1615] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.676755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.677030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.678701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47684f49-143c-42c0-803a-8683399c97c7 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.688464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5a1e6-e57d-49de-9d48-5ce84cbcd43f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.689777 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 801/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:26.692084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.692375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.692658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.694039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.695093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.695372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.695743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] PATH_INFO: `/v3/projects/4935f1f1adc44a51a1219c7258357184/users/2b7abc81647948b58d455c411ff55853/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.712349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4935f1f1adc44a51a1219c7258357184, user_id=2b7abc81647948b58d455c411ff55853, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.715085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.728334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] MFA Rules not processed for user `62084e68550f4225a3eacf221579316b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:26.729585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.732303 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 816/1617] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:26 2022] PUT /identity/v3/projects/4935f1f1adc44a51a1219c7258357184/users/2b7abc81647948b58d455c411ff55853/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:26.736084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.738130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:26.799240 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 802/1618] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:26.800986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.806230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ae4a-8ce5-4f58-a610-5f9063404e5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.809909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.810608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.810852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.811131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.843855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.869743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f1a5d-441b-47d9-b391-48095164c75c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.874833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:26.875677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:26.876057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:26.876429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:26.877345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.880234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.888912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:26.891101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:26.904814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 817/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:26.905568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:26.908589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.918485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73749ea-ccea-42de-af38-6d28dc4dd159 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:26.918731 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 803/1620] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:26.920344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.003286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.004064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.004654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.004760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.005509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.008299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.030706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100769c-4453-4c4b-89ac-dbddef2066e8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.041634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.042802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.043461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.044023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.044888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.045586 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 818/1621] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.046520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.047686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.089591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 804/1622] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:26 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.090843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.141560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14217a04-65ff-409b-879d-e96b7daf116a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.167664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a1cbb-eb5c-4fea-9fc0-93fcb556a4d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.173392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.174293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.174806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.175288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.176131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.177882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.189757 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 805/1623] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.190974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.202488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38955cf-083e-4c0d-b822-87fc799d0e69 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.208716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.209555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.209891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.210245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.211137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.213337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.239101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:27.246671 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 806/1624] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.247450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.249010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.251245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.251904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.252350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.253891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.257255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.302334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 819/1625] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/projects => generated 395 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.303243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.355752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:27.361707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab12324-9760-40a8-8a68-0062222dc87f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.417130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e5f1c-3af9-475a-a6c3-261a4392db0d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.427144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.427889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.428173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.428448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.429417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.432219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.439477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.440468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.440654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.441101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.441804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.444098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.473706 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 820/1626] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.474675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.483473 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 807/1627] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.483473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.488170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf278c-c0bf-43ee-96f1-7026ffb0dd5f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.495317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcf456-9a51-4b53-a4ef-a8f7dc585b1c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.495749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.496716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.497118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.497484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.500889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.501309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.502211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.502494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.502909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] PATH_INFO: `/v3/projects/4935f1f1adc44a51a1219c7258357184/users/2b7abc81647948b58d455c411ff55853/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.503020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.505043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4935f1f1adc44a51a1219c7258357184, user_id=2b7abc81647948b58d455c411ff55853, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.508255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.527232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 808/1628] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:27 2022] PUT /identity/v3/projects/4935f1f1adc44a51a1219c7258357184/users/2b7abc81647948b58d455c411ff55853/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:27.528769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.540704 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 821/1629] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/users => generated 291 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.541650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.555890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4082d8-6b63-44d0-8c93-137e56b3476b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.618627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecde6a8-6ff6-4243-bd87-8b6557800d86 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.623366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.624468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.624468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.624678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.625302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.626965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.627303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.628181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.628849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.629266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.630823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.633555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.652109 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 809/1630] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.653224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.659466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 822/1631] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:27.660659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.667618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c430d0-90bf-4d91-aacb-c74969b5b7d0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.672755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.673456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1a40e-5c09-423c-80f9-6b7cac1fc4b9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.673561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.673795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.674069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.675025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.676691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a10ee-f18f-41f3-8c06-b1a457bfb9b1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.681059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.682211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.682656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.683108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.684051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.685836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.687543 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 810/1632] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.689226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.689226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.689497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.705763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 823/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.705763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.717862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1ef7e-d408-492c-a797-1313ab10a109 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.722803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] MFA Rules not processed for user `2b7abc81647948b58d455c411ff55853`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:27.723904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.724312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:27.724600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.724900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.725170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.726062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.728733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb174a0-dc9c-4f56-841a-fd130d85d381 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.742582 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 824/1634] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.744376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196b9e-5598-4156-b1d9-52bdd2aa31d8 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.744780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196b9e-5598-4156-b1d9-52bdd2aa31d8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.745127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196b9e-5598-4156-b1d9-52bdd2aa31d8 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.746749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 825/1635] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:27.747451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196b9e-5598-4156-b1d9-52bdd2aa31d8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.761486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196b9e-5598-4156-b1d9-52bdd2aa31d8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.766026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.766708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.766992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.767263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.768032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.769754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.791562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 826/1636] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.793585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:27.796526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.817750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a036b-f1c8-406c-bae3-0586a67b9d31 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.823328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.824065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.824351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.824635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.825507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.827013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.829009 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 811/1637] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:27.830139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.839553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:27.839804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 827/1638] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:27.841469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.855679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa25ee-afb7-481b-bab3-ff48d40fb72c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.856426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9846a-6a93-4b07-a04f-32992d9f68ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:27.861036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.862157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.862706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.863043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] PATH_INFO: `/v3/projects/d84fd01fc63e454797a06b516a0cf7e8/users/87077ac70a1a44b98a568e3848c8afd4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.865165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:27.866446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.866992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.867537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] PATH_INFO: `/v3/projects/db495e0cc5c546bd949f809b351810ee/users/b4b5e59e5e964902a2169cb260371413/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.883730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84fd01fc63e454797a06b516a0cf7e8, user_id=87077ac70a1a44b98a568e3848c8afd4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.887186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.890544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db495e0cc5c546bd949f809b351810ee, user_id=b4b5e59e5e964902a2169cb260371413, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:27.893733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942b4ed-89e7-4c3e-b201-da2c612dcad5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:27.906442 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 812/1639] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:27 2022] PUT /identity/v3/projects/d84fd01fc63e454797a06b516a0cf7e8/users/87077ac70a1a44b98a568e3848c8afd4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:27.907726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:27.912578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 828/1640] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:27 2022] PUT /identity/v3/projects/db495e0cc5c546bd949f809b351810ee/users/b4b5e59e5e964902a2169cb260371413/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:27.914442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:27.914768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:27.915022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:27.936804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:27.938053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:27.986094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e389b1a-3652-4cff-8fb1-070da02340ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.020141 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 829/1641] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:28.021520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.094213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.096145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.097543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.097731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] PATH_INFO: `/v3/projects/a071979b44d344cda722a9e230128b29/users/0604468e79274a45b15c192435118e57/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.112416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71bec-57df-4bf6-aa0a-58afde29a409 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.117513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.118567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.118989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.119265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] PATH_INFO: `/v3/projects/f1533927111744ae9f05405d1240b77c/users/30a49b35a3e34f8fabed75aeeda724af/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.125377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a071979b44d344cda722a9e230128b29, user_id=0604468e79274a45b15c192435118e57, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.133752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ff40-754b-41d1-be6e-4da15ed82a7e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.139083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1533927111744ae9f05405d1240b77c, user_id=30a49b35a3e34f8fabed75aeeda724af, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.142145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.156931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 813/1642] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:27 2022] PUT /identity/v3/projects/a071979b44d344cda722a9e230128b29/users/0604468e79274a45b15c192435118e57/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.158451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.158740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.159966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.163528 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 830/1643] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/f1533927111744ae9f05405d1240b77c/users/30a49b35a3e34f8fabed75aeeda724af/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.168327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.187650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] MFA Rules not processed for user `71d0d753d0314e44b9cd7fba3ab1cd26`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:28.188878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:28.242855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:28.249372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214f514-4a97-4bdd-88c1-7043ece56b7e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.261880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:28.262410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.263675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.264967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.265399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] PATH_INFO: `/v3/projects/69b33db63c5e424b94c673b74c1e9ddd/users/c5ca7127b38940269836120b64656004/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.278862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 814/1644] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:28.279693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.288378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b33db63c5e424b94c673b74c1e9ddd, user_id=c5ca7127b38940269836120b64656004, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.293412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.299274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54295cee-8297-4f54-94a1-2e3093086f7a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.306532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.307237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.307537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.307846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.308741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.310784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf0a67-cd53-4c5e-aa1c-2d4e903cf5df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.319761 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 831/1645] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/69b33db63c5e424b94c673b74c1e9ddd/users/c5ca7127b38940269836120b64656004/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.321044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.327090 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 815/1646] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:28.327090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad373-0db9-4488-a0d0-ce56f722025e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.327090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad373-0db9-4488-a0d0-ce56f722025e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.327090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfad373-0db9-4488-a0d0-ce56f722025e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.328119 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 816/1647] 10.222.0.18 () {54 vars in 960 bytes} [Sat Jun 4 20:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:28.328767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad373-0db9-4488-a0d0-ce56f722025e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.420302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78766ab8-e549-4a7a-adf8-dbc9e74856c3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.425674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.426753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.427039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.427324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.428116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.429777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.444941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 832/1648] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:28.445841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfad373-0db9-4488-a0d0-ce56f722025e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.446320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.451160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.452539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.453663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.454201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.455607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.457397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.457557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de0c4-3e7d-40e4-b5d7-a249775345d0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.462463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.463291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.463624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.464012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.464750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.466542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.476343 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 817/1649] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:28.477388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.482371 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 833/1650] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:28.487445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.500377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577bad-6ca3-4945-b4f1-3372fbd33657 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.506035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.507154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.507732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.507985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.508719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.510821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.527268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 834/1651] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:28.533368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.545521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3bd9-1f51-4472-84bb-d0b1c950266e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.552025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.552955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.553229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.553498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] PATH_INFO: `/v3/projects/d84fd01fc63e454797a06b516a0cf7e8/users/87077ac70a1a44b98a568e3848c8afd4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.555711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84fd01fc63e454797a06b516a0cf7e8, user_id=87077ac70a1a44b98a568e3848c8afd4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.558409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11ad33-f1d9-405b-b705-25702e67b65f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.575610 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 835/1652] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/d84fd01fc63e454797a06b516a0cf7e8/users/87077ac70a1a44b98a568e3848c8afd4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.578054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.578410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.578727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.589404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c075c-99cb-4ade-9d99-d9831e9e0ff3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.609241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:28.611446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:28.692823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.693564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.693857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.694599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.699730 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 836/1653] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Jun 4 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:28.701422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.714223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:28.748593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:28.786723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef3785-6ecb-4f60-a9a6-c723ce39c121 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.792002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.792588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.794138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.794440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.794871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.795248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] PATH_INFO: `/v3/projects/db495e0cc5c546bd949f809b351810ee/users/b4b5e59e5e964902a2169cb260371413/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.797939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=db495e0cc5c546bd949f809b351810ee, user_id=b4b5e59e5e964902a2169cb260371413, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.801441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.806757 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 818/1654] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:28.807644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.814534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 837/1655] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/db495e0cc5c546bd949f809b351810ee/users/b4b5e59e5e964902a2169cb260371413/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.815577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:28.828604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789050e-63a4-460d-8e63-0540f0eae94e service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.908635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:28.909583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:28.909860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:28.910257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] PATH_INFO: `/v3/projects/a071979b44d344cda722a9e230128b29/users/0604468e79274a45b15c192435118e57/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:28.912534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a071979b44d344cda722a9e230128b29, user_id=0604468e79274a45b15c192435118e57, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:28.915470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:28.920486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d0318-7cd5-4610-9b17-b53a26a76acc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:28.928008 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 819/1656] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/a071979b44d344cda722a9e230128b29/users/0604468e79274a45b15c192435118e57/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:28.937241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:29.013683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cbfc-f212-45cd-8bd1-dfcff34707bb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:29.019465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:29.022414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.022414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.022414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] PATH_INFO: `/v3/projects/69b33db63c5e424b94c673b74c1e9ddd/users/c5ca7127b38940269836120b64656004/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.024208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b33db63c5e424b94c673b74c1e9ddd, user_id=c5ca7127b38940269836120b64656004, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:29.027250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8ca1-89dc-4cf4-a54d-5d2f84b80e70 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:29.028124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:29.029045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.029320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.029600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] PATH_INFO: `/v3/projects/f1533927111744ae9f05405d1240b77c/users/30a49b35a3e34f8fabed75aeeda724af/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.031714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1533927111744ae9f05405d1240b77c, user_id=30a49b35a3e34f8fabed75aeeda724af, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:29.034616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:29.041273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 820/1657] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/69b33db63c5e424b94c673b74c1e9ddd/users/c5ca7127b38940269836120b64656004/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:29.042627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ba87-a9a5-46bc-ba76-37c4a9a719b6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.043118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ba87-a9a5-46bc-ba76-37c4a9a719b6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.043465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ba87-a9a5-46bc-ba76-37c4a9a719b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.064373 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 838/1658] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:28 2022] PUT /identity/v3/projects/f1533927111744ae9f05405d1240b77c/users/30a49b35a3e34f8fabed75aeeda724af/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:29.064373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:29.088068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-73c4ba87-a9a5-46bc-ba76-37c4a9a719b6 None None] MFA Rules not processed for user `87077ac70a1a44b98a568e3848c8afd4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.089560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-73c4ba87-a9a5-46bc-ba76-37c4a9a719b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.155714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:29.177301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ad287-d083-44be-b74c-37ad91fb0ed9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:29.189095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:29.190792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.191222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.191685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.202551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:29.204432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb065d-d321-420f-9cd8-3414f0fd659b service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:29.212888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:29.221512 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 821/1659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.223447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f319b-5f30-449a-ab54-6616daf34348 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.223851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f319b-5f30-449a-ab54-6616daf34348 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.224224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f319b-5f30-449a-ab54-6616daf34348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.230354 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 839/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:29.232720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca18c6-2ed3-4e2a-88eb-0a4c7be2ec30 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.233207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca18c6-2ed3-4e2a-88eb-0a4c7be2ec30 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.233621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca18c6-2ed3-4e2a-88eb-0a4c7be2ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.261959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c08f319b-5f30-449a-ab54-6616daf34348 None None] MFA Rules not processed for user `b4b5e59e5e964902a2169cb260371413`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.264321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c08f319b-5f30-449a-ab54-6616daf34348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.291536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-29ca18c6-2ed3-4e2a-88eb-0a4c7be2ec30 None None] MFA Rules not processed for user `0604468e79274a45b15c192435118e57`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.293397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29ca18c6-2ed3-4e2a-88eb-0a4c7be2ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.374873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 822/1661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.384480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 840/1662] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.385745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f11b-ca71-4026-bbdf-a4249bb7d585 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.385963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d2cc-b0fb-4d69-b1e5-0a2dff07cf2f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.386403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d2cc-b0fb-4d69-b1e5-0a2dff07cf2f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.386984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d2cc-b0fb-4d69-b1e5-0a2dff07cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.387260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f11b-ca71-4026-bbdf-a4249bb7d585 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.387769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f11b-ca71-4026-bbdf-a4249bb7d585 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.390206 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 823/1663] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:29 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:29.391615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba739-5dc0-4af3-90b8-3f48a8be9f98 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.392195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba739-5dc0-4af3-90b8-3f48a8be9f98 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.392611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba739-5dc0-4af3-90b8-3f48a8be9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.418047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6ab0d2cc-b0fb-4d69-b1e5-0a2dff07cf2f None None] MFA Rules not processed for user `c5ca7127b38940269836120b64656004`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.419253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ab0d2cc-b0fb-4d69-b1e5-0a2dff07cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.433082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dd0ba739-5dc0-4af3-90b8-3f48a8be9f98 None None] MFA Rules not processed for user `30a49b35a3e34f8fabed75aeeda724af`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.434388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd0ba739-5dc0-4af3-90b8-3f48a8be9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.504645 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 841/1664] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.507293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1700c-c95d-4fba-89b6-a7ad6f0f0679 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.507692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1700c-c95d-4fba-89b6-a7ad6f0f0679 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.508580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1700c-c95d-4fba-89b6-a7ad6f0f0679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.526246 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 824/1665] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.526246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.526246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.526902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.534439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7fd1700c-c95d-4fba-89b6-a7ad6f0f0679 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.535856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7fd1700c-c95d-4fba-89b6-a7ad6f0f0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.546077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] MFA Rules not processed for user `6c28978004214999bd5ff400f05fdc73`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.547316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.632150 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 842/1666] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.637598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:29.653211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5dd5-1188-44f6-ae0c-d5ca0fb2c96b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.653917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5dd5-1188-44f6-ae0c-d5ca0fb2c96b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.654413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a5dd5-1188-44f6-ae0c-d5ca0fb2c96b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.657060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 843/1667] 10.222.0.18 () {54 vars in 961 bytes} [Sat Jun 4 20:52:29 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:29.657954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a5dd5-1188-44f6-ae0c-d5ca0fb2c96b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:29.664843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:29.686585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 825/1668] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:29.687750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:29.704194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.782385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a5dd5-1188-44f6-ae0c-d5ca0fb2c96b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:29.835437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:29.836326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.836936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.837067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.837848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:29.839918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1bc02-8672-4c2a-8b07-08e6a3012dae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:29.876409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0022e-7ebf-4631-b1ee-9ef6c26d993f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:29.886292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:29.887116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.887402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.887730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.898795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 844/1669] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/projects => generated 395 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:29.900535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:29.900965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:29.901415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:29.907616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:29.909996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:29.924559 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 826/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:29.929360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:29.930982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:29.937385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:29.963088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d418f-7dca-41f3-88b0-ef5807d9add0 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.087105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 845/1671] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:30.096390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.109666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade16e5-8eeb-40af-a000-1b0365f9dac0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.118640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.119322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.119639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.119914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.153177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.154183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.154456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.154974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.156247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.158970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.187367 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 827/1672] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:29 2022] POST /identity/v3/users => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:30.192073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.208477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681f28c-2ade-495e-bbbd-678468c6030f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.216406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.217633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.218566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.219142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.220857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.225041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.230560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:30.243332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 828/1673] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:30.246017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.261980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc84a7-a14e-41a8-ad03-39abf6dab7f5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.272368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.273101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.274111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.274624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.274791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a5aa6-eb4a-41b2-9951-48e2d38a9c02 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.275295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.276540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.278692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.295481 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 829/1674] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:30.300630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.301372 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 846/1675] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:30.315651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21662448-5c06-4fcb-8a4e-1b457c2e79a6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.322238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.324276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.324769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.325279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] PATH_INFO: `/v3/projects/5dfebfcbd66a448ab244276f70531d0d/users/eb36771148154ae3838163db5b2ae24b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.348104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfebfcbd66a448ab244276f70531d0d, user_id=eb36771148154ae3838163db5b2ae24b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.352868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.383058 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 830/1676] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:30 2022] PUT /identity/v3/projects/5dfebfcbd66a448ab244276f70531d0d/users/eb36771148154ae3838163db5b2ae24b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:30.394376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.394736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.395400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.430222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.435263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] MFA Rules not processed for user `eb36771148154ae3838163db5b2ae24b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:30.436591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:30.437067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:30.567459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5a6fa-ee41-44f6-9eca-e09841eadb21 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.576832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 847/1677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:30.587434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.588301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.588586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.588865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.720382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.722165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.734855 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 831/1678] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:52:30.778364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.794503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc256db-b63a-40e5-bbd6-e13b19a60b1e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.800664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.801368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.801656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.801934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.816804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:30.843689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8bcc-047a-446b-a35d-9f3d26f877a1 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:30.872558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:30.874416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:30.875539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:30.876398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:30.960322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:30.963072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:30.977988 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 848/1679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:30.979185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:31.035865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.037678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.071768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 832/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:31.082221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:31.083918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2d028-7369-46e4-8d56-74e0c037644b service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:31.090194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:31.092555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:31.093391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.093775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.094189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.101136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:31.119181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.121991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5e3ba-c177-4cdc-bb0c-f737aae0f16e service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.123916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd4e7-e7da-4bc6-8b6b-62f89def6984 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:31.136951 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 849/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:31.155239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:31.155955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.156240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.156514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.198431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:31.239867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.242692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2f1ca-357c-45a2-a688-4e89a21bda10 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.255182 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 833/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:31.349302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86224-c2ac-4002-882c-4a941d623b3f None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.349722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86224-c2ac-4002-882c-4a941d623b3f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.350069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86224-c2ac-4002-882c-4a941d623b3f None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.352104 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 850/1683] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:31.365535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.365819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.366091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.410713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:31.412230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:31.432983 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 834/1684] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:31.451329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86224-c2ac-4002-882c-4a941d623b3f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:31.506100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:31.525517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f55ab-66da-4d35-a34b-1a7719c74005 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:31.531365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86224-c2ac-4002-882c-4a941d623b3f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:31.535861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:31.536640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.537053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.537425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.543183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:31.543998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.544318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.544686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.552437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.556374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.599085 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 851/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:31.653318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.655242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.682902 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 835/1686] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:31.760788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:31.776358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75937-bd7a-4613-81fc-b5e19f2b1ba8 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:31.791685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:31.792508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:31.792893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:31.793260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:31.949314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:31.951812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1bdb5-7969-48cd-ab3a-38a664c4d471 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:31.992244 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 852/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:32.278017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:32.303726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.303969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.304246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.306469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 853/1688] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:32.311669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:32.344615 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 04 20:52:32.345062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:32.381670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b97e-0e1d-4a8a-a054-422985e7dd1d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:32.393677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a49b35a3e34f8fabed75aeeda724af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1533927111744ae9f05405d1240b77c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:32.394606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.398413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.398664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] PATH_INFO: `/v3/projects/3794e2ea301c4644aa5724a8ba8103e0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.400979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: Authorizing `identity:get_project(project_id=3794e2ea301c4644aa5724a8ba8103e0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:32.404819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6d323-1147-4dfa-92e7-f7126c2af698 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:32.411352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 854/1689] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:32 2022] GET /identity/v3/projects/3794e2ea301c4644aa5724a8ba8103e0 => generated 379 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:52:32.456459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b28a-3893-4f4c-8fdd-5b531c23a4d8 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:32.468153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:32.470586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.471364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.471706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.473108 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 855/1690] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:52:32.473354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.473673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.473949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] PATH_INFO: `/v3/users/a2b068d9458042abbbde0ade6677b25d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.475482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b068d9458042abbbde0ade6677b25d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:32.476555 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.476555 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 20:52:32.476555 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 20:52:32.477782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:32.481203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:32.511800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:32.534157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0f33c-7a4b-4f29-9382-d140595bcb27 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:32.555795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:32.556849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.557139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.557423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.558664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:32.560919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:32.562703 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 856/1691] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:32 2022] GET /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 393 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:52:32.666308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b068d9458042abbbde0ade6677b25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.667029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b068d9458042abbbde0ade6677b25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.701217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:32.706403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:32.709076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b068d9458042abbbde0ade6677b25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.725974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b068d9458042abbbde0ade6677b25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.731962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9ab-aeda-4ec9-827e-d12aaa12d6ab tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:32.732256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:32.751254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:32.752385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.752804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.753011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] PATH_INFO: `/v3/users/25f3f9fb63ef4771977be23373810489` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.754484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f3f9fb63ef4771977be23373810489)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:32.756551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:32.792457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b068d9458042abbbde0ade6677b25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.825400 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 836/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:32 2022] DELETE /identity/v3/users/a2b068d9458042abbbde0ade6677b25d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:32.825400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:32.827253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:32.879178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f3f9fb63ef4771977be23373810489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.892016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f3f9fb63ef4771977be23373810489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.893069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f3f9fb63ef4771977be23373810489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.893893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f3f9fb63ef4771977be23373810489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.928549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:32.934043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f328e68b-3b76-4cf0-852d-f3694f9ea89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f3f9fb63ef4771977be23373810489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:32.958334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 857/1693] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:32 2022] DELETE /identity/v3/users/25f3f9fb63ef4771977be23373810489 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:52:32.960531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa98-1293-46ed-8a7b-a17baa5ea5d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:32.961040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa98-1293-46ed-8a7b-a17baa5ea5d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:32.963265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aa98-1293-46ed-8a7b-a17baa5ea5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:32.994776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d993aa98-1293-46ed-8a7b-a17baa5ea5d5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:32.997651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d993aa98-1293-46ed-8a7b-a17baa5ea5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.011966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe28061-e7ed-42fa-a876-6584d3bb6f80 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:33.079806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 858/1694] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:33.082098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2c6b5-79ee-4b23-aee4-431bd7279192 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.082687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2c6b5-79ee-4b23-aee4-431bd7279192 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.083100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2c6b5-79ee-4b23-aee4-431bd7279192 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.085917 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 859/1695] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:33.087718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.088210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.088726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.132597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:33.134519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.150209 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 860/1696] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:33.150627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:33.152537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.179018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:33.180022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.180448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.180868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.193175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.342107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:33.349873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:33.381741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:33.384479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 837/1697] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:33.387808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.389529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:33.395069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.438031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:33.527017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05982a64-b48f-444d-9c59-a64cdc83f472 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:33.547618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:33.548479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.553915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.554869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.581676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:33.583167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:33.600848 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 838/1698] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:33.601735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:33.612105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a1c8-984c-472f-aab3-350b938e007b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:33.617290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:33.618108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.619219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.619219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.630991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:33.632840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638770c7-ae6f-46d5-a8cd-30a4402f75e6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:33.635301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920839-21a5-4ede-bed4-4508d783ad49 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:33.647163 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 839/1699] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:33.648230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:33.648842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.649121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.649337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.649456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.649673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.649873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.654987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:33.660293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41030d-828a-450e-ad6b-26ece9fe8951 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:33.667591 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 861/1700] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:33 2022] GET /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 393 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:33.715018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] MFA Rules not processed for user `90a9faf4a615437ca499c0ccbc1e7563`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:33.718633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.820426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.821258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.821675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.823208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 862/1701] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:52:33.838216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:33.850453 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 840/1702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:33.859841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:33.861546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.863330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:33.864507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:33.883866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:33.885750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f24eb-57f7-4c1e-ad67-d1d66a74c0b6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:33.893191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:33.894329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:33.894885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:33.895337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:33.898573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:33.902496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:33.986116 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 841/1703] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:33 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:33.987129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.001286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215dae7-9fd2-4513-89b9-ef5c7bd937d3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.164708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a49b35a3e34f8fabed75aeeda724af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1533927111744ae9f05405d1240b77c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.167454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.167922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.168911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] PATH_INFO: `/v3/projects/3794e2ea301c4644aa5724a8ba8103e0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.172563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: Authorizing `identity:get_project(project_id=3794e2ea301c4644aa5724a8ba8103e0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.177641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0280-693b-4511-b5cf-4da4a850138d tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.182933 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 863/1704] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:33 2022] GET /identity/v3/projects/3794e2ea301c4644aa5724a8ba8103e0 => generated 379 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:52:34.189587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:34.233233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ae3d4-0c4c-47ca-9c8e-303d842ed5d1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.239877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.240675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.241066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.242103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.248129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.250656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.264823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.265594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.266076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.267797 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 864/1705] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:52:34.287197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:34.302207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 842/1706] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:33 2022] POST /identity/v3/users => generated 307 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:34.304086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.341143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf657-03d2-43dc-9089-d48873614b92 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.350071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.351042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.354533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.355841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.359033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.360889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.381946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 843/1707] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:34.394963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.416147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1441f-6bb6-46d1-889a-f35bdf89fa77 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.439132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.440178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.440778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.441008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] PATH_INFO: `/v3/projects/3836f24b696946f8be16f8415389655b/users/23217a2f30944c4eb4de3164e8f35416/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.473066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3836f24b696946f8be16f8415389655b, user_id=23217a2f30944c4eb4de3164e8f35416, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.476831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.502514 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 844/1708] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:34 2022] PUT /identity/v3/projects/3836f24b696946f8be16f8415389655b/users/23217a2f30944c4eb4de3164e8f35416/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:34.506187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.512464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:34.546012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.618788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf059f9-14b9-46e5-a571-16961d7bb87a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.634409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.635473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.635880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.636280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] PATH_INFO: `/v3/users/ea9032fda1d24a71a887d0a9573b7ce4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.637695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9032fda1d24a71a887d0a9573b7ce4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.640040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.701884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:34.709331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1985-f6dc-49f0-aa82-398640007a08 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.802502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9032fda1d24a71a887d0a9573b7ce4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:34.807735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9032fda1d24a71a887d0a9573b7ce4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:34.821011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9032fda1d24a71a887d0a9573b7ce4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:34.822741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9032fda1d24a71a887d0a9573b7ce4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:34.847462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:34.848362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b29adf81-0b40-492d-aa9a-ef2b85a895d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9032fda1d24a71a887d0a9573b7ce4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:34.849145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.849594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.850012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.851763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:34.854290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:34.872042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 865/1709] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:34 2022] GET /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 393 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:52:34.873288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:34.873879 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 845/1710] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:34 2022] DELETE /identity/v3/users/ea9032fda1d24a71a887d0a9573b7ce4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:34.876125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:34.876506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:34.877018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:34.877391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:34.896795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:34.912593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae265eba-41aa-4376-ad0c-9495b7724dae tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:34.919184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:34.920610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.061366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.062087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.062350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.062622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.063371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:35.065243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58745e7-9a61-442d-8217-ff26b1187ed0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:35.075939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 846/1711] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:35.078095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.092417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.096446 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 866/1712] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:35.096446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.100105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.100766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.153832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d3a83-b3b2-473b-8d06-58d8b82de4ba None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:35.170260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:35.171679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.177763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.179003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.187204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.187828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 867/1713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:35.188235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] PATH_INFO: `/v3/projects/744b968fdf1748b3889e0cbe831ea56e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.188727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.194151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744b968fdf1748b3889e0cbe831ea56e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:35.198877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:35.200165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.221599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3f75-86a3-4b21-823a-a83fb392137e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:35.238556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.239471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.239932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.240219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] PATH_INFO: `/v3/users/62084e68550f4225a3eacf221579316b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.248511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62084e68550f4225a3eacf221579316b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:35.251266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:35.333388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744b968fdf1748b3889e0cbe831ea56e', 'request_id': 'req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.365157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62084e68550f4225a3eacf221579316b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.365368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744b968fdf1748b3889e0cbe831ea56e', 'request_id': 'req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.378075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62084e68550f4225a3eacf221579316b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.378701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62084e68550f4225a3eacf221579316b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.380079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62084e68550f4225a3eacf221579316b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.382231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744b968fdf1748b3889e0cbe831ea56e', 'request_id': 'req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.398301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62084e68550f4225a3eacf221579316b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.416679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] The token cache is being invalidate because project 744b968fdf1748b3889e0cbe831ea56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:35.417352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.426489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.428874 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 847/1714] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:35 2022] DELETE /identity/v3/projects/744b968fdf1748b3889e0cbe831ea56e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:35.433365 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 868/1715] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:35 2022] DELETE /identity/v3/users/62084e68550f4225a3eacf221579316b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:35.435843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.436530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.437995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.442314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.460112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:35.551998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed15550-dd7a-4b8d-99c8-623ef8d6e818 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:35.580143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612fc54-437b-44a9-ae5e-d6d9d1856a62 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:35.585305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.586960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.587550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.588242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] PATH_INFO: `/v3/projects/3836f24b696946f8be16f8415389655b/users/23217a2f30944c4eb4de3164e8f35416/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.590268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3836f24b696946f8be16f8415389655b, user_id=23217a2f30944c4eb4de3164e8f35416, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:35.593451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:35.594116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:35.613045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 869/1716] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:35 2022] PUT /identity/v3/projects/3836f24b696946f8be16f8415389655b/users/23217a2f30944c4eb4de3164e8f35416/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:35.613045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.615472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.632021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.632971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.633258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.633572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] PATH_INFO: `/v3/projects/0ec59a0aa994409c95c5c0e98ecfb8ef` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.635073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec59a0aa994409c95c5c0e98ecfb8ef)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:35.637766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:35.767331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec59a0aa994409c95c5c0e98ecfb8ef', 'request_id': 'req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.780316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec59a0aa994409c95c5c0e98ecfb8ef', 'request_id': 'req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.790282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec59a0aa994409c95c5c0e98ecfb8ef', 'request_id': 'req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.791102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cf96-83f5-4595-bbce-f880e075886d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:35.817051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] The token cache is being invalidate because project 0ec59a0aa994409c95c5c0e98ecfb8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:35.817611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.818506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:35.832177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 848/1717] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:35 2022] DELETE /identity/v3/projects/0ec59a0aa994409c95c5c0e98ecfb8ef => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:35.833888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:35.836324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:35.892970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:35.893875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:35.894198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:35.894520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:35.899661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.030609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:36.032209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:36.055372 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 870/1718] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:36.056504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:36.060724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f5e8-31e6-40f8-b6e2-f095d60928e2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:36.062480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.067458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:36.068181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.068734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.069017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.070687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:36.071091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.077584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840404-3730-44d6-a289-25e8870366e9 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:36.088404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:36.090175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.092843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.093139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] PATH_INFO: `/v3/users/0604468e79274a45b15c192435118e57` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.096249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0604468e79274a45b15c192435118e57)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:36.100297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:36.147599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:36.149734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a1f2-3a6e-4a0e-9ddf-0f03a515f7cc service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:36.163132 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 849/1719] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:52:36.165277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0d3e-0d9c-4bd7-aab4-2983a66f0363 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.165277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0d3e-0d9c-4bd7-aab4-2983a66f0363 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.165637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0d3e-0d9c-4bd7-aab4-2983a66f0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.193574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c89b0d3e-0d9c-4bd7-aab4-2983a66f0363 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:36.195041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c89b0d3e-0d9c-4bd7-aab4-2983a66f0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.226557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0604468e79274a45b15c192435118e57'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.228040 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 850/1720] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:36.229513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.231555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.233329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.247581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0604468e79274a45b15c192435118e57'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.249444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:36.250352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0604468e79274a45b15c192435118e57'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.251434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0604468e79274a45b15c192435118e57'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.277450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:36.288391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.289105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0604468e79274a45b15c192435118e57'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.321517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 851/1722] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:36.321830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 871/1722] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:36 2022] DELETE /identity/v3/users/0604468e79274a45b15c192435118e57 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:36.323044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:36.324871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:36.326521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.330742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.494458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807db83-e30f-41c2-b863-edec38980900 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:36.512524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:36.513271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71714e63-0696-4bb4-bb00-169d1ce7f3f0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:36.513869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.519675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.520008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] PATH_INFO: `/v3/users/87077ac70a1a44b98a568e3848c8afd4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.523668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87077ac70a1a44b98a568e3848c8afd4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:36.534552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:36.686598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:36.691703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:36.692289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:36.692458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:36.700940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.758806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87077ac70a1a44b98a568e3848c8afd4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.783113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87077ac70a1a44b98a568e3848c8afd4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.785051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87077ac70a1a44b98a568e3848c8afd4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.785659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87077ac70a1a44b98a568e3848c8afd4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.841061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87077ac70a1a44b98a568e3848c8afd4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:36.846206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:36.873332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 872/1723] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:36 2022] DELETE /identity/v3/users/87077ac70a1a44b98a568e3848c8afd4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:36.874214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:36.887491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:36.940151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:36.946742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:36.983172 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 852/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:36.985804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:36.990539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:37.141433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d033e3-47c8-4460-9b0a-475581910148 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:37.144672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:37.156126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:37.156824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:37.157112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:37.157530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:37.161304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:37.275835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9edba-513e-43f4-88fd-95316a97672a service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:37.412294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:37.413812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb3cb-785a-476b-98fc-e061a06caec7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:37.437212 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 873/1725] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:37.495910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:37.496892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:37.497038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:37.497367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:37.503341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:37.733069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:37.740459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:37.764074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 853/1726] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:52:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:52:38.274070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e762b3-9a72-4d5e-91d8-bf1b5347aded None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.274734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e762b3-9a72-4d5e-91d8-bf1b5347aded None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.274734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e762b3-9a72-4d5e-91d8-bf1b5347aded None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.276429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 874/1727] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:38.281875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:38.284206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:38.423940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.424812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.425626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.466121 ncdv-master-1 devstack@keystone.service[97804]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 04 20:52:38.467094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:38.471332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:38.519261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:38.552758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:38.554294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:38.585488 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 875/1728] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:52:38.585982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:38.589547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:38.668987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fda5d-fd84-4da5-b969-3baa88e86d97 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:38.672630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dfac3-c05a-4af1-8c19-f5b200003c18 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:38.684680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:38.685631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.685929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.686146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.690311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:38.693073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:38.693893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:38.695682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.696121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.696983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] PATH_INFO: `/v3/projects/2c103d8a8d72475980015967d95817b1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.702225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c103d8a8d72475980015967d95817b1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:38.702770 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 854/1729] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:38 2022] GET /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 393 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:38.703761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:38.705626 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:38.705626 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 20:52:38.705626 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 20:52:38.708003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:38.717406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:38.737012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6452-b38d-4cbf-94b0-b538749163f1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:38.747653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:38.748341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.748624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.748902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.770712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:38.772979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe72e2a-20b3-4f1d-abdd-fdbceac4ee7a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:38.790107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 855/1730] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:38.867940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:38.868251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:38.868753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:38.872693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 856/1731] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:52:38.882504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:38.907595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:38.933922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac6e7a-363e-423e-b2ea-665a44505192 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:38.962602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c103d8a8d72475980015967d95817b1', 'request_id': 'req-99b26ee1-341c-42ea-a696-968dd351ffc0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.009428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c103d8a8d72475980015967d95817b1', 'request_id': 'req-99b26ee1-341c-42ea-a696-968dd351ffc0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.047378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c103d8a8d72475980015967d95817b1', 'request_id': 'req-99b26ee1-341c-42ea-a696-968dd351ffc0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.077577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] The token cache is being invalidate because project 2c103d8a8d72475980015967d95817b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:39.078178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.080956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.086268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 876/1732] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:38 2022] DELETE /identity/v3/projects/2c103d8a8d72475980015967d95817b1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:39.088459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:39.093489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:39.125328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:39.128233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:39.129870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:39.132330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:39.134169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:39.136676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:39.146385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:39.159790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 857/1733] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:38 2022] GET /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 393 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:39.163084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:39.173440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:39.368816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b26ee1-341c-42ea-a696-968dd351ffc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:39.398928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:39.400420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:39.400877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:39.401305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] PATH_INFO: `/v3/projects/a071979b44d344cda722a9e230128b29` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:39.407020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a071979b44d344cda722a9e230128b29)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:39.409981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:39.488365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610081f-7d07-494d-8695-3c035a272c6a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:39.515792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:39.521348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:39.522445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:39.524359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] PATH_INFO: `/v3/users/b4b5e59e5e964902a2169cb260371413` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:39.529448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a071979b44d344cda722a9e230128b29', 'request_id': 'req-4191362b-1fcb-4e68-beb4-316ed10633e9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.532395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b5e59e5e964902a2169cb260371413)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:39.543199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:39.548629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a071979b44d344cda722a9e230128b29', 'request_id': 'req-4191362b-1fcb-4e68-beb4-316ed10633e9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.565561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a071979b44d344cda722a9e230128b29', 'request_id': 'req-4191362b-1fcb-4e68-beb4-316ed10633e9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.602647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] The token cache is being invalidate because project a071979b44d344cda722a9e230128b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:39.603259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.604206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4191362b-1fcb-4e68-beb4-316ed10633e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.606584 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 877/1734] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:39 2022] DELETE /identity/v3/projects/a071979b44d344cda722a9e230128b29 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:39.611705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f041e5-83d7-46f6-874f-fc9804db00e3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:39.612267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f041e5-83d7-46f6-874f-fc9804db00e3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:39.612682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f041e5-83d7-46f6-874f-fc9804db00e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:39.703226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b6f041e5-83d7-46f6-874f-fc9804db00e3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:39.728069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:39.730771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6f041e5-83d7-46f6-874f-fc9804db00e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:39.767844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b5e59e5e964902a2169cb260371413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.778963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b5e59e5e964902a2169cb260371413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.834490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b5e59e5e964902a2169cb260371413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.836243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b5e59e5e964902a2169cb260371413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.879123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c08be19-2d3f-416f-8d33-789bbe281f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b5e59e5e964902a2169cb260371413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:39.917064 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 858/1735] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:39 2022] DELETE /identity/v3/users/b4b5e59e5e964902a2169cb260371413 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:39.918777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:39.919066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:39.919345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:39.934278 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 859/1736] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:52:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:39.939910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:52:39.944264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:40.005478 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 878/1737] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:52:40.031216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.035016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.035658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.119543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.121115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:40.160332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:40.176563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:40.245101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:40.389884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534725-6a7c-4a7c-8156-a03d5da268e3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.412684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5ca7127b38940269836120b64656004', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69b33db63c5e424b94c673b74c1e9ddd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.413589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.413923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.414196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] PATH_INFO: `/v3/projects/5dfebfcbd66a448ab244276f70531d0d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.417110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorizing `identity:get_project(project_id=5dfebfcbd66a448ab244276f70531d0d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.421725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.430617 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 879/1739] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:40.432234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.435600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 860/1739] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:52:39 2022] GET /identity/v3/projects/5dfebfcbd66a448ab244276f70531d0d => generated 395 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:40.444014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2411aac-c5d0-46f0-ac89-7cf4f7cbea64 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.450201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.451001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.452935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.452935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.452935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:40.452935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.456272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.491013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.497849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 880/1740] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:40.510910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a200f8-7e16-4ae9-a340-96a4cfb0de85 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.530195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.530871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.531151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.531434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.537153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.542610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.608647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.612001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:40.637039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c79b-59d1-4caf-886a-970510a74f33 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.637649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 861/1741] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:40 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:40.642483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.735932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:40.806489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809047-fb10-44d5-93e1-60eca8b525ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.819198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.820247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.820521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.820868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] PATH_INFO: `/v3/users/9f701c69994f4445b32c5b500d687260` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.823685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f701c69994f4445b32c5b500d687260)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.825589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.826423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.826554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.826760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.826994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.827740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.837747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.902463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 862/1742] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:40 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:40.907190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.929116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58e889-0de1-40fc-a104-37184c04a90c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:40.946418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:40.947348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:40.947816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:40.948109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:40.949072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:40.951070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:40.952848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f701c69994f4445b32c5b500d687260'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:40.977673 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 863/1743] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:52:40.985444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:40.987502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f701c69994f4445b32c5b500d687260'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:40.991268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f701c69994f4445b32c5b500d687260'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:40.993213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f701c69994f4445b32c5b500d687260'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:41.014752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0fdec-b90f-490e-9c80-d5e9cbc9e496 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:41.025021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:41.025021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:41.025316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:41.025472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:41.026413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:41.028781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:41.035306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-69ecbd98-0126-47b5-b227-8a905431c309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f701c69994f4445b32c5b500d687260'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:41.084051 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 864/1744] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:41.085316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:41.086048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 881/1745] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:40 2022] DELETE /identity/v3/users/9f701c69994f4445b32c5b500d687260 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:41.090810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:41.091820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:41.091820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:41.091995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:41.141131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:41.146662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:41.162416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad11ef-b609-41d3-8a9c-9a2e9611d8f8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:41.212096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:41.340255 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 882/1746] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:41.466787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:41.471694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:41.471968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:41.472244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] PATH_INFO: `/v3/projects/a3b98c9704a043ea8089ae0910ca9053/users/a4a4d09ab8484e458a96593fcbfdcbbd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:41.472996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:41.474960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:41.509509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b98c9704a043ea8089ae0910ca9053, user_id=a4a4d09ab8484e458a96593fcbfdcbbd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:41.517016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba6d8b-4a41-400e-99c6-ef8135cdcacb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:41.551384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 865/1747] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:41 2022] PUT /identity/v3/projects/a3b98c9704a043ea8089ae0910ca9053/users/a4a4d09ab8484e458a96593fcbfdcbbd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:41.567164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7e25-8a57-4290-91ed-bf5f4d3a5425 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:41.572618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7e25-8a57-4290-91ed-bf5f4d3a5425 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:41.575698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7e25-8a57-4290-91ed-bf5f4d3a5425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:41.699380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b13b7e25-8a57-4290-91ed-bf5f4d3a5425 None None] MFA Rules not processed for user `a4a4d09ab8484e458a96593fcbfdcbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:41.701046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b13b7e25-8a57-4290-91ed-bf5f4d3a5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:41.836912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c53e2-36ad-4b7a-a20d-804d85094a81 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:41.981094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 866/1748] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:41.981094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:41.981094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:41.981094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.005712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.009123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.009413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.009694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.043562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:42.055471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:42.080089 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 867/1749] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jun 4 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:42.082949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:42.102007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:42.235723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.237346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:42.281152 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 883/1750] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:42.282445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:42.284220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:42.310780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a7aba-971d-4edd-b6a7-3f5dee7a6ad4 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:42.317641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.318512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.321615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.322073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.342154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.344331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:42.362030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7cfa-6447-47c0-beec-32b07647ccfc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:42.383853 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 884/1751] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:42.385075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:42.387058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.388315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:42.388678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.389172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.389658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.391564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.401081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:42.433260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377254db-9b79-43a6-902b-8a3161bdcbac service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:42.454674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.463640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.465252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.466021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] PATH_INFO: `/v3/projects/3794e2ea301c4644aa5724a8ba8103e0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.470292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3794e2ea301c4644aa5724a8ba8103e0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.479117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:42.545791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:42.562563 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 868/1752] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:42.563219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:42.567991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:42.650885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3794e2ea301c4644aa5724a8ba8103e0', 'request_id': 'req-b8959194-aabe-4a90-80a0-699208545711'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:42.674848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3794e2ea301c4644aa5724a8ba8103e0', 'request_id': 'req-b8959194-aabe-4a90-80a0-699208545711'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:42.694729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3794e2ea301c4644aa5724a8ba8103e0', 'request_id': 'req-b8959194-aabe-4a90-80a0-699208545711'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:42.728383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] The token cache is being invalidate because project 3794e2ea301c4644aa5724a8ba8103e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:42.728660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:42.729305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:42.731484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 885/1753] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:42 2022] DELETE /identity/v3/projects/3794e2ea301c4644aa5724a8ba8103e0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:42.732453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:42.741304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:42.920441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc3ba0-8328-4d88-ad2b-4e00ec1b1344 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:42.941240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959194-aabe-4a90-80a0-699208545711 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:42.954682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.955587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.956034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.956803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:42.958686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.959711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.960573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:42.961165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:42.961745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] PATH_INFO: `/v3/projects/db495e0cc5c546bd949f809b351810ee` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:42.962208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:42.963974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db495e0cc5c546bd949f809b351810ee)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:42.970630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:43.006125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 886/1754] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:42 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:43.007051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.019166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:43.052816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708df89f-13a3-4503-ba13-e0ee06adef4a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.061731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:43.065085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.065511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.065803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] PATH_INFO: `/v3/users/30a49b35a3e34f8fabed75aeeda724af` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.068506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a49b35a3e34f8fabed75aeeda724af)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:43.075729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:43.137596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db495e0cc5c546bd949f809b351810ee', 'request_id': 'req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.174957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db495e0cc5c546bd949f809b351810ee', 'request_id': 'req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.184857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db495e0cc5c546bd949f809b351810ee', 'request_id': 'req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.219698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a49b35a3e34f8fabed75aeeda724af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.220680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] The token cache is being invalidate because project db495e0cc5c546bd949f809b351810ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:43.221104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.222160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.229368 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 869/1755] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:42 2022] DELETE /identity/v3/projects/db495e0cc5c546bd949f809b351810ee => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:43.230288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.234678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:43.243448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a49b35a3e34f8fabed75aeeda724af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.248035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a49b35a3e34f8fabed75aeeda724af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.251561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a49b35a3e34f8fabed75aeeda724af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.313497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a98b25b-5fb8-48ec-8882-7979adfae9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a49b35a3e34f8fabed75aeeda724af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:43.326499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:43.357062 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 887/1756] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:43 2022] DELETE /identity/v3/users/30a49b35a3e34f8fabed75aeeda724af => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:43.368819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a037-6929-4353-8dd7-68c1e14bc410 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.373710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a037-6929-4353-8dd7-68c1e14bc410 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.374222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080a037-6929-4353-8dd7-68c1e14bc410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.410390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:43.445265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f080a037-6929-4353-8dd7-68c1e14bc410 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:43.446517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f080a037-6929-4353-8dd7-68c1e14bc410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:43.458122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45266ccd-bc89-471d-8279-fa6c3bf0f0c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.608383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 888/1757] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:43.609367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:43.610528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.610956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.611621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.612851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:43.615919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.616401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.616843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.620490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:43.647218 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 870/1758] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:43.653214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.654075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:43.655680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:43.658801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:43.679969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 889/1759] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:52:43.683495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.685798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900608f-1a42-479e-953a-aafa8c288f22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.699983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:43.701193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.701629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.702077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] PATH_INFO: `/v3/projects/ee4c325c34994ccd886a81b93f575260/users/87ea56e981164a768272ee130428a636/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.704157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69738-7124-49e7-8962-9655f77dbbb7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.720100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:43.721144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.721721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:43.722231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:43.723425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:43.725505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:43.727469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:43.743733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4c325c34994ccd886a81b93f575260, user_id=87ea56e981164a768272ee130428a636, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:43.746993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:43.759557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 890/1760] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:43.767341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.780533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 871/1761] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:43 2022] PUT /identity/v3/projects/ee4c325c34994ccd886a81b93f575260/users/87ea56e981164a768272ee130428a636/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:43.784805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:43.797917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfa55c-c783-489c-bce8-f8e4df410ea1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.994032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fad4c9-3d95-46ce-9ddd-b32992e00585 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:43.995648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:43.996980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:43.997652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.000979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.004842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.009259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.019604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.021178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.021644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.022048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.022963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.025483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.057901 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 872/1762] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:44.061993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.098427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb048c-355b-468f-8316-75afa54e8758 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:44.106391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 891/1763] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:43 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:44.111274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.225707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7843-9710-42c2-a6b2-79dcc5265d79 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:44.229844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:44.249861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.250546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.250827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.251101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.252416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.256908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.305026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 892/1764] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:44 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:44.309615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.322555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:44.341952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe374d-852a-4867-8fa6-251107148160 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:44.353582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.354681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.355024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.355237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.357815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.357815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.400816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 893/1765] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:44.404876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.427271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.428248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.428532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.428808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] PATH_INFO: `/v3/projects/ee4c325c34994ccd886a81b93f575260/users/87ea56e981164a768272ee130428a636/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.434113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4e13-c933-4ebc-b7e8-3c52271cfab9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:44.443752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4c325c34994ccd886a81b93f575260, user_id=87ea56e981164a768272ee130428a636, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.446091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.446808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.461237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.461237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.461237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.461237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.466849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d776-6b48-408c-84c9-e07cf39c9920 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.497591 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 894/1766] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:44.499810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.536209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 873/1767] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:44 2022] PUT /identity/v3/projects/ee4c325c34994ccd886a81b93f575260/users/87ea56e981164a768272ee130428a636/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:44.550303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58f39-fcbc-4790-8584-ee321fb5c218 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.550662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbb257-8bea-438f-acb5-516a68c190f6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:44.551227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58f39-fcbc-4790-8584-ee321fb5c218 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.554091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58f39-fcbc-4790-8584-ee321fb5c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.680678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e8b58f39-fcbc-4790-8584-ee321fb5c218 None None] MFA Rules not processed for user `87ea56e981164a768272ee130428a636`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:44.686236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8b58f39-fcbc-4790-8584-ee321fb5c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:44.781221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:44.782175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.782460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.782738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] PATH_INFO: `/v3/projects/4f96f137c6d949369a676019a3ea5c09/users/6444d4847f6e49edb68485980d3012d2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.843637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f96f137c6d949369a676019a3ea5c09, user_id=6444d4847f6e49edb68485980d3012d2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:44.852128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:44.893547 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 895/1768] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:44 2022] PUT /identity/v3/projects/4f96f137c6d949369a676019a3ea5c09/users/6444d4847f6e49edb68485980d3012d2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:44.899743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 874/1769] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:44.905734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:44.906303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:44.906751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:44.911864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:44.916895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:44.982593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] MFA Rules not processed for user `6444d4847f6e49edb68485980d3012d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:44.984848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:45.214445 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 875/1770] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:45.219534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:45.224504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:45.228415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f59-847e-4eef-aa63-3887b7fa7160 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:45.236809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:45.237858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:45.239466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:45.240512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] PATH_INFO: `/v3/projects/d84fd01fc63e454797a06b516a0cf7e8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:45.242579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84fd01fc63e454797a06b516a0cf7e8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:45.245149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:45.393912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:45.395742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84fd01fc63e454797a06b516a0cf7e8', 'request_id': 'req-44247dae-b0ff-4ee5-829c-7032184a2d05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:45.435666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84fd01fc63e454797a06b516a0cf7e8', 'request_id': 'req-44247dae-b0ff-4ee5-829c-7032184a2d05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:45.459957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84fd01fc63e454797a06b516a0cf7e8', 'request_id': 'req-44247dae-b0ff-4ee5-829c-7032184a2d05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:45.475816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:45.495494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca32c72-f3b3-434f-8465-bd8f325cfa87 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:45.522347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] The token cache is being invalidate because project d84fd01fc63e454797a06b516a0cf7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:45.523226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:45.527692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:45.532985 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 896/1771] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:44 2022] DELETE /identity/v3/projects/d84fd01fc63e454797a06b516a0cf7e8 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:45.535910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:45.543742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:45.701378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:45.702052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:45.702332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:45.702616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:45.710643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:45.805921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44247dae-b0ff-4ee5-829c-7032184a2d05 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:45.812996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:45.813838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:45.814127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:45.814716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:45.815239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:45.817985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadb61e-ffd3-4f00-8ac2-c9a4e2a276c4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:45.919824 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 897/1772] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:45 2022] POST /identity/v3/projects => generated 387 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:45.921230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236e36-aa57-4801-acde-8e10127b34b4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:45.921526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236e36-aa57-4801-acde-8e10127b34b4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:45.921798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb236e36-aa57-4801-acde-8e10127b34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:45.999724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cb236e36-aa57-4801-acde-8e10127b34b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:46.001220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb236e36-aa57-4801-acde-8e10127b34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:46.016500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:46.018303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:46.064866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 876/1773] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 850 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:46.066156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:46.111172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179fc3b-89b1-430e-ade2-075586576010 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:46.299314 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 898/1774] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:46.304333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.307038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.307417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.319192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 899/1775] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:52:46 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:46.320195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:46.343641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:46.386269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:46.387071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.387409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.387709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.388572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:46.390527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7738d-06e5-406b-8b4f-feafc63cdc82 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:46.453174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a7ca-edf8-45c5-9e11-80e6eb4ea19f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:46.479160 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 877/1776] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:46 2022] POST /identity/v3/users => generated 300 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:46.484803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.486830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.487417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.490201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:46.494560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.495762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.497943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] PATH_INFO: `/v3/projects/f1533927111744ae9f05405d1240b77c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.501696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1533927111744ae9f05405d1240b77c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:46.512058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:46.522413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:46.578966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:46.585530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:46.623927 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 878/1777] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:46.625195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:46.663006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5669c5-6629-421d-b38a-87fa1435085f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:46.708662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1533927111744ae9f05405d1240b77c', 'request_id': 'req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:46.730254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1533927111744ae9f05405d1240b77c', 'request_id': 'req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:46.745054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1533927111744ae9f05405d1240b77c', 'request_id': 'req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:46.776458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] The token cache is being invalidate because project f1533927111744ae9f05405d1240b77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:46.777140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:46.779309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:46.787571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 900/1778] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:46 2022] DELETE /identity/v3/projects/f1533927111744ae9f05405d1240b77c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:46.787571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:46.794519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:46.810464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:46.848146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:46.850066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.850527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.850995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.851891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:46.855450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91eba-1f56-43a8-9659-f55be4a55588 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:46.891251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 879/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:46.891251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:46.892927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:46.892927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:46.959219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:46.961101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:46.995886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 880/1780] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:46.997195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:47.001017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:47.034183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377583-8c8f-4d67-ac6c-f0c41c1b34ae None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.034870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ecbbd-8d13-4c2c-8074-19fe7c39df20 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.053936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.056643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.058412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.059463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.064188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.065568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] PATH_INFO: `/v3/projects/c5ec4a876dc4481bb5d77554b28861e4/users/fafea124f8b64e40a17cca01eacec39d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.068028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.068352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.069174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:47.073908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:47.081228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a277e-53e6-4b8b-b329-9af3cae67e09 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:47.133090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 901/1781] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:47.134618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.134908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.135188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.142090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ec4a876dc4481bb5d77554b28861e4, user_id=fafea124f8b64e40a17cca01eacec39d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:47.151999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:47.208848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:47.209171 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 881/1782] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:46 2022] PUT /identity/v3/projects/c5ec4a876dc4481bb5d77554b28861e4/users/fafea124f8b64e40a17cca01eacec39d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:47.210172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:47.213344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:47.492332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1f14-5823-4cf0-8d99-2295eb8717b4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.524513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.526878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.527155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.527432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.530774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 902/1783] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:47.536429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:47.536752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:47.545822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:47.592155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86637a94-eb12-4a64-bcc2-2e784f1ca9f0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.603677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.606336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.606750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.607261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.608250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:47.610632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0562f30-02bf-40d5-869c-7308b7ddfeef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:47.653013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 903/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:47.655551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.655943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.656241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.674756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 882/1785] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:47 2022] POST /identity/v3/projects => generated 373 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:47.686270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:47.709112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:47.710998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:47.830665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 904/1786] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:47.835021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:47.840381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:47.881550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:47.920552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408c3d-9a96-454c-a93f-bb8068376638 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.921523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea85c6f-fa5e-4700-8c44-5e65f60b9f2e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:47.932294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.940090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.941075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.941669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:47.942119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.942393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:47.942687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:47.943271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:47.944201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:47.946264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:47.950151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:47.952441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:47.988518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:47.998324 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 883/1787] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:48.000190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:48.061607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041928cf-f1f8-402c-9785-68028ce91dbb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:48.075805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:48.076700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.076964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.077237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] PATH_INFO: `/v3/projects/c5ec4a876dc4481bb5d77554b28861e4/users/fafea124f8b64e40a17cca01eacec39d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.081966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ec4a876dc4481bb5d77554b28861e4, user_id=fafea124f8b64e40a17cca01eacec39d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:48.089786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:48.133926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:48.144335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9f005-7938-498a-b25f-349430b0f3d1 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:48.150021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 884/1788] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:47 2022] PUT /identity/v3/projects/c5ec4a876dc4481bb5d77554b28861e4/users/fafea124f8b64e40a17cca01eacec39d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:48.163588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:48.195174 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 905/1789] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:48.201254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6b33-5fe4-4320-9e3a-90349a234c58 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.201254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6b33-5fe4-4320-9e3a-90349a234c58 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.201559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6b33-5fe4-4320-9e3a-90349a234c58 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.208421 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 906/1790] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:52:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:52:48.210799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6b33-5fe4-4320-9e3a-90349a234c58 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:48.430213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06dd16-93c1-4329-9bce-24f73857492a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:48.449432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:48.450739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.451200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.451665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.452894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:48.458676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7aaa-4eff-4732-92fa-27c83497688f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:48.475171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6b33-5fe4-4320-9e3a-90349a234c58 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:48.535990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:48.548753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.550540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.551251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.553306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:48.560460 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 885/1791] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:48 2022] POST /identity/v3/users => generated 287 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:48.571017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553685-a7f9-441d-b2c2-598a7dc0aaad None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.571252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553685-a7f9-441d-b2c2-598a7dc0aaad None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.576022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98553685-a7f9-441d-b2c2-598a7dc0aaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.622454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:48.741825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-98553685-a7f9-441d-b2c2-598a7dc0aaad None None] MFA Rules not processed for user `fafea124f8b64e40a17cca01eacec39d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:48.745553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-98553685-a7f9-441d-b2c2-598a7dc0aaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:48.755079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 907/1792] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:48 2022] POST /identity/v3/projects => generated 373 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:48.756169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:48.969108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848054d7-9704-4012-829d-b1b7d55e2dd3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:48.989628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:48.990468 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 886/1793] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:48.991649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.991969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.992260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:48.997981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:48.998285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:48.998638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.026501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.029498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.082638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 908/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:49.085426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.085958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:49.088835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:49.092937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:49.118521 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 887/1795] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:52:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:49.120017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.178414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:49.258733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:49.284984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb0aac-625d-45b3-bb81-fb3d86d695e7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.296158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.296924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.297212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.297574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.298224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.299997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.320817 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 888/1796] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:49.321674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.355420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4507ba6-2065-4593-a5bc-6c4cb335a34f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.370046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.371198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.371487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.371796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.372504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.379945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.394970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9904-9e03-434a-9ecd-fb27cad72225 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.406573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.409276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.410919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.412346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] PATH_INFO: `/v3/projects/7f37a307cd1843549d1e715ed0ee917c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.416522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f37a307cd1843549d1e715ed0ee917c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.421271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.422941 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 889/1797] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:49 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:49.424105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.426269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:49.466058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df3c14-4467-49a5-8abc-fd5893053af3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.492370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.493186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.493586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.494057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.564060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f37a307cd1843549d1e715ed0ee917c', 'request_id': 'req-824753e1-fdab-4e17-8314-d173c6eba489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:49.575742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f37a307cd1843549d1e715ed0ee917c', 'request_id': 'req-824753e1-fdab-4e17-8314-d173c6eba489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:49.590189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f37a307cd1843549d1e715ed0ee917c', 'request_id': 'req-824753e1-fdab-4e17-8314-d173c6eba489'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:49.631301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] The token cache is being invalidate because project 7f37a307cd1843549d1e715ed0ee917c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:49.631923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:49.633795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:49.644150 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 909/1798] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:49 2022] DELETE /identity/v3/projects/7f37a307cd1843549d1e715ed0ee917c => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:49.645453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.648320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:49.744248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.746184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.775926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 890/1799] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:49.778138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.797489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d68d-78ba-4e6f-81c5-ad9b4ac83c6d service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.831705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824753e1-fdab-4e17-8314-d173c6eba489 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.839965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.840883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.841349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.841774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.842822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.845735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.863417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 910/1800] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:49.863417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.868100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:49.913814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bae5f-a186-49ec-951f-05e82f951a33 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:49.921046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.923067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.923537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.924107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] PATH_INFO: `/v3/users/c5ca7127b38940269836120b64656004` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.925969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ca7127b38940269836120b64656004)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.929011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.937043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:49.940576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:49.940576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:49.940965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:49.948690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:49.951011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:49.983177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 891/1801] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:49.985304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:49.990627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:50.063731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ca7127b38940269836120b64656004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:50.065756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:50.093800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ca7127b38940269836120b64656004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:50.094876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ca7127b38940269836120b64656004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:50.103434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ca7127b38940269836120b64656004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:50.119561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:50.166912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ca7127b38940269836120b64656004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:50.207739 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 911/1802] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:49 2022] DELETE /identity/v3/users/c5ca7127b38940269836120b64656004 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:50.209311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:50.214791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:50.244290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619234d9-8d2b-4029-89b5-3d01a978c11b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:50.345284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:50.346672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.347210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.347700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.350439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:50.366977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:50.369221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:50.413028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 892/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:50.416679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:50.420556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:50.464737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cc20-2dda-40fc-9502-89272cb2447b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:50.479991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:50.482499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.484263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.484880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] PATH_INFO: `/v3/projects/1a174f779b9f457f8c9be5c07d5e2e6b/users/045b0be223e6429eaf1189db63581bf9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.537475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a174f779b9f457f8c9be5c07d5e2e6b, user_id=045b0be223e6429eaf1189db63581bf9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:50.545002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4aa49-82e9-46da-9eb8-a84eacd6dc43 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:50.582701 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 912/1804] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:50 2022] PUT /identity/v3/projects/1a174f779b9f457f8c9be5c07d5e2e6b/users/045b0be223e6429eaf1189db63581bf9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:50.601419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.602085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.603224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.679945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b8975-ddf1-4f6d-82cf-786c6328bb8b service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:50.689413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] MFA Rules not processed for user `045b0be223e6429eaf1189db63581bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:50.692364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:50.870848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:50.871589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.872214 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 913/1805] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:50.872654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.874101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:50.874306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.875944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:50.879040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:50.881582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:50.902921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767667a-9a68-4957-b32e-0768484c12c7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:50.903648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 893/1806] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:50.910289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:50.919900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:50.921144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.921599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.922119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.923189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:50.930653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:50.931840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e67758-e724-41fc-a65a-26c734fa311d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:50.940791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:50.942334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:50.942852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:50.943799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] PATH_INFO: `/v3/projects/b5a66410551e4ce78d9c492b20a70379/users/817a1c522a084c3fa1d996b9ea743700/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:50.974854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a66410551e4ce78d9c492b20a70379, user_id=817a1c522a084c3fa1d996b9ea743700, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:50.978752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40692-ee83-4420-b586-f75bc0dc77b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:50.996716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 914/1807] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:50 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:50.998417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.003807 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 894/1808] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:50 2022] PUT /identity/v3/projects/b5a66410551e4ce78d9c492b20a70379/users/817a1c522a084c3fa1d996b9ea743700/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:51.019672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.020042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.020335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.032447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:51.090764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] MFA Rules not processed for user `817a1c522a084c3fa1d996b9ea743700`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:51.094596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:51.203010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8c93-0bd3-4908-a4a0-9b0cc3cc7922 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.311935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 895/1809] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:51.316788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.428660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.432204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.432608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.433040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.441439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.461349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.541835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 915/1810] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:50 2022] POST /identity/v3/users => generated 293 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:51.543867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.562185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7f42-59cb-4c98-8dfe-9be4ff2fc954 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.562756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b20a8-caf7-48b3-b3a5-deda94f12b55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.580563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.582062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.582496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.582927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.585249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.586133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.586959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.587248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.587540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.588344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.592317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.592957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.619947 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 916/1811] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:51.621220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.645368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf7122-a802-491b-9d92-f4ce2787e7a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.660386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.661388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.661757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.662040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] PATH_INFO: `/v3/projects/e148a1d03f534f83bf1113542f7def65/users/c05cd331a8434278997a25318a856901/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.676383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 896/1812] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:51.682905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.699065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e148a1d03f534f83bf1113542f7def65, user_id=c05cd331a8434278997a25318a856901, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.702018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.732094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 917/1813] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:51 2022] PUT /identity/v3/projects/e148a1d03f534f83bf1113542f7def65/users/c05cd331a8434278997a25318a856901/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:51.733338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.847325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:51.877291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ccc9f-07ad-482f-878e-8bf8b2b56778 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.888610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.890049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.890049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.890276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feeeb4-992c-4e89-a945-e7bd108b33b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.890418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.890851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.892900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.906152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.909515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.911626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.912421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.915237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.920691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:51.926511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 918/1814] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:51.927982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.959764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8b7d-88ef-4b87-a596-df7532f6ef58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:51.975343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:51.976583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:51.979089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:51.979386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] PATH_INFO: `/v3/projects/e148a1d03f534f83bf1113542f7def65/users/c05cd331a8434278997a25318a856901/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:51.983239 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 897/1815] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:51 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:51.985119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e148a1d03f534f83bf1113542f7def65, user_id=c05cd331a8434278997a25318a856901, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:51.986442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:51.992653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffec15-0279-4c99-9841-16d5eb4a3f89 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:52.011069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:52.017966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d2aa-2bbd-4385-b1fe-e693bc13fa6d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.033355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 919/1816] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:51 2022] PUT /identity/v3/projects/e148a1d03f534f83bf1113542f7def65/users/c05cd331a8434278997a25318a856901/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:52.035367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.035713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.035996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.103400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] MFA Rules not processed for user `c05cd331a8434278997a25318a856901`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:52.104729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:52.258411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.259448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.259846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.260370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.261044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:52.267888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 920/1817] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:52:52.274618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:52.309241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:52.312114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:52.336003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 898/1818] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:52.339337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:52.361053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99109b48-6b98-4397-b3f1-21202e18feb8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.373707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.373707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.373707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.373707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] PATH_INFO: `/v3/projects/69b33db63c5e424b94c673b74c1e9ddd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.377040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b33db63c5e424b94c673b74c1e9ddd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:52.381352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:52.401707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59649b1-c0c0-4349-94c3-72b5c30073f5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.415640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.417278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.420285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.420763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] PATH_INFO: `/v3/projects/c6d67b538d474c6c8bac76cc0447660d/users/1a767c507b2e4b57890efe462797121b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.478515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d67b538d474c6c8bac76cc0447660d, user_id=1a767c507b2e4b57890efe462797121b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:52.484628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:52.528280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b33db63c5e424b94c673b74c1e9ddd', 'request_id': 'req-02ad3207-b650-45ca-a648-ed3a72173f59'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:52.535321 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 899/1819] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:52 2022] PUT /identity/v3/projects/c6d67b538d474c6c8bac76cc0447660d/users/1a767c507b2e4b57890efe462797121b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:52.539869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:52.549824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b33db63c5e424b94c673b74c1e9ddd', 'request_id': 'req-02ad3207-b650-45ca-a648-ed3a72173f59'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:52.606021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b33db63c5e424b94c673b74c1e9ddd', 'request_id': 'req-02ad3207-b650-45ca-a648-ed3a72173f59'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:52.666175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] The token cache is being invalidate because project 69b33db63c5e424b94c673b74c1e9ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:52.666679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:52.667730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:52.670187 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 921/1820] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:52 2022] DELETE /identity/v3/projects/69b33db63c5e424b94c673b74c1e9ddd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:52:52.672325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:52.675350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:52.741757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8507d-cb5c-4dfa-907f-f377e758593e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.759647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.760751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.761192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.761653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.762750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:52.764647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:52.789919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 900/1821] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:52.791219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:52.793419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:52.850426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:52.890123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7e7d2-ded1-4597-84b5-7a7becd924bb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.914414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.915226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.915647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.916617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.918156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:52.943066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad3207-b650-45ca-a648-ed3a72173f59 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:52.971293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:52.975960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:52.976434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:52.977258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] PATH_INFO: `/v3/users/6444d4847f6e49edb68485980d3012d2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:52.982307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6444d4847f6e49edb68485980d3012d2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:52.993509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:53.032577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:53.094034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:53.096306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:53.121968 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 901/1822] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:53.124711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:53.129257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:53.179454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0695-e9bb-430a-847c-a482c17d3d2a service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:53.215678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:53.216899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:53.217291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:53.217836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] PATH_INFO: `/v3/users/eb36771148154ae3838163db5b2ae24b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:53.218081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6444d4847f6e49edb68485980d3012d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.221535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb36771148154ae3838163db5b2ae24b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:53.223875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:53.243629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6444d4847f6e49edb68485980d3012d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.245283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6444d4847f6e49edb68485980d3012d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.246666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6444d4847f6e49edb68485980d3012d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.283906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6444d4847f6e49edb68485980d3012d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.317757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 922/1823] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:52 2022] DELETE /identity/v3/users/6444d4847f6e49edb68485980d3012d2 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:53.321512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:53.326707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:53.385363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb36771148154ae3838163db5b2ae24b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.388144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb36771148154ae3838163db5b2ae24b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.416471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb36771148154ae3838163db5b2ae24b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.420307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb36771148154ae3838163db5b2ae24b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.483006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb36771148154ae3838163db5b2ae24b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:53.494976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549a629-92bb-48dd-9216-154de0eea578 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:53.515327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:53.516218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:53.516552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:53.516857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] PATH_INFO: `/v3/projects/c6d67b538d474c6c8bac76cc0447660d/users/1a767c507b2e4b57890efe462797121b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:53.522334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d67b538d474c6c8bac76cc0447660d, user_id=1a767c507b2e4b57890efe462797121b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:53.528699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e59046-a8ba-4fdf-9e01-d1b440720f3e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:53.545930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 902/1824] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:53 2022] DELETE /identity/v3/users/eb36771148154ae3838163db5b2ae24b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:53.567459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:53.567459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:53.569156 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 923/1825] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:53 2022] PUT /identity/v3/projects/c6d67b538d474c6c8bac76cc0447660d/users/1a767c507b2e4b57890efe462797121b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:53.571674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b667-3377-425a-aa02-a605bc4e6f72 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:53.572241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b667-3377-425a-aa02-a605bc4e6f72 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:53.572763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b667-3377-425a-aa02-a605bc4e6f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:53.651501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4e91b667-3377-425a-aa02-a605bc4e6f72 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:53.654268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4e91b667-3377-425a-aa02-a605bc4e6f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:53.756852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:53.825973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5497b9-77a9-4c3a-a9a3-39683e951981 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:53.860030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 924/1826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:53.860030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:53.860030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:53.860367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:53.928107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] MFA Rules not processed for user `1a767c507b2e4b57890efe462797121b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:53.931571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:53.950551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:53.997977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:53.998683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:53.998967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:53.999243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:54.003360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:54.165985 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 925/1827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:54.167007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:54.176255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:54.207748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:54.215098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:54.262732 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 903/1828] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:54.353547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:54.356642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:54.397597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8d3f4-1fcb-4dc8-9330-082544472fde service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:54.397826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16992f-77e5-457c-b0af-e6cd0e5a035d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:54.416147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:54.418963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:54.419873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:54.420368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:54.420884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:54.420998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:54.421299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:54.421742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:54.457787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:54.459343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:54.461066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:54.467964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:54.490863 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 926/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:54.537218 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 904/1830] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:52:55.209054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:55.210505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:55.242650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a348eb-ef5d-4489-8c94-628745765780 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:55.257861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:55.258858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:55.259143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:55.259530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] PATH_INFO: `/v3/users/045b0be223e6429eaf1189db63581bf9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:55.261829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] RBAC: Authorizing `identity:delete_user(user_id=045b0be223e6429eaf1189db63581bf9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:55.279093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:55.280881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:55.286972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:55.326760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ff12-f887-42b3-98fd-419419137e08 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:55.346154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:55.348572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:55.353573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:55.353933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] PATH_INFO: `/v3/users/a4a4d09ab8484e458a96593fcbfdcbbd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:55.364671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a4d09ab8484e458a96593fcbfdcbbd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:55.385002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:55.500056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045b0be223e6429eaf1189db63581bf9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.536354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045b0be223e6429eaf1189db63581bf9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.540768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045b0be223e6429eaf1189db63581bf9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.543608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045b0be223e6429eaf1189db63581bf9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.594470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a4d09ab8484e458a96593fcbfdcbbd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.601360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a4d09ab8484e458a96593fcbfdcbbd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.618919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045b0be223e6429eaf1189db63581bf9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.630729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a4d09ab8484e458a96593fcbfdcbbd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.635738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a4d09ab8484e458a96593fcbfdcbbd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.666241 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 927/1831] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:55 2022] DELETE /identity/v3/users/045b0be223e6429eaf1189db63581bf9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:55.670635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:55.674636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:55.680115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:55.696067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c245b160-5ded-4d5d-bffc-66e61dfb36c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a4d09ab8484e458a96593fcbfdcbbd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:55.761689 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 905/1832] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:55 2022] DELETE /identity/v3/users/a4a4d09ab8484e458a96593fcbfdcbbd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:52:55.773476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:55.774156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:55.776944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:55.827020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:55.872578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:55.874420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:55.954117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a69de-7e79-4336-8372-f782f45f887c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:56.080376 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 906/1833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:56.081631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:56.084821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.114410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51358d9-3ae9-4eda-8283-c0f875632255 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:56.128556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:56.129940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.131073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.131947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:56.132370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] PATH_INFO: `/v3/projects/5dfebfcbd66a448ab244276f70531d0d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.133495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.134506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.135801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] PATH_INFO: `/v3/projects/4f96f137c6d949369a676019a3ea5c09` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.136031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfebfcbd66a448ab244276f70531d0d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:56.138724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f96f137c6d949369a676019a3ea5c09)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:56.140445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:56.142835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:56.275453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfebfcbd66a448ab244276f70531d0d', 'request_id': 'req-81391119-7af5-4fdd-8831-dbcbc69849b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.290142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfebfcbd66a448ab244276f70531d0d', 'request_id': 'req-81391119-7af5-4fdd-8831-dbcbc69849b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.292299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f96f137c6d949369a676019a3ea5c09', 'request_id': 'req-f2caa294-2466-4ccb-b300-a01ff451f0f3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.304982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f96f137c6d949369a676019a3ea5c09', 'request_id': 'req-f2caa294-2466-4ccb-b300-a01ff451f0f3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.306987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfebfcbd66a448ab244276f70531d0d', 'request_id': 'req-81391119-7af5-4fdd-8831-dbcbc69849b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.326738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f96f137c6d949369a676019a3ea5c09', 'request_id': 'req-f2caa294-2466-4ccb-b300-a01ff451f0f3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.351688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] The token cache is being invalidate because project 5dfebfcbd66a448ab244276f70531d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:56.352152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.353809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-81391119-7af5-4fdd-8831-dbcbc69849b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.365417 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 907/1834] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:56 2022] DELETE /identity/v3/projects/5dfebfcbd66a448ab244276f70531d0d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:56.368836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5772414-daba-41f8-812d-1d6404a26831 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.369327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5772414-daba-41f8-812d-1d6404a26831 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.370098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5772414-daba-41f8-812d-1d6404a26831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.372795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] The token cache is being invalidate because project 4f96f137c6d949369a676019a3ea5c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:56.373099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.374063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.378034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 928/1835] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:55 2022] DELETE /identity/v3/projects/4f96f137c6d949369a676019a3ea5c09 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:56.379769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:56.382731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.428033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f5772414-daba-41f8-812d-1d6404a26831 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:56.429300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f5772414-daba-41f8-812d-1d6404a26831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.545542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa294-2466-4ccb-b300-a01ff451f0f3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:56.557046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:56.557810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.558099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.558402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.566432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.586675 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 908/1836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:56.591218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.591708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.591856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.597150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:56.618885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:56.650343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:56.650343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.688845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 909/1837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:56.693879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:56.698084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:56.718828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc4d21-86b1-4fe2-9a54-4cf529933538 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:56.730426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:56.731418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.732950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.737621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] PATH_INFO: `/v3/users/fafea124f8b64e40a17cca01eacec39d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.744436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafea124f8b64e40a17cca01eacec39d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:56.746543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:56.758940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:56.760486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:56.800291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 929/1838] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:56.801594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:56.834172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6afc5-4b4e-4900-afe4-58bb00df9815 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:56.853441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:56.854002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.854270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.854617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.886211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafea124f8b64e40a17cca01eacec39d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.895440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafea124f8b64e40a17cca01eacec39d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.897968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:56.899830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca920a-5b18-4055-8142-faa2e6e9faf4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:56.916406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafea124f8b64e40a17cca01eacec39d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.923313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafea124f8b64e40a17cca01eacec39d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:56.940376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 930/1839] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:56.949716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:56.950075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:56.950364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:56.973885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d1667da8-1d14-437e-a4b4-c3aa9e81ab37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafea124f8b64e40a17cca01eacec39d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:57.003407 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 910/1840] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:56 2022] DELETE /identity/v3/users/fafea124f8b64e40a17cca01eacec39d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:57.005339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.005697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.019713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.028553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:57.031466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.105033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] MFA Rules not processed for user `23217a2f30944c4eb4de3164e8f35416`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:57.108819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.192454 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 931/1841] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:57.193480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.207027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e861e-4367-4c3d-9aeb-05b57209cb81 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.214633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.215664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.215927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.216201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.217300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:57.217656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.220289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.250084 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 932/1842] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:57.255940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.275056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516fbe-43aa-4c98-8f10-973235aacc6d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.282348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.283905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.284394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.284953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.286038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.288835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.315491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 911/1843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:57.328031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.329530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.339686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 933/1844] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:57 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:57.340695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.452134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:57.463146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c98d-9019-42b2-9b5a-044db53ee12d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.469444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.470341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.471786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.472229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.473094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.475059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.484662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:57.486255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65299b3-22e3-49d8-9ad0-9045e6a7b253 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.508330 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 934/1845] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:57 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:57.512497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.529037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be9f04-7e80-4b53-93ce-6fdc1eaccf89 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.562771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.563596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.563783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.564387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.565836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.573104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.593324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 935/1846] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:57.597973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.616808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bada3-9cd4-49ec-a849-2cf907b86471 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.624034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.624828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.625028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.625530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.626412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.629164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.652297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 936/1847] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:57.653375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.666110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.666793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.667076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.667354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.670049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ae3f-f52d-457c-bc94-a54ef3506c3d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.672683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.676755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.677671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.677953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.678243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] PATH_INFO: `/v3/projects/933dac39a88a4f38ab3de23c3066b2e5/users/86b34f19ba0d4537bd70272e19916917/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.697577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=933dac39a88a4f38ab3de23c3066b2e5, user_id=86b34f19ba0d4537bd70272e19916917, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.701001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.721806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 937/1848] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:57 2022] PUT /identity/v3/projects/933dac39a88a4f38ab3de23c3066b2e5/users/86b34f19ba0d4537bd70272e19916917/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:57.725212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.737558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.811605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.813269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67330cad-8bc2-46f3-8382-3f267f8ce735 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.838481 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 912/1849] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:52:57.841030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.841601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.841601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.869874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce1a88-65cb-48ea-8d0c-f67ebce18ddd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:57.882074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:57.883538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:57.883768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:57.884055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] PATH_INFO: `/v3/projects/c5ec4a876dc4481bb5d77554b28861e4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:57.885407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ec4a876dc4481bb5d77554b28861e4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:57.887991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:57.896856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] MFA Rules not processed for user `86b34f19ba0d4537bd70272e19916917`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:57.898325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.972237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ec4a876dc4481bb5d77554b28861e4', 'request_id': 'req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:57.982379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ec4a876dc4481bb5d77554b28861e4', 'request_id': 'req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:57.987263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 913/1850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:57.987263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:57.987263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:57.992937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ec4a876dc4481bb5d77554b28861e4', 'request_id': 'req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.002765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4bdac-0baf-4d32-86cb-1986f3486135 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.010931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] The token cache is being invalidate because project c5ec4a876dc4481bb5d77554b28861e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:58.011217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.012086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.019891 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 938/1851] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:57 2022] DELETE /identity/v3/projects/c5ec4a876dc4481bb5d77554b28861e4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:58.019891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.020541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.030250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:58.078586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:58.081035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.082285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.082458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.082852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] PATH_INFO: `/v3/projects/a3b98c9704a043ea8089ae0910ca9053` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.084291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b98c9704a043ea8089ae0910ca9053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.086989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.130594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce27afe-8cc5-4e32-bcb7-fe55693464f9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.143916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b98c9704a043ea8089ae0910ca9053', 'request_id': 'req-bc76c50c-e587-4c16-9823-09176fd1b9df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.152945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b98c9704a043ea8089ae0910ca9053', 'request_id': 'req-bc76c50c-e587-4c16-9823-09176fd1b9df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.158540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b98c9704a043ea8089ae0910ca9053', 'request_id': 'req-bc76c50c-e587-4c16-9823-09176fd1b9df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.173479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] The token cache is being invalidate because project a3b98c9704a043ea8089ae0910ca9053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:58.174032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.175016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.176729 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 914/1852] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:57 2022] DELETE /identity/v3/projects/a3b98c9704a043ea8089ae0910ca9053 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:58.180160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.180160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.205088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.205780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.206080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.206359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.209991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.253328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c50c-e587-4c16-9823-09176fd1b9df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.258420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.259430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.259766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.260040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] PATH_INFO: `/v3/projects/1a174f779b9f457f8c9be5c07d5e2e6b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.262595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a174f779b9f457f8c9be5c07d5e2e6b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.263399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.301697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.303475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.317226 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 939/1853] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:58.318135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.320607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.334830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a174f779b9f457f8c9be5c07d5e2e6b', 'request_id': 'req-5c15276b-979f-4401-b680-19a0ba7b0932'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.337064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047fa29-ea79-49c9-9dff-57c57194150a service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.344277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a174f779b9f457f8c9be5c07d5e2e6b', 'request_id': 'req-5c15276b-979f-4401-b680-19a0ba7b0932'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.345406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:58.354096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a174f779b9f457f8c9be5c07d5e2e6b', 'request_id': 'req-5c15276b-979f-4401-b680-19a0ba7b0932'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.394124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] The token cache is being invalidate because project 1a174f779b9f457f8c9be5c07d5e2e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:58.394824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.396137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c15276b-979f-4401-b680-19a0ba7b0932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.399968 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 915/1854] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:58 2022] DELETE /identity/v3/projects/1a174f779b9f457f8c9be5c07d5e2e6b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:58.401348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.401727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.402121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.427384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:58.429291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.462685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.463376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.463702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.463977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.464676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.466797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.491474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:58.522452 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 940/1855] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:58 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:58.523847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.525681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.543896 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 916/1856] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:58.545200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.546993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.561578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88afd5-865c-4603-a0a7-c4945e5fa91d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.638703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b2e59-1421-4177-a75f-b815cfc38904 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:58.640821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.642682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.643206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.643817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] PATH_INFO: `/v3/users/c05cd331a8434278997a25318a856901` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.645439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05cd331a8434278997a25318a856901)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.648723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.654229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:58.655144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.655429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.655736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] PATH_INFO: `/v3/users/87ea56e981164a768272ee130428a636` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.662688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ea56e981164a768272ee130428a636)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:58.664874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:58.740052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05cd331a8434278997a25318a856901'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.740962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05cd331a8434278997a25318a856901'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.745870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ea56e981164a768272ee130428a636'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.753596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05cd331a8434278997a25318a856901'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.754732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05cd331a8434278997a25318a856901'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.755856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ea56e981164a768272ee130428a636'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.756926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ea56e981164a768272ee130428a636'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.758923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ea56e981164a768272ee130428a636'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.776563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d6c4eedd-6279-4f3b-a272-a27cdbbcd9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ea56e981164a768272ee130428a636'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.777902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05cd331a8434278997a25318a856901'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:58.800396 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 917/1857] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:58 2022] DELETE /identity/v3/users/c05cd331a8434278997a25318a856901 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:58.801798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:58.803538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.809777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:58.811422 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 941/1858] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:52:58 2022] DELETE /identity/v3/users/87ea56e981164a768272ee130428a636 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:58.812797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:58.813078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:58.813358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:58.851609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:52:58.855897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:58.936601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ddc4d-e108-4b28-b2c3-1ea85ea97c3a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.000518 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 942/1859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:52:59.005269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.027449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb48c3-1dd9-4806-a5e4-c77fd4c4cd5b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.055135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.057018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.061107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.065610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.067145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:52:59.067145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.072541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.079086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.080083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.080536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.081045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.081908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.086354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.090626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:59.106217 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 943/1860] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:52:59.114751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.129849 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 918/1861] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:58 2022] POST /identity/v3/users => generated 300 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:59.130995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.132848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:59.132982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd4ef-55aa-40b1-97eb-98efa76155ff admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.140395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.141167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.141738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.142247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.144421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.147447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.156010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303ffa8-854c-4e3a-a6af-8de881c8dce1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.170570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.171271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.171578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.171869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.172595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.177204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.191394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 944/1862] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:52:59 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:59.196264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.203354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 919/1863] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:52:59.207607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.233455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a77d3-2c34-477f-a2cc-4b00ce56efeb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.371498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566403-9c9d-4bc6-a123-db7a0792c6b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.381440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.382711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.384470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.385005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.385910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.389195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.390587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.390587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.390770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] PATH_INFO: `/v3/projects/968650b94cc44528b4f1628f52067f0a/users/ee008636c30d44ef95cc6877f8d3f1b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.397418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.408629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968650b94cc44528b4f1628f52067f0a, user_id=ee008636c30d44ef95cc6877f8d3f1b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.411369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.432521 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 920/1864] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:59 2022] PUT /identity/v3/projects/968650b94cc44528b4f1628f52067f0a/users/ee008636c30d44ef95cc6877f8d3f1b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:59.434092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.435782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:59.445711 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 945/1865] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:52:59 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:52:59.446683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.467166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540c162-a095-4265-8d69-8f5f4e7cf32d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.471329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:59.623824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0694c-f649-4bcb-a801-b216d8f62eb3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.629277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.630176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.630463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.630936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] PATH_INFO: `/v3/projects/e148a1d03f534f83bf1113542f7def65` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.632229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e148a1d03f534f83bf1113542f7def65)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.637063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.671068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.672449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.672449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.672449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.673132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.680408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.732822 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 946/1866] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:59.733815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.747995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e148a1d03f534f83bf1113542f7def65', 'request_id': 'req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:59.763892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e148a1d03f534f83bf1113542f7def65', 'request_id': 'req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:59.776685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62931be-35db-4b04-b51f-b09d4a2f7b67 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.780032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e148a1d03f534f83bf1113542f7def65', 'request_id': 'req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:59.807408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] The token cache is being invalidate because project e148a1d03f534f83bf1113542f7def65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:52:59.807728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:59.808946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:52:59.812718 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 921/1867] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:59 2022] DELETE /identity/v3/projects/e148a1d03f534f83bf1113542f7def65 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:59.813869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.815372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:59.877455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.878336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.878623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.878894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.880134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.881684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.884193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:59.901854 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 947/1868] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:52:59.902692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:59.904709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:59.919469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86b86-a7b0-4974-b994-897de911a43f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.927969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:59.928939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.929312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.929683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] PATH_INFO: `/v3/projects/968650b94cc44528b4f1628f52067f0a/users/ee008636c30d44ef95cc6877f8d3f1b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:59.936602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968650b94cc44528b4f1628f52067f0a, user_id=ee008636c30d44ef95cc6877f8d3f1b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:59.953077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30709f17-9896-4bca-bbd1-756e908a2c46 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:59.965670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca6d6-f09a-4576-98ac-eb2d95c8c27b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:59.979104 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 948/1869] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:52:59 2022] PUT /identity/v3/projects/968650b94cc44528b4f1628f52067f0a/users/ee008636c30d44ef95cc6877f8d3f1b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:52:59.986536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:59.986810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:59.987111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.030662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.031931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.044122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:00.059088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.060860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.061318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.061883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] PATH_INFO: `/v3/projects/ee4c325c34994ccd886a81b93f575260` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.063487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4c325c34994ccd886a81b93f575260)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.068319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.139899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 949/1870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.147088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.147572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.156210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4c325c34994ccd886a81b93f575260', 'request_id': 'req-4df648e7-525d-408d-be6f-5f8e9ff296a8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:00.168018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fac7d-76a9-4a29-96b8-a4c55dcf0335 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.170599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4c325c34994ccd886a81b93f575260', 'request_id': 'req-4df648e7-525d-408d-be6f-5f8e9ff296a8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:00.181598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4c325c34994ccd886a81b93f575260', 'request_id': 'req-4df648e7-525d-408d-be6f-5f8e9ff296a8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:00.206114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] The token cache is being invalidate because project ee4c325c34994ccd886a81b93f575260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:00.207419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:00.208538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4df648e7-525d-408d-be6f-5f8e9ff296a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:00.212101 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 922/1871] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:52:59 2022] DELETE /identity/v3/projects/ee4c325c34994ccd886a81b93f575260 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:00.214348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.214717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.215056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.241232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.242599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.243124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.243599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.244979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.246944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259a94a-fdd8-4840-8358-7935fd69b9d5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.255683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] MFA Rules not processed for user `ee008636c30d44ef95cc6877f8d3f1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.257470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.259895 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 950/1872] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:00.261494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55914a-6062-4694-bd08-4418d10a2258 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.261987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55914a-6062-4694-bd08-4418d10a2258 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.262623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55914a-6062-4694-bd08-4418d10a2258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.286420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7e55914a-6062-4694-bd08-4418d10a2258 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.288116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7e55914a-6062-4694-bd08-4418d10a2258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.301811 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 951/1873] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.303950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.304772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.305490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.330451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.334434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.348526 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 952/1874] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.349783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.351402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.370748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbdbad-a7d3-4658-b2fd-7cf00708cc5c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.380219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 923/1875] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.381511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.392102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.392838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.393130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.393420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] PATH_INFO: `/v3/projects/966c29cbde7542f4b537730a6fa7f550/users/68c0fa377ee24f049f034bb8ec13c5ed/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.397504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b0493-2b31-4bf3-b4fa-faa8ff54f960 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.404398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.405635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.406095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.406845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.407843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:00.408707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.411238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc986-ce02-46b8-a6ef-9d4fd0011eea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.414846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] RBAC: Authorizing `identity:create_grant(project_id=966c29cbde7542f4b537730a6fa7f550, user_id=68c0fa377ee24f049f034bb8ec13c5ed, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.418341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.437177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 924/1876] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:00.440032 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 953/1877] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:00 2022] PUT /identity/v3/projects/966c29cbde7542f4b537730a6fa7f550/users/68c0fa377ee24f049f034bb8ec13c5ed/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:00.440394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.440955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.441372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.441911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.442991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.469438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.471595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.513935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:00.537777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:00.564540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 925/1878] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.565557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.581608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940557f3-41d4-46df-9e4b-3d8fea98d106 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.587380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.588163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.588512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.588855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.589846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.592579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6f909-4c38-4961-b563-9607cc990a7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.595061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27872-b0e7-4772-93df-71a9f973164f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.602390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.603660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.603952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.604236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.640435 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 926/1879] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:00.643280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.643634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.643914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.685691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] MFA Rules not processed for user `68c0fa377ee24f049f034bb8ec13c5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:00.687316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:00.719984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.722870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.738987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 954/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:00.739983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.753022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60ad3-6851-4147-b51e-f6557df459c8 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.783699 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 927/1881] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:00.783699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.900980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.903034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f79f0-9703-4273-8e72-5a474514a59f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.903863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.904164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.904915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.906128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:00.906569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.908251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.917443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.918160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.918444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.918855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.919618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.925120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:00.941882 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 955/1882] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:00.942670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.963602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d793582-fdda-4312-9f20-31bf5a65e77e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:00.966793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 928/1883] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:00.970956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:00.980327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:00.980539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:00.983122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:00.983267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:00.985039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:00.987417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.042923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 956/1884] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:00 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:01.044314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.110831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:01.121397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:01.170491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7304f4-f671-458b-8b83-5347793aa75a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.215291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad079b44-1497-4da8-a700-3927b2d8cf84 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.221181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.221864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.222148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.222426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.223132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.225104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.268867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 957/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:01 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:01.271318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.283794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.284816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.285196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.285840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.289402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:01.367914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40872c81-37ad-4b33-a3ad-7b32f3ec9608 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.383728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.384439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.384765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.384992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.385725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.388160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.390891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.391123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0a90-c312-4430-bcb5-48bac44c8ad1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.406935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 929/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:01.407915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.411404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 958/1887] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:01.412957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.413253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.413534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.422740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddf084-423b-4346-a6b1-4610a908497a service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.427719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.428959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.429247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.429525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.430308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.432918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.437007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] MFA Rules not processed for user `90a9faf4a615437ca499c0ccbc1e7563`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:01.438408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:01.461413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 930/1888] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:01 2022] POST /identity/v3/users => generated 307 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:01.463428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.475088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba3a6b-c2ca-4c3c-a93e-79035f448672 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.482261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.483668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.484470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.484470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.484950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.487746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.531949 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 959/1889] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:01.533587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.542383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 931/1890] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:01 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:01.543410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.552186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb47f68-7728-4638-bfb4-01785a0911c2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.558971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880266c9-6230-466d-9d31-1e2470890fca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.559177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.559909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.560163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.560389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.561602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.567224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.567377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.567377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.567556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.568390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.569293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.570495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.584533 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 960/1891] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:01.585593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.588946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 932/1892] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:01.589850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.601942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe1825-5daf-4b85-926e-048b078694c1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.602825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cdb52-3419-4dfc-9434-2f8989b60ff8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.609068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.610884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.611676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.611959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.612240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.612974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.613947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.614248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.614550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] PATH_INFO: `/v3/projects/3c12cdfa245b4e51964e147c36dd535b/users/4b64dec19aae48c084025ce00eebb9ee/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.615620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.632284 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 961/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:01.633220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.650627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c0eb1-c7ad-42bf-b30f-6d9a282227ac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.650924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c12cdfa245b4e51964e147c36dd535b, user_id=4b64dec19aae48c084025ce00eebb9ee, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.654051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.659127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.660013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.660269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.669511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] PATH_INFO: `/v3/projects/1f9661db443648e691406aba59772bd1/users/bba28bc58a4a4650ab9100153ec72109/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.675905 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 933/1894] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:01 2022] PUT /identity/v3/projects/3c12cdfa245b4e51964e147c36dd535b/users/4b64dec19aae48c084025ce00eebb9ee/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:01.677119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.702669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9661db443648e691406aba59772bd1, user_id=bba28bc58a4a4650ab9100153ec72109, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.706379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256a463-24f6-425c-9f9b-1ef13198f641 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.715224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:01.730744 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 962/1895] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:01 2022] PUT /identity/v3/projects/1f9661db443648e691406aba59772bd1/users/bba28bc58a4a4650ab9100153ec72109/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:01.732326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.733172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.734002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.747316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:01.785413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04872ea3-570c-482e-81a5-a48410dfbf2a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.806516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] MFA Rules not processed for user `4b64dec19aae48c084025ce00eebb9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:01.808245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:01.921383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.922261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.922823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.923200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.924162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.926696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:01.941070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 934/1896] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:01.942107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.972813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663223c8-6c44-4deb-9f50-50e08cc52c2d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:01.982033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 963/1897] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:01.983035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:01.985355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:01.987198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:01.987853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:01.988260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:01.989162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:01.991529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.015213 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 935/1898] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:02.015405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8c25-5338-49aa-a17b-b06a746ae758 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.015548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.019408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.020366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.020972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.021247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] PATH_INFO: `/v3/projects/d4bdd7db3ff04de98130d93249a59c81/users/7abca2e5d53a43149dea438193357042/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.030467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63331dfa-c6cc-4389-93c5-cc3ccccbabc6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.041832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4bdd7db3ff04de98130d93249a59c81, user_id=7abca2e5d53a43149dea438193357042, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.044786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.053932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.055325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.055658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.055934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.057337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.072700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896377-dc36-4094-828b-937a36558d6c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.077225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 964/1899] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:01 2022] PUT /identity/v3/projects/d4bdd7db3ff04de98130d93249a59c81/users/7abca2e5d53a43149dea438193357042/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:02.078042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.129031 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 936/1900] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:02.130631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.130874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.131145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.181715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ccb03-81eb-4f81-9cc2-86a7477af413 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.197734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] MFA Rules not processed for user `7abca2e5d53a43149dea438193357042`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:02.202465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.255251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.256362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.256720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.257105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] PATH_INFO: `/v3/projects/1f9661db443648e691406aba59772bd1/users/bba28bc58a4a4650ab9100153ec72109/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.261017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9661db443648e691406aba59772bd1, user_id=bba28bc58a4a4650ab9100153ec72109, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.264349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.277125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 965/1901] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:02 2022] PUT /identity/v3/projects/1f9661db443648e691406aba59772bd1/users/bba28bc58a4a4650ab9100153ec72109/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:02.278127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.280020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.301242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.309095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 937/1902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:02.310298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.326174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db324e-960b-4bc6-8b98-5a89994b0762 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.337718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.390993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857374f-ea02-41a6-8454-3debb83ee608 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.404767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.408383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.409320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.409834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] PATH_INFO: `/v3/users/86b34f19ba0d4537bd70272e19916917` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.412406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b34f19ba0d4537bd70272e19916917)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.416916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.436084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.437454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.437939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.438387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.440953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.443229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6bb0-99e8-41b7-b515-bf4c49de1260 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.469686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 938/1903] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:02.472053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43515-028a-4db1-b527-107cd871e830 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.472568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43515-028a-4db1-b527-107cd871e830 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.472661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43515-028a-4db1-b527-107cd871e830 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.474636 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 939/1904] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:02.476028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.476354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.476635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.503672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b34f19ba0d4537bd70272e19916917'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:02.508664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] MFA Rules not processed for user `bba28bc58a4a4650ab9100153ec72109`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:02.512864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.514010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b34f19ba0d4537bd70272e19916917'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:02.521163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b34f19ba0d4537bd70272e19916917'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:02.522260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b34f19ba0d4537bd70272e19916917'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:02.554917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b34f19ba0d4537bd70272e19916917'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:02.589057 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 966/1905] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:02 2022] DELETE /identity/v3/users/86b34f19ba0d4537bd70272e19916917 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:02.590134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.592673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.651430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 940/1906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:02.653246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.655722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.683332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f65a-4fb0-450f-8cb1-9513415d43d4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.729767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec93a-bd1c-474e-ab0b-9bb4e5516bf1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.741606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.742478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.742773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.743051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.743880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.746096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fedaa-d607-4d6a-a938-238a54bfbc09 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.788388 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 967/1907] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:02.788388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.788388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.788388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.797947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.798869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.799275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.799592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.800494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.802185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cf0cc-7be7-47ff-a32a-88e519ee2061 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.815898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 941/1908] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:02.817672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.818138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.818599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.819942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:02.821322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.832986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.848325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:02.851254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.903054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.920889 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 968/1909] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:02.921783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.982448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 942/1910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:02.983635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.002208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e855-7518-49d3-9781-38bb9dbd9839 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.009606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.010598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.011023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.011637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] PATH_INFO: `/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0/users/d17515a1e761457cbade1df17df14315/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.044671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355dab2-eb83-47ff-97ae-f30842781b1c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.047655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adaf3cef7cb4f05a08846b680e02ef0, user_id=d17515a1e761457cbade1df17df14315, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.051637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.052618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.053135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.053487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.053657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.054609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.057066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.091199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 943/1911] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:02 2022] PUT /identity/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0/users/d17515a1e761457cbade1df17df14315/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:03.092571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.094639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.102346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 969/1912] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:02 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:03.102346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.104923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.127120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fd502-6a32-4f48-9bab-23c2d51970a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.198056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.199066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.199203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.199561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.205089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab0f-b7ae-4b94-81be-b30c4c11e480 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.208262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.210388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.212464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.213378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.213901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.223921 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 970/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:03.226396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.227630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.228429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.244752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815558a-61dd-49a4-a72b-8dbb67c32f29 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.252529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.256798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.257790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.258597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.347711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:03.366686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.370459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.371465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.378107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085955e-171e-4eb2-b0bc-66ffa3b59748 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.396162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 971/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:03.397150 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 944/1915] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:03.397981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.398610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed2ea-f590-4473-88ee-c7181d8d0e65 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.399111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed2ea-f590-4473-88ee-c7181d8d0e65 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.399627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed2ea-f590-4473-88ee-c7181d8d0e65 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.401632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 972/1916] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:03.402593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed2ea-f590-4473-88ee-c7181d8d0e65 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.418845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed2ea-f590-4473-88ee-c7181d8d0e65 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.424789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.425806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.426295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.426816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.427702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.429478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5df72-beae-4e6e-ad8e-1ad9b631d364 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.449571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 973/1917] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:03.453186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.453611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.453761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811b5d0-3637-4a8d-a9b9-086b950bca79 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.454190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.460153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.464942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.473349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.473950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.475641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.477569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.494262 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 945/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:03.495530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.515748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5e78-eb1c-445d-af9f-7f5924beb3ae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.522952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.524852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:03.525089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.525474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.525871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] PATH_INFO: `/v3/projects/7cb222f108c64fb6a885733337e192d0/users/9c4e30f31a06490fac7e63f31bfd7cc8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.528429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.553555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb222f108c64fb6a885733337e192d0, user_id=9c4e30f31a06490fac7e63f31bfd7cc8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.554657 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 974/1919] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:03.556192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.557637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.570350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825feccd-7d0d-4b30-ab42-cf23afd2fa3f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.574890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:03.576669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.577621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.578095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.578380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] PATH_INFO: `/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0/users/d17515a1e761457cbade1df17df14315/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.581767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adaf3cef7cb4f05a08846b680e02ef0, user_id=d17515a1e761457cbade1df17df14315, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.584811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488ff74-8837-42cd-b90d-c4057184137a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.591703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 946/1920] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:03 2022] PUT /identity/v3/projects/7cb222f108c64fb6a885733337e192d0/users/9c4e30f31a06490fac7e63f31bfd7cc8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:03.593675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.613830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 975/1921] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:03 2022] PUT /identity/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0/users/d17515a1e761457cbade1df17df14315/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:03.625771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.627114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.627114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.700188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] MFA Rules not processed for user `d17515a1e761457cbade1df17df14315`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:03.702238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.709256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb8cec-fca7-46eb-b598-5cb36a1208e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.817126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.818027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.818312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.818598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.819807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.823942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.840319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 947/1922] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:03.846129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.860389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bdc6e-7025-4dd1-8984-202c8f43bdd0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:03.874347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:03.875322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.875675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.875960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] PATH_INFO: `/v3/projects/7cb222f108c64fb6a885733337e192d0/users/9c4e30f31a06490fac7e63f31bfd7cc8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.878426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb222f108c64fb6a885733337e192d0, user_id=9c4e30f31a06490fac7e63f31bfd7cc8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:03.882896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604b97-f81e-4c48-819d-04d73dd9247b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:03.884622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 976/1923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:03.890018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:03.891561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.900934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 948/1924] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:03 2022] PUT /identity/v3/projects/7cb222f108c64fb6a885733337e192d0/users/9c4e30f31a06490fac7e63f31bfd7cc8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:03.913298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:03.913698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:03.914061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:03.947856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] MFA Rules not processed for user `9c4e30f31a06490fac7e63f31bfd7cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:03.950096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:03.994705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c8892-7c5f-45ad-9c37-6488eb1bbb2a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.035026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:04.072267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 949/1925] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:04.075670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.077225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.093541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:04.114332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.115152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.115523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.115894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.148897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.152428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:04.183875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01cb97-2a84-4996-84f4-642e08ed6a1e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.191411 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 977/1926] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:04.192198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.193223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.195046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.195371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] PATH_INFO: `/v3/projects/933dac39a88a4f38ab3de23c3066b2e5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.197427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933dac39a88a4f38ab3de23c3066b2e5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.199783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:04.279677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.293808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933dac39a88a4f38ab3de23c3066b2e5', 'request_id': 'req-19960705-0ed8-4b91-84fb-f7b9f74afe40'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.295704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571d003-7fa2-40a6-aa71-d37635da05b2 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.310309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933dac39a88a4f38ab3de23c3066b2e5', 'request_id': 'req-19960705-0ed8-4b91-84fb-f7b9f74afe40'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.338235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933dac39a88a4f38ab3de23c3066b2e5', 'request_id': 'req-19960705-0ed8-4b91-84fb-f7b9f74afe40'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.365590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] The token cache is being invalidate because project 933dac39a88a4f38ab3de23c3066b2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:04.365945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.367967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.380677 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 950/1927] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:04 2022] DELETE /identity/v3/projects/933dac39a88a4f38ab3de23c3066b2e5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:04.384948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.387651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.416918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.417972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.418106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.418391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.420974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.495113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19960705-0ed8-4b91-84fb-f7b9f74afe40 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.501967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.503413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.503756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.504029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] PATH_INFO: `/v3/users/ee008636c30d44ef95cc6877f8d3f1b9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.506594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee008636c30d44ef95cc6877f8d3f1b9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.508904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:04.516661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.519110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:04.535865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 978/1928] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:04.536773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.538744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.557949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d934-a0dd-4918-a5ee-817d565da164 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.567496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.568685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:04.569389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.569991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.570737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.570922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee008636c30d44ef95cc6877f8d3f1b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.571702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee008636c30d44ef95cc6877f8d3f1b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.574438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.586774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee008636c30d44ef95cc6877f8d3f1b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.593158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee008636c30d44ef95cc6877f8d3f1b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.634013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee008636c30d44ef95cc6877f8d3f1b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:04.669411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:04.676299 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 951/1929] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:04 2022] DELETE /identity/v3/users/ee008636c30d44ef95cc6877f8d3f1b9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:04.688373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.690200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.712644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.714663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:04.740596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 979/1930] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:04.870007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:04.871934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:04.892425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac064c-aad2-4c4c-847a-6c3ec1be0bc2 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.904853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a453d26-093f-4ac6-ac3a-d03afc83ca43 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:04.917082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:04.917987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:04.918270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:04.918547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] PATH_INFO: `/v3/users/4b64dec19aae48c084025ce00eebb9ee` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:04.921473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b64dec19aae48c084025ce00eebb9ee)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:04.923859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.020509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b64dec19aae48c084025ce00eebb9ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.021242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.021964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.022203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.022487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.022588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b64dec19aae48c084025ce00eebb9ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.026317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.035968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b64dec19aae48c084025ce00eebb9ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.037452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b64dec19aae48c084025ce00eebb9ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.053531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b64dec19aae48c084025ce00eebb9ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.081897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 952/1931] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:04 2022] DELETE /identity/v3/users/4b64dec19aae48c084025ce00eebb9ee => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:05.082678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.084109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.142455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.143303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:05.144795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31afea9-4d5f-4d44-be86-802302699856 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.161028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 980/1932] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:05.162787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.163145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.163357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.182540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:05.183989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.198421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c743-085f-4f67-9c5e-a3bb2377b2fc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:05.206530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.207224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.207536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.207858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.210610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.275929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 981/1933] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:05.276826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.284008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.303141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f726ae3-c2fb-4ed0-86e3-7f3302bc15f1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:05.308565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.309551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.310195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.310674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.311092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.311426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] PATH_INFO: `/v3/projects/968650b94cc44528b4f1628f52067f0a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.313091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] RBAC: Authorizing `identity:delete_project(project_id=968650b94cc44528b4f1628f52067f0a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.315919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.322543 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 953/1934] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:05.323802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.325213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.337266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:05.417491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968650b94cc44528b4f1628f52067f0a', 'request_id': 'req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.430800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968650b94cc44528b4f1628f52067f0a', 'request_id': 'req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.442519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d8e0-26c0-47df-8396-46b7f33eb756 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:05.446208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968650b94cc44528b4f1628f52067f0a', 'request_id': 'req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.477850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] The token cache is being invalidate because project 968650b94cc44528b4f1628f52067f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:05.478220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.479652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.482246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 982/1935] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:05 2022] DELETE /identity/v3/projects/968650b94cc44528b4f1628f52067f0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:05.482777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.488465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.562072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.563249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.563249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.563452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.566672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.608800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacfb01-f3a9-41e8-bb3a-9970b66e150e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:05.615459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.615459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.615459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.616516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] PATH_INFO: `/v3/users/68c0fa377ee24f049f034bb8ec13c5ed` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.620986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c0fa377ee24f049f034bb8ec13c5ed)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.623378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.678793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:05.718671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.723328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efcc26-96b9-4690-b8be-4e3f75c83198 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.731868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c0fa377ee24f049f034bb8ec13c5ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.745740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c0fa377ee24f049f034bb8ec13c5ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.745740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c0fa377ee24f049f034bb8ec13c5ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.745740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c0fa377ee24f049f034bb8ec13c5ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.750678 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 954/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:05.752445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ead7-d386-490a-b764-e8e2fa10b4ac None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.753178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ead7-d386-490a-b764-e8e2fa10b4ac None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.753677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01ead7-d386-490a-b764-e8e2fa10b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.766684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c0fa377ee24f049f034bb8ec13c5ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:05.784434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cd01ead7-d386-490a-b764-e8e2fa10b4ac None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:05.786065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cd01ead7-d386-490a-b764-e8e2fa10b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.788237 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 983/1937] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:05 2022] DELETE /identity/v3/users/68c0fa377ee24f049f034bb8ec13c5ed => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:05.789105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.791645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.821445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:05.869841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 955/1938] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:05.871204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aff88-1cad-4ff0-a138-ff3bf901d14b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.871493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aff88-1cad-4ff0-a138-ff3bf901d14b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.871847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719aff88-1cad-4ff0-a138-ff3bf901d14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.897433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302c77-8e5a-40f5-85fb-a0f7d4a0be63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:05.901360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-719aff88-1cad-4ff0-a138-ff3bf901d14b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:05.902885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-719aff88-1cad-4ff0-a138-ff3bf901d14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.905242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:05.906414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.906885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.907370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] PATH_INFO: `/v3/users/7abca2e5d53a43149dea438193357042` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.910594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abca2e5d53a43149dea438193357042)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:05.914402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:05.916139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 956/1939] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:05.918128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:05.919007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:05.919301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:05.959343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:05.960651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:05.972615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 957/1940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:05.974119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:05.977160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.024407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abca2e5d53a43149dea438193357042'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.052516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abca2e5d53a43149dea438193357042'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.054199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abca2e5d53a43149dea438193357042'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.055403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abca2e5d53a43149dea438193357042'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.078132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d20cd-179d-419e-abd9-bb4fd667b9a9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.084460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.085613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.086785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.086785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.088847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.103959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abca2e5d53a43149dea438193357042'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.122857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.126019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.148351 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 984/1941] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:05 2022] DELETE /identity/v3/users/7abca2e5d53a43149dea438193357042 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:06.150037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.151421 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 958/1942] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:06.152584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.153087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.154785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.190541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e94af-f3ba-4d05-a14f-afa7219c60df service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.273298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12f9aa-eb03-4031-942c-48d429e4b63a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.280173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.281139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.281627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.282122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.283284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:06.298607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.304570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7815-2005-4df5-a7f5-0e49ea8b6f65 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.321228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.323328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.323908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.324480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] PATH_INFO: `/v3/projects/3c12cdfa245b4e51964e147c36dd535b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.327172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c12cdfa245b4e51964e147c36dd535b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.331966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.345147 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 985/1943] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:06.347525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.350056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.351071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.385933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:06.386111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:06.387796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.400938 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 986/1944] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:06.402565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.436947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16063c26-ae2a-43a8-a268-d1006c9545f4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.467006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c12cdfa245b4e51964e147c36dd535b', 'request_id': 'req-cb1782b0-1a96-455f-89be-ba0656018c4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.479085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c12cdfa245b4e51964e147c36dd535b', 'request_id': 'req-cb1782b0-1a96-455f-89be-ba0656018c4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.482132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:06.496657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c12cdfa245b4e51964e147c36dd535b', 'request_id': 'req-cb1782b0-1a96-455f-89be-ba0656018c4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.576562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.580659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] The token cache is being invalidate because project 3c12cdfa245b4e51964e147c36dd535b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:06.582208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.583663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.584223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.584673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.586662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.587261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.589210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.595870 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 959/1945] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:06 2022] DELETE /identity/v3/projects/3c12cdfa245b4e51964e147c36dd535b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:06.601727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.606439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.654503 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 987/1946] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:06 2022] POST /identity/v3/projects => generated 395 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:06.657954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.662551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.719175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b0-1a96-455f-89be-ba0656018c4e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.808949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d633d-8fd6-462d-a0e1-3d8262700f58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.823058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.823993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.824887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.824887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] PATH_INFO: `/v3/users/d17515a1e761457cbade1df17df14315` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.829180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17515a1e761457cbade1df17df14315)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.832516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.849507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.850183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.850498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.850716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.863420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.888579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.894907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.907486 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 960/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:06.908730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.910119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.925980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c06a-4ec8-98ae-b0491f490118 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:06.934694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:06.935574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:06.935956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:06.936324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:06.937132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:06.940655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:06.954817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17515a1e761457cbade1df17df14315'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.976412 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 961/1948] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:06 2022] POST /identity/v3/users => generated 298 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:06.976412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:06.980733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:06.993556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17515a1e761457cbade1df17df14315'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.994716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17515a1e761457cbade1df17df14315'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:06.996054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17515a1e761457cbade1df17df14315'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.010759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c4784-8eb1-425e-9e59-dbed941321da admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.015051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17515a1e761457cbade1df17df14315'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.017108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.021238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.022015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.022450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] PATH_INFO: `/v3/projects/966c29cbde7542f4b537730a6fa7f550` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.025473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=966c29cbde7542f4b537730a6fa7f550)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.030486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.038771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 988/1949] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:06 2022] DELETE /identity/v3/users/d17515a1e761457cbade1df17df14315 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:07.038771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.040810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.098838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:07.124350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:07.136134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966c29cbde7542f4b537730a6fa7f550', 'request_id': 'req-c709dfa2-5044-49f9-bfd0-5e009a836bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.149166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966c29cbde7542f4b537730a6fa7f550', 'request_id': 'req-c709dfa2-5044-49f9-bfd0-5e009a836bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.160600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966c29cbde7542f4b537730a6fa7f550', 'request_id': 'req-c709dfa2-5044-49f9-bfd0-5e009a836bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.181252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] The token cache is being invalidate because project 966c29cbde7542f4b537730a6fa7f550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:07.181769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.182324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.185382 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 962/1950] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:06 2022] DELETE /identity/v3/projects/966c29cbde7542f4b537730a6fa7f550 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:07.189696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.192123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.203185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1d7c6-869f-4091-ba5b-6557592fcdb3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.337900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.339032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.339189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709dfa2-5044-49f9-bfd0-5e009a836bcc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.339331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.339716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.340601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.342233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.344338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.345352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.345639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.346525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] PATH_INFO: `/v3/users/bba28bc58a4a4650ab9100153ec72109` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.348547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba28bc58a4a4650ab9100153ec72109)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.350939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.355635 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 989/1951] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:07.368014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.370475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.392663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12526b-fca9-45e2-8111-f6b45b5c2136 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.399484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.400588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.401123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.401490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.402362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.404260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.416384 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 990/1952] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:07.420736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.422288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba28bc58a4a4650ab9100153ec72109'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.423952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba28bc58a4a4650ab9100153ec72109'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.432641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76f54-728a-431a-945e-06919e6fbf68 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.434374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba28bc58a4a4650ab9100153ec72109'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.435674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba28bc58a4a4650ab9100153ec72109'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.438396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.439929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.440271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.440625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] PATH_INFO: `/v3/projects/2d9304b76a754b31bb48d933a61eb508/users/66b6d873574540ad866d203f7a562270/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.452763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e2dd35e-4f3c-4e75-a279-bf318b297305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba28bc58a4a4650ab9100153ec72109'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.458577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9304b76a754b31bb48d933a61eb508, user_id=66b6d873574540ad866d203f7a562270, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.461725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.473230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 963/1953] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:07 2022] DELETE /identity/v3/users/bba28bc58a4a4650ab9100153ec72109 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:07.477737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 991/1954] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:07 2022] PUT /identity/v3/projects/2d9304b76a754b31bb48d933a61eb508/users/66b6d873574540ad866d203f7a562270/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:07.488320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.488616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.488905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.521155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] MFA Rules not processed for user `66b6d873574540ad866d203f7a562270`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:07.522458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.576395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:07.643584 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 964/1955] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:07.645276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.648680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.649560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.658804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.787410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c086-24fb-4099-a77e-7c5e597e58f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.800091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aae64-17d4-4892-a972-3e735072c36a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:07.810444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.811462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.811675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.811914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] PATH_INFO: `/v3/projects/d4bdd7db3ff04de98130d93249a59c81` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.813288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4bdd7db3ff04de98130d93249a59c81)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.815325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.823178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:07.823921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.824211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.824491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.825399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:07.828988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:07.897779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 965/1956] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:07 2022] POST /identity/v3/projects => generated 395 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:07.904582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:07.911309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:07.923563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bdd7db3ff04de98130d93249a59c81', 'request_id': 'req-62ccc855-f901-4b7c-8356-661cfdbd8b29'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.935109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bdd7db3ff04de98130d93249a59c81', 'request_id': 'req-62ccc855-f901-4b7c-8356-661cfdbd8b29'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.956056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bdd7db3ff04de98130d93249a59c81', 'request_id': 'req-62ccc855-f901-4b7c-8356-661cfdbd8b29'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.983697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] The token cache is being invalidate because project d4bdd7db3ff04de98130d93249a59c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:07.984079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.984798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:07.987185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 992/1957] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:07 2022] DELETE /identity/v3/projects/d4bdd7db3ff04de98130d93249a59c81 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:08.000360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.003247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.054805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a22f45-7047-449d-b144-4fe95d6635e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.127338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccc855-f901-4b7c-8356-661cfdbd8b29 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.150376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.151420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.151734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.152550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] PATH_INFO: `/v3/users/9c4e30f31a06490fac7e63f31bfd7cc8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.154315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4e30f31a06490fac7e63f31bfd7cc8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.156890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:08.218117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.219023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.219402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.219842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.220990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.223461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:08.252410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:08.261314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 966/1958] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:07 2022] POST /identity/v3/users => generated 304 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:08.264239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.267574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4e30f31a06490fac7e63f31bfd7cc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.268408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.285948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4e30f31a06490fac7e63f31bfd7cc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.286985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4e30f31a06490fac7e63f31bfd7cc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.287674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4e30f31a06490fac7e63f31bfd7cc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.300552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc993-4aa4-40c0-837f-913c5c59a92f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.311380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.314335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.315251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.315605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] PATH_INFO: `/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.316945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4e30f31a06490fac7e63f31bfd7cc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.317924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adaf3cef7cb4f05a08846b680e02ef0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.321177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:08.338036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 993/1959] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:07 2022] DELETE /identity/v3/users/9c4e30f31a06490fac7e63f31bfd7cc8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:08.339181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.344269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.426295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adaf3cef7cb4f05a08846b680e02ef0', 'request_id': 'req-27f3ea7c-0973-426b-b454-d74987ab6b8b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.435200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adaf3cef7cb4f05a08846b680e02ef0', 'request_id': 'req-27f3ea7c-0973-426b-b454-d74987ab6b8b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.451896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adaf3cef7cb4f05a08846b680e02ef0', 'request_id': 'req-27f3ea7c-0973-426b-b454-d74987ab6b8b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.474709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:08.487968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] The token cache is being invalidate because project 1adaf3cef7cb4f05a08846b680e02ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:08.488247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.489126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.491491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 967/1960] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:08 2022] DELETE /identity/v3/projects/1adaf3cef7cb4f05a08846b680e02ef0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:08.492512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.493895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.503533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60601f-ab45-4585-b5b1-92058d4ac670 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.644231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.645171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.646243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.646243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] PATH_INFO: `/v3/projects/1f9661db443648e691406aba59772bd1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.648745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9661db443648e691406aba59772bd1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.651102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:08.659317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ea7c-0973-426b-b454-d74987ab6b8b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.667101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.668045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.668334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.668702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.669530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.671434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:08.684555 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 968/1961] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:08.685898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.687800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.730331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9661db443648e691406aba59772bd1', 'request_id': 'req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.739356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9661db443648e691406aba59772bd1', 'request_id': 'req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.748887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9661db443648e691406aba59772bd1', 'request_id': 'req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.772579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] The token cache is being invalidate because project 1f9661db443648e691406aba59772bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:08.773171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.773733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0b39cb9-d6f6-4ff8-9a68-146948c8fd6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:08.779450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 994/1962] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:08 2022] DELETE /identity/v3/projects/1f9661db443648e691406aba59772bd1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:08.781300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.781876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.782040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.802725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:08.803975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.806586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098839c-f87d-4830-a4a7-847598977053 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.826087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:08.919985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.921713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.922436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.922930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.925803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.934391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 995/1963] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:08.935760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:08.937341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:08.952952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420936c-1d36-4f13-9705-8e9ed063f3b1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:08.960394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:08.961374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:08.961653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:08.961931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] PATH_INFO: `/v3/projects/c7790ed18a2d410da270e2ab6717ea3d/users/be43d67f52be4362abfd5c144057e5bd/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:08.981336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7790ed18a2d410da270e2ab6717ea3d, user_id=be43d67f52be4362abfd5c144057e5bd, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:08.985980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4803-b7de-4a53-9888-7c3630819f2c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.007208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 996/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:08 2022] PUT /identity/v3/projects/c7790ed18a2d410da270e2ab6717ea3d/users/be43d67f52be4362abfd5c144057e5bd/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:09.007208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.007208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.007208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.014373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.020187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.024281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd28e2f-0940-4cc7-8fcb-cdf1bfecda0e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.041331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.043375 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 969/1965] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:09.044464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.048001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1aff-fbdc-4248-8511-3286071b2abc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.050155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1aff-fbdc-4248-8511-3286071b2abc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.050375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1aff-fbdc-4248-8511-3286071b2abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.097472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d7bc1aff-fbdc-4248-8511-3286071b2abc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.103017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7bc1aff-fbdc-4248-8511-3286071b2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.188931 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 997/1966] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.190263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.226682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fbab-63e5-4d12-b44b-4d76559757cd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.235559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.236356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.236661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.236948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.237885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.239579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.258445 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 998/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:09.259057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.260894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 970/1968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.261214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.263575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.264349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.264913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.278786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066b22-a1bd-4a0b-bf19-2d7cae09d1ba admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.290386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.291465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.292319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.292628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] PATH_INFO: `/v3/projects/7cb222f108c64fb6a885733337e192d0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.295002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb222f108c64fb6a885733337e192d0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.296634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.297270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.297991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.312174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 971/1969] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.324675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.356610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13364c69-21a6-4303-bc87-e6053779b7bb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.399248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb222f108c64fb6a885733337e192d0', 'request_id': 'req-545febd9-a0a2-4e97-9aba-272fa70ac3ce'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:09.439899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb222f108c64fb6a885733337e192d0', 'request_id': 'req-545febd9-a0a2-4e97-9aba-272fa70ac3ce'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:09.465331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb222f108c64fb6a885733337e192d0', 'request_id': 'req-545febd9-a0a2-4e97-9aba-272fa70ac3ce'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:09.481258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.501299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] The token cache is being invalidate because project 7cb222f108c64fb6a885733337e192d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:09.501723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:09.504924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:09.508918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.509678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 999/1970] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:09 2022] DELETE /identity/v3/projects/7cb222f108c64fb6a885733337e192d0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:09.511635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.514498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.514793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.515082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] PATH_INFO: `/v3/projects/c7790ed18a2d410da270e2ab6717ea3d/users/be43d67f52be4362abfd5c144057e5bd/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.517490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7790ed18a2d410da270e2ab6717ea3d, user_id=be43d67f52be4362abfd5c144057e5bd, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.518057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.521497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.543744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545febd9-a0a2-4e97-9aba-272fa70ac3ce admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.551762 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 972/1971] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:09 2022] PUT /identity/v3/projects/c7790ed18a2d410da270e2ab6717ea3d/users/be43d67f52be4362abfd5c144057e5bd/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:09.551762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.553233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.640794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.641677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.642115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.642483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.643362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:09.644105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.646470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2aa28-002b-4d99-a568-c8e6284b2fb6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.652181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43915f3-51c3-447a-ae28-5dc30eb10cf4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.657404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.658145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.658422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.658868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.659702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:09.660262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.661718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f494c1d-ed14-48aa-9f7f-d1f4947bb7dc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.663665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1000/1972] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:09.665134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.665435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.665925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.679693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 973/1973] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:09.682482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48a57-6818-4545-b029-fbd843f2678b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.683116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48a57-6818-4545-b029-fbd843f2678b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.683617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48a57-6818-4545-b029-fbd843f2678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.686612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.687909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.699459 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1001/1974] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.700232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.711375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.718944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19e410-5741-4cdd-9361-a79dd363633e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.720663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-07b48a57-6818-4545-b029-fbd843f2678b None None] MFA Rules not processed for user `be43d67f52be4362abfd5c144057e5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.722096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07b48a57-6818-4545-b029-fbd843f2678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.726963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.727734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.728050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.728388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.730124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.732784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.780752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1002/1975] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:09.780752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.818551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 974/1976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.824040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-5b2d-4ee4-9d7e-c535f4bb202e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.824040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-5b2d-4ee4-9d7e-c535f4bb202e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.824040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091a71-5b2d-4ee4-9d7e-c535f4bb202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.851261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ea091a71-5b2d-4ee4-9d7e-c535f4bb202e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:09.852605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ea091a71-5b2d-4ee4-9d7e-c535f4bb202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.883961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48373a10-e346-450a-98e1-7bae9c73a103 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.889559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.890503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.890789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.891065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.891816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.894163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.927196 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1003/1977] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:09.928624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.949146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.977360 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 975/1978] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.977360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.977360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.977819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.010129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] MFA Rules not processed for user `66b6d873574540ad866d203f7a562270`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:10.012143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:10.022831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ad09-f4d9-4abd-a2d5-01f44a2506aa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.028380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.029256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.030196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.030196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.030695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.037192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.056324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1004/1979] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:10.057216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.072037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058fb0-3bc0-4d1a-9723-f6a5d7215867 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.077509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.078203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.078490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.078772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.079548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.081956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.113665 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 976/1980] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:10.115038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.127356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1005/1981] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:10 2022] POST /identity/v3/users => generated 285 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:10.128520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.134465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8049dba-3a0f-40f8-933b-9f2c7be759b3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.139922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.140354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906fde4-9390-48d6-a917-64fece0d32c7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.140609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.140889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.141160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.142331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:10.142766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.145152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.151801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.152874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.153341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.154740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.155200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.160963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.172529 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 977/1982] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:10.176836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.178653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:10.185113 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1006/1983] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.186732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.202228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955456-9a0f-46e1-962b-fb4993d6a1a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.210393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.211456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.211938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.212388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.214189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.217686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.234137 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1007/1984] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.235109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.249374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b416f8-fae7-43fe-99a5-a96c71774aad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.257607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.258940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.259401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.259927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.261135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.264921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.288519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f80f2-700f-4f51-b8ed-43299b7180d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.291850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:10.296163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.296846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.297284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.297529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.300788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:10.313271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.315188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.319109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1008/1985] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:10 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:10.320685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.331069 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 978/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:10.333161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.347415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbd3d-47d6-4ac0-b0fd-c3ea37165648 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.431729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.431729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.432772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.433154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.433879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.435821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.456139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 979/1987] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.457414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.478219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c826e-1361-4b9d-953e-de46b257f8db admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.488298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.489270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.489604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.489855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.490680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.492826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.503176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:10.519720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe79ca-c7fa-4928-80e5-9ebff326418d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.527815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 980/1988] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:10 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:10.529014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.535418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.536196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.536848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.537264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.538147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.539900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.544061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c68e-2aa9-4a13-9c25-b69c1ec092c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.553897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.554437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1009/1989] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.555899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.557209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.557814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.558439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] PATH_INFO: `/v3/projects/59732919324a41879d12686b1fb8d041/users/d28a1d44c39648fa928dd5e9051fd1ad/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.579097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195e385-9d3c-443f-8ca8-3344e985acb0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.586589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.587642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.588108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.588587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.589515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.591539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.606252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59732919324a41879d12686b1fb8d041, user_id=d28a1d44c39648fa928dd5e9051fd1ad, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.610546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1010/1990] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.612348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.612594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.625424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b0440-40cf-4068-afb5-d8759c420059 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.632338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.633700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.634157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.634597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] PATH_INFO: `/v3/projects/fe43e07b418e49c89e989a118b72cbcb/users/bcc2337b87934343958229a28aa71c7a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.640721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 981/1991] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:10 2022] PUT /identity/v3/projects/59732919324a41879d12686b1fb8d041/users/d28a1d44c39648fa928dd5e9051fd1ad/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:10.645228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.658308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe43e07b418e49c89e989a118b72cbcb, user_id=bcc2337b87934343958229a28aa71c7a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.661473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8097d-49f3-4065-9bf5-852dd752ad54 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.683472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1011/1992] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:10 2022] PUT /identity/v3/projects/fe43e07b418e49c89e989a118b72cbcb/users/bcc2337b87934343958229a28aa71c7a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:10.685383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.685890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.686417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.732234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] MFA Rules not processed for user `d28a1d44c39648fa928dd5e9051fd1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:10.734891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:10.757406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faa4b1-63e2-4f99-a18b-0f5ec1e8e692 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.847489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.848352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.848751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.849285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.850205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:10.852377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82614e-bee6-47c9-b5dd-73fb06b55c01 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:10.875668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 982/1993] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:10.875668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10003744-0547-4554-97d0-f42158edcb71 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.875668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10003744-0547-4554-97d0-f42158edcb71 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.875668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10003744-0547-4554-97d0-f42158edcb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:10.916981 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1012/1994] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:10.918560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:10.930104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-10003744-0547-4554-97d0-f42158edcb71 None None] MFA Rules not processed for user `bcc2337b87934343958229a28aa71c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:10.932815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-10003744-0547-4554-97d0-f42158edcb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:10.939973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf7aa2-9411-4ee3-bb3a-c839c3b877e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:10.963117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:10.965133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:10.965631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:10.966340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] PATH_INFO: `/v3/projects/35a44b25c41d4fcc9674a91efe653c20/users/8f6e44c00dc444d0bd6d318808a15bec/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.008823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a44b25c41d4fcc9674a91efe653c20, user_id=8f6e44c00dc444d0bd6d318808a15bec, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.017778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acf71d-afba-43fd-b79b-0d171e339e89 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.055995 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1013/1995] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:10 2022] PUT /identity/v3/projects/35a44b25c41d4fcc9674a91efe653c20/users/8f6e44c00dc444d0bd6d318808a15bec/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:11.078220 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 983/1996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:11.083018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10003744-0547-4554-97d0-f42158edcb71 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.084769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.084769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.084769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.106266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:11.120466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10003744-0547-4554-97d0-f42158edcb71 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.174747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] MFA Rules not processed for user `8f6e44c00dc444d0bd6d318808a15bec`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:11.177381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:11.191180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:11.245917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.247424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.247772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.249447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.249600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.253451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.299383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1014/1997] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:11.299383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.303110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:11.374924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 984/1998] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:11 2022] POST /identity/v3/projects => generated 393 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:11.374924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.458042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02f8d-fc5a-4be2-b5ec-8437103c1155 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.474377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfd70-a109-46dc-8f24-4595dae83b48 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.493851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.494722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.496731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.497117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.498220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.500725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.566608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.567377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.567777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.568177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.576032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 985/1999] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:11 2022] POST /identity/v3/projects => generated 399 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:11.577308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.650262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:11.678585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.680512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.697712 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1015/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:11.698472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.717722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6185b-0090-4ad2-b3b1-6d577e581b1d service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.734481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137690c4-3bcc-4592-bcdf-945a0e605cda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.739151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.739902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.741495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.742315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.742702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.743121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.744160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.746611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.750539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.750805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.751778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.754834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.784179 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 986/2001] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:11 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:11.788247 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1016/2002] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:11 2022] POST /identity/v3/users => generated 306 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:11.789523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.795620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.797366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:11.809463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8309d3-59b1-4a93-a89e-5accf96c0f28 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.824683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.825469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.825777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.826032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.827000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.828910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.831250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc7477-9959-4476-8fba-0e19ec70827a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.847870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.848753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.849695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.849876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.850672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.853839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.856492 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 987/2003] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:11.860589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.875687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ecb-807a-4a3a-8bb1-de3e2b079334 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.878509 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1017/2004] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:11.883384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.900633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.902484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.902980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.903480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] PATH_INFO: `/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa/users/bea26a0ae5934659a0323b2f15d57f7d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.905180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7370c-d841-4871-bbaf-83e88e62375d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.910782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.912030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.914073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.914843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] PATH_INFO: `/v3/projects/270dcdc439594a3899ace6584ffd6557/users/18454309b2d1482dbd4fd75d7d15a406/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.943773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270dcdc439594a3899ace6584ffd6557, user_id=18454309b2d1482dbd4fd75d7d15a406, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.949431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.963760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ab994ddd5c4a5d82db2b675d8efffa, user_id=bea26a0ae5934659a0323b2f15d57f7d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.972982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.993428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1018/2005] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:11 2022] PUT /identity/v3/projects/270dcdc439594a3899ace6584ffd6557/users/18454309b2d1482dbd4fd75d7d15a406/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:12.002386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:12.004808 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 988/2006] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:11 2022] PUT /identity/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa/users/bea26a0ae5934659a0323b2f15d57f7d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:12.008702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:12.192622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce5ae-c97c-4ea4-9391-e24dd4cc72b8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:12.199744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:12.200516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.200816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.201200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.201998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:12.203661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:12.227454 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 989/2007] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:12.233468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:12.254370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93981261-1ddb-408c-a47f-65e0ceeb7d3a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:12.265586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:12.267266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.268005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.268456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] PATH_INFO: `/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa/users/bea26a0ae5934659a0323b2f15d57f7d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.274855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ab994ddd5c4a5d82db2b675d8efffa, user_id=bea26a0ae5934659a0323b2f15d57f7d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:12.281703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c5ca-1f15-48fd-9fcc-cc45925accc1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:12.283391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99c7d3-b83e-4a21-8a79-f19e1c95aa5d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:12.291951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:12.294828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.296928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.301594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.308620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:12.312840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 990/2008] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:12 2022] PUT /identity/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa/users/bea26a0ae5934659a0323b2f15d57f7d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:12.325010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1a33-cb69-4815-bbe3-b42aeedcb48b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.325375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1a33-cb69-4815-bbe3-b42aeedcb48b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.325723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c1a33-cb69-4815-bbe3-b42aeedcb48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.334621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:12.377319 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1019/2009] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:12.381194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:12.415004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25021d44-d3af-4e96-aa18-688e95e49ae0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:12.421253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3a9c1a33-cb69-4815-bbe3-b42aeedcb48b None None] MFA Rules not processed for user `bea26a0ae5934659a0323b2f15d57f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:12.423759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3a9c1a33-cb69-4815-bbe3-b42aeedcb48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:12.551028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 991/2010] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:12.581810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:12.582849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.583169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.583416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] PATH_INFO: `/v3/projects/270dcdc439594a3899ace6584ffd6557/users/18454309b2d1482dbd4fd75d7d15a406/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.585784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=270dcdc439594a3899ace6584ffd6557, user_id=18454309b2d1482dbd4fd75d7d15a406, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:12.588854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:12.603934 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1020/2011] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:12 2022] PUT /identity/v3/projects/270dcdc439594a3899ace6584ffd6557/users/18454309b2d1482dbd4fd75d7d15a406/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:12.615064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.615346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.615750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:12.649104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] MFA Rules not processed for user `18454309b2d1482dbd4fd75d7d15a406`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:12.650800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:12.695674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:12.779136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 992/2012] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:12.780651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:12.816097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:12.890851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a82d5a-3cfa-4f44-8903-8191b8dad3cd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:12.912127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:12.912994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:12.913379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:12.913759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.056282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:13.059160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:13.074847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1021/2013] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:13.124600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:13.147860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4cd16-7b73-4241-9415-fe76d3ec6789 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:13.168251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:13.169299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.169740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.170167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.245178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:13.346797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:13.358561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:13.411118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 993/2014] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:13.421374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1f797-bc48-418e-a6df-c29355b362a0 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:13.431237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:13.432134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.432451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.432906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] PATH_INFO: `/v3/users/bcc2337b87934343958229a28aa71c7a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.434279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc2337b87934343958229a28aa71c7a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:13.436646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:13.500820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:13.523145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc2337b87934343958229a28aa71c7a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:13.527487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2145ab-aa1b-44cb-ad38-7fbc9c1b559e service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:13.540064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc2337b87934343958229a28aa71c7a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:13.540989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:13.541534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc2337b87934343958229a28aa71c7a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:13.542545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc2337b87934343958229a28aa71c7a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:13.544083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:13.545345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.545691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.546858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.550521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:13.576307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:13.578007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344f4f5-4650-4fe1-b072-f24c84482e22 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:13.622716 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 994/2015] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:13.624789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc2337b87934343958229a28aa71c7a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:13.658673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bb-2c18-4ee9-b87a-32922a4ae554 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.659028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bb-2c18-4ee9-b87a-32922a4ae554 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.659317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445298bb-2c18-4ee9-b87a-32922a4ae554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.661861 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1022/2016] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:13 2022] DELETE /identity/v3/users/bcc2337b87934343958229a28aa71c7a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:13.690003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-445298bb-2c18-4ee9-b87a-32922a4ae554 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:13.692310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-445298bb-2c18-4ee9-b87a-32922a4ae554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:13.696643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:13.698314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:13.884007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5c16-1951-4f35-b8b2-600869a4158b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:13.892983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:13.894394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.895351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.896369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] PATH_INFO: `/v3/users/d28a1d44c39648fa928dd5e9051fd1ad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.898256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28a1d44c39648fa928dd5e9051fd1ad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:13.901215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:13.921060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 995/2017] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:13.922820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:13.922820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:13.922984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:13.950477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] MFA Rules not processed for user `71d0d753d0314e44b9cd7fba3ab1cd26`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:13.952246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.043774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28a1d44c39648fa928dd5e9051fd1ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.052081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.059172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28a1d44c39648fa928dd5e9051fd1ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.060242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28a1d44c39648fa928dd5e9051fd1ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.061048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28a1d44c39648fa928dd5e9051fd1ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.079224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 996/2018] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:14.080561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:14.081968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.104111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28a1d44c39648fa928dd5e9051fd1ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.142792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1023/2019] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:13 2022] DELETE /identity/v3/users/d28a1d44c39648fa928dd5e9051fd1ad => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:14.143811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:14.145262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.203208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2cc8-e646-4f83-9bd2-a906612e5bc1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:14.274921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.302427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f00f45-248f-4ec4-a775-4b84814c346a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:14.303036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:14.304290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.305015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.305416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.307872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.310594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:14.311848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.312133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.312411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] PATH_INFO: `/v3/users/8f6e44c00dc444d0bd6d318808a15bec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.315130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6e44c00dc444d0bd6d318808a15bec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:14.317150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:14.325230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:14.326902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2275-ced0-4d1e-a42a-a7e5823ba75e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:14.349909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 997/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:14.354140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.354525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.354844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.395429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6e44c00dc444d0bd6d318808a15bec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.405570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6e44c00dc444d0bd6d318808a15bec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.406465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6e44c00dc444d0bd6d318808a15bec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.406987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6e44c00dc444d0bd6d318808a15bec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.418239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:14.425837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.440229 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 998/2021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:14.445314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66395994-b61d-4d96-ad7c-e12675b0b4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6e44c00dc444d0bd6d318808a15bec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:14.454820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:14.462134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.494937 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1024/2022] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:14 2022] DELETE /identity/v3/users/8f6e44c00dc444d0bd6d318808a15bec => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:14.500451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.500831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2450d-a7c6-40c3-8e01-59041b37bb87 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:14.501271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.504627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.537505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:14.540921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.593382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:14.593959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.594244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.594521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.633718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1025/2023] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:14.647578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:14.649356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:14.668234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c417-027d-4064-84a2-7eb2483ef726 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:14.673715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:14.674828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:14.675118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:14.675395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:14.688002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:14.690700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:14.706241 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1026/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:14.742108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.749083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:14.750609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:14.776649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 999/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:15.375569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:15.382065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:15.405108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b28b0c-54d6-4f07-9d39-32023aa2a8ce service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:15.423175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:15.424199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:15.424486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:15.424762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] PATH_INFO: `/v3/projects/fe43e07b418e49c89e989a118b72cbcb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:15.426055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe43e07b418e49c89e989a118b72cbcb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:15.428154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:15.564834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe43e07b418e49c89e989a118b72cbcb', 'request_id': 'req-968b100c-69be-4b45-8032-3554b8a28268'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.581610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe43e07b418e49c89e989a118b72cbcb', 'request_id': 'req-968b100c-69be-4b45-8032-3554b8a28268'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.584503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:15.592918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe43e07b418e49c89e989a118b72cbcb', 'request_id': 'req-968b100c-69be-4b45-8032-3554b8a28268'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.627269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] The token cache is being invalidate because project fe43e07b418e49c89e989a118b72cbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:15.627914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.630222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.635337 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1027/2026] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:15 2022] DELETE /identity/v3/projects/fe43e07b418e49c89e989a118b72cbcb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:15.636694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:15.651604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf9cc3-1b72-4bd1-a316-7e7c2c1e44c9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:15.748455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:15.749553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:15.752220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:15.752699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] PATH_INFO: `/v3/users/bea26a0ae5934659a0323b2f15d57f7d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:15.754952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea26a0ae5934659a0323b2f15d57f7d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:15.758357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:15.871732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea26a0ae5934659a0323b2f15d57f7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.872985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea26a0ae5934659a0323b2f15d57f7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.878018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:15.880064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:15.891666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea26a0ae5934659a0323b2f15d57f7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.893439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea26a0ae5934659a0323b2f15d57f7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.912150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b100c-69be-4b45-8032-3554b8a28268 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:15.923126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:15.923742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:15.924095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:15.924414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] PATH_INFO: `/v3/projects/35a44b25c41d4fcc9674a91efe653c20` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:15.932938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a44b25c41d4fcc9674a91efe653c20)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:15.939777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:15.968150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea26a0ae5934659a0323b2f15d57f7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:15.993422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1000/2027] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:15 2022] DELETE /identity/v3/users/bea26a0ae5934659a0323b2f15d57f7d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:15.994244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:16.005135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:16.063749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a44b25c41d4fcc9674a91efe653c20', 'request_id': 'req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.077651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a44b25c41d4fcc9674a91efe653c20', 'request_id': 'req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.094299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a44b25c41d4fcc9674a91efe653c20', 'request_id': 'req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.131580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] The token cache is being invalidate because project 35a44b25c41d4fcc9674a91efe653c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:16.132519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.135823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.138204 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1028/2028] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:15 2022] DELETE /identity/v3/projects/35a44b25c41d4fcc9674a91efe653c20 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:16.150909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:16.158922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:16.269723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0bb4-d400-4c7d-a4b4-11ec08d9a95b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:16.275952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:16.276846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.277130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.277461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] PATH_INFO: `/v3/users/18454309b2d1482dbd4fd75d7d15a406` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.277589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb254d-974f-4b12-a774-80f1c824e042 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:16.278834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18454309b2d1482dbd4fd75d7d15a406)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:16.281062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:16.298822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:16.305258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.305775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.306254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] PATH_INFO: `/v3/projects/59732919324a41879d12686b1fb8d041` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.309318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59732919324a41879d12686b1fb8d041)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:16.317927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:16.356415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:16.386878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18454309b2d1482dbd4fd75d7d15a406'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.409880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18454309b2d1482dbd4fd75d7d15a406'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.410654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18454309b2d1482dbd4fd75d7d15a406'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.411963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18454309b2d1482dbd4fd75d7d15a406'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.426897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:16.436923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9de4e724-8f38-45ce-a2e6-993ae7d0c0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18454309b2d1482dbd4fd75d7d15a406'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.446873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59732919324a41879d12686b1fb8d041', 'request_id': 'req-6b91ae12-db16-44a7-87be-ab76a79cd097'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.464919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59732919324a41879d12686b1fb8d041', 'request_id': 'req-6b91ae12-db16-44a7-87be-ab76a79cd097'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.478291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1029/2029] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:16 2022] DELETE /identity/v3/users/18454309b2d1482dbd4fd75d7d15a406 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:16.491495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59732919324a41879d12686b1fb8d041', 'request_id': 'req-6b91ae12-db16-44a7-87be-ab76a79cd097'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.516052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] The token cache is being invalidate because project 59732919324a41879d12686b1fb8d041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:16.516545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.517789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6b91ae12-db16-44a7-87be-ab76a79cd097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:16.520187 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1001/2030] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:15 2022] DELETE /identity/v3/projects/59732919324a41879d12686b1fb8d041 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:16.525265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2113-a1ba-4fa9-b483-d9b3d5862517 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.525820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2113-a1ba-4fa9-b483-d9b3d5862517 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.526266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c2113-a1ba-4fa9-b483-d9b3d5862517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.574439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-964c2113-a1ba-4fa9-b483-d9b3d5862517 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:16.575843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-964c2113-a1ba-4fa9-b483-d9b3d5862517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:16.772322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4e1ca-a353-444e-bf92-6bbc32062d7c None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.772839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4e1ca-a353-444e-bf92-6bbc32062d7c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.772839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4e1ca-a353-444e-bf92-6bbc32062d7c None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.774251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1002/2031] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:53:16.788190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.788490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.788770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.874483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1030/2032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:53:16.882865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.883157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.883353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:16.927040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:16.928816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:16.943385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:16.953760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:16.974774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1031/2033] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:16.976719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:16.989381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020384d-7b5c-4ecf-a93e-12c6926e128c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:16.997330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:16.998475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:16.998861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:16.999240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.000353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:17.000796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.002787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.024137 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1032/2034] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:17.026026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.057314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712b196-35cf-4a72-8aca-41da4dd85496 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.114803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.115833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.116010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.116256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.116966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.126833 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1003/2035] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:53:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:17.128559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.130989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.134861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.164134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648361e-099b-4af2-81c3-3b3cbe4a5f04 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.170776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.171948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.172339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.172717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] PATH_INFO: `/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.174472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ab994ddd5c4a5d82db2b675d8efffa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.176815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.234222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1033/2036] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:17.234222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.239411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.301291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ab994ddd5c4a5d82db2b675d8efffa', 'request_id': 'req-1ac983f5-f714-4492-9088-99a54f3242cb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:17.319950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ab994ddd5c4a5d82db2b675d8efffa', 'request_id': 'req-1ac983f5-f714-4492-9088-99a54f3242cb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:17.329227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:17.334312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ab994ddd5c4a5d82db2b675d8efffa', 'request_id': 'req-1ac983f5-f714-4492-9088-99a54f3242cb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:17.363632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] The token cache is being invalidate because project f8ab994ddd5c4a5d82db2b675d8efffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:17.364089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:17.364998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:17.372474 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1004/2037] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:17 2022] DELETE /identity/v3/projects/f8ab994ddd5c4a5d82db2b675d8efffa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:17.373471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.378885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.425776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ea355-049a-42aa-94e5-504ada02543f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.506352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac983f5-f714-4492-9088-99a54f3242cb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.508012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:17.522716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.524640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.524937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.525221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.525994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.528293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.532321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.536185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.536477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.536764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.539030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.552035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.562880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e158946-c0a0-496e-845d-cacd3a3ebf07 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.565829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1034/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:17.567599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225aa2d-cdfa-411a-93f3-9ac363d5e5fd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.567849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225aa2d-cdfa-411a-93f3-9ac363d5e5fd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.568130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225aa2d-cdfa-411a-93f3-9ac363d5e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.570685 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1005/2039] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:17.571914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.587562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b01e93-d976-4249-ba84-4995892fdba4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.592667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d225aa2d-cdfa-411a-93f3-9ac363d5e5fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:17.594130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d225aa2d-cdfa-411a-93f3-9ac363d5e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.598640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.599756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.600052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.600336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.601548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.604431 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1035/2040] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:17.606562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.614160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.614260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.620181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.636118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:17.637414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.645116 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1006/2041] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:17.649973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.650474 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1036/2042] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:53:17.661174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.682298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b861-e468-44b8-a2e6-10657cb66e7b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.688518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdae62-728c-4f56-ae93-14cb740ad849 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.695036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.695762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.696041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.696320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.697059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.700106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.705137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.705826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.706108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.706383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.720746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:17.720746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.720746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.734802 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1007/2043] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:17.739483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.762573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1037/2044] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:17.763457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.770975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1152-072a-47bf-963d-f0e677eb8d40 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.775755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf4698-adfa-4a97-a549-580cf7574300 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.780866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.781445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.781669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.781814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.781996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.782363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.782784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:17.783284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.783433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] PATH_INFO: `/v3/projects/eec20993c56848f3b51ef657573fd2fa/users/90ddce5b88fa408ea66da1aba6af4a8f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:17.785499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.800902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec20993c56848f3b51ef657573fd2fa, user_id=90ddce5b88fa408ea66da1aba6af4a8f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:17.804520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:17.815597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1038/2045] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:17.820698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.840989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1008/2046] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:17 2022] PUT /identity/v3/projects/eec20993c56848f3b51ef657573fd2fa/users/90ddce5b88fa408ea66da1aba6af4a8f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:17.841844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:17.843536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:17.937460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a27d6-a2a7-4e95-ade1-455d469dbc86 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.988818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d63bf-8a19-4ad4-b429-a99253151659 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:17.998440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:17.999427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:17.999752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.000037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] PATH_INFO: `/v3/projects/270dcdc439594a3899ace6584ffd6557` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.002088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270dcdc439594a3899ace6584ffd6557)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.004780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.029495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.030194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.030482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.030836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.031730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.035383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0ae1-ae6b-444d-9363-e4dc7411096a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.070223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:18.075075 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1039/2047] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:17 2022] POST /identity/v3/users => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:18.078082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eb18-464f-4c8c-9cf5-38e5035cb263 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.078446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eb18-464f-4c8c-9cf5-38e5035cb263 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.078815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eb18-464f-4c8c-9cf5-38e5035cb263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.087174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270dcdc439594a3899ace6584ffd6557', 'request_id': 'req-8eccc4a4-a242-4da1-a4d6-19ff591974f8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:18.106097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270dcdc439594a3899ace6584ffd6557', 'request_id': 'req-8eccc4a4-a242-4da1-a4d6-19ff591974f8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:18.120241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270dcdc439594a3899ace6584ffd6557', 'request_id': 'req-8eccc4a4-a242-4da1-a4d6-19ff591974f8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:18.124671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2e29eb18-464f-4c8c-9cf5-38e5035cb263 None None] MFA Rules not processed for user `90ddce5b88fa408ea66da1aba6af4a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:18.126718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e29eb18-464f-4c8c-9cf5-38e5035cb263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.146724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:18.151177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] The token cache is being invalidate because project 270dcdc439594a3899ace6584ffd6557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:18.151489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:18.152410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:18.160252 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1009/2048] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:17 2022] DELETE /identity/v3/projects/270dcdc439594a3899ace6584ffd6557 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:18.160252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.160549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.246854 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1040/2049] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:18.248510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.248800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.249078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.260201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccc4a4-a242-4da1-a4d6-19ff591974f8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.265726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.266868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.268114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.268547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.269513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.271502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37457c4-c20b-4696-a290-3176c2e3f565 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.271875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:18.273281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.286001 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1010/2050] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:18.286370 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1041/2051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:18.288348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.288817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.289259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.292200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.305041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1165167-c8fb-4671-880c-91912f7c782e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.311598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.312907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.313483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.314098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.315070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.316893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15637b-f86a-4a3d-bb80-0d8f3f4dd243 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.333345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1042/2052] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:18.333345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.333345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.333345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.333683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] MFA Rules not processed for user `90ddce5b88fa408ea66da1aba6af4a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:18.334316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.349169 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1011/2053] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:18.349169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.356942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:18.358309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.358724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732007e-69d0-4bbb-8ab0-1a14edac1228 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.373610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.374956 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1043/2054] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:18.375404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.375914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.379695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] PATH_INFO: `/v3/projects/0af910452e1d476fad0c05ca42e35ec4/users/e4bb796a1038475b82667e6ab615b3da/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.381133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.395259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb9f1e-82bc-40b0-b5be-7eaa79ca85db None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.401475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af910452e1d476fad0c05ca42e35ec4, user_id=e4bb796a1038475b82667e6ab615b3da, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.402815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.403822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.404208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.404665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.406065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:18.406181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.406260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.409068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c17693-e29f-453b-b9ae-793ffb6c5af4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.429506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1012/2055] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:18 2022] PUT /identity/v3/projects/0af910452e1d476fad0c05ca42e35ec4/users/e4bb796a1038475b82667e6ab615b3da/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:18.434185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1044/2056] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:18.435835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.444839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.445137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.445572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.484477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] MFA Rules not processed for user `e4bb796a1038475b82667e6ab615b3da`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:18.486980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.582609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad7bb-b5dc-4432-bfd0-e14465435eda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.596492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.596730 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1045/2057] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:18.597479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.597712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.597877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.598426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.599699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.602555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:18.603463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.657159 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1013/2058] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/projects => generated 403 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:18.657159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.672357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:18.713014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:18.718631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9265-5487-45b4-ace9-1f56c123d0e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.754274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e65e5-68d1-4640-b8af-27e10bb85405 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.764004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.766196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.767123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.767806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.768991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.775178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.821882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.822489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.822877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.823254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.856899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1014/2059] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/projects => generated 359 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:18.857896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:18.959546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414fbeb-926d-4d94-9e52-9a54b8e9b382 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:18.968943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.969359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:18.970367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:18.971172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:18.971458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:18.972214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:18.974378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:18.974683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.006682 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1046/2060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:19.008086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.017373 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1015/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:18 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:19.022471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.025145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693ee1-93c2-4b4a-b032-16b346d2af97 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.035970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec36bf-111a-435a-9c7a-926d47bfcdf5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.042028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.042708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.042991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.043273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.043779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.044032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.044880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.045382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.045861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.045967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.047012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.049483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.075754 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1016/2062] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:53:19.080777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.089315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1047/2063] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:19 2022] POST /identity/v3/users => generated 286 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:19.094081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.100917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409ca81-3739-42be-981c-e6e283019e95 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.110865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.112127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.112606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.113065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.114824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.116971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.119138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a98c40-3fb6-4917-9384-5bafa7a1158b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.130770 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1017/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:53:19.132172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.132979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.133291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.133670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.134594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.135406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.140076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.148080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace1e40-b2c3-4026-a0b5-584bb922110c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.153209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.154724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.155016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.155987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] PATH_INFO: `/v3/projects/aec2eb2be3bf4569978af88238bcd375/users/9d9acb7edff248c4802b8b514e59c90a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.158276 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1048/2065] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:19.160803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.172596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531a782-1fef-47a9-8895-ad5e4484406c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.178388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.179541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.179909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.180452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] PATH_INFO: `/v3/projects/c20a336609264784817ea8fe150c14ef/users/29407a381ff24f7aa852c5b6e3995fcf/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.190432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec2eb2be3bf4569978af88238bcd375, user_id=9d9acb7edff248c4802b8b514e59c90a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.200044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.201429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20a336609264784817ea8fe150c14ef, user_id=29407a381ff24f7aa852c5b6e3995fcf, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.204893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491bee4-b10d-48d0-b3ef-c148a58fcdaf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.226756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1018/2067] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:19 2022] PUT /identity/v3/projects/aec2eb2be3bf4569978af88238bcd375/users/9d9acb7edff248c4802b8b514e59c90a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:19.227258 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1049/2067] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:19 2022] PUT /identity/v3/projects/c20a336609264784817ea8fe150c14ef/users/29407a381ff24f7aa852c5b6e3995fcf/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:19.228150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.229233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.229724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.230143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.274435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:19.278469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:19.326853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:19.384601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e3b8-77df-471b-a85f-bbebee80a9e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.464541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:19.506301 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1050/2068] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:19.522760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.524476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:19.534524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.535226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.535525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.536284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.536621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.538235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.556774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1019/2069] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:19.557758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:19.570650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc2582-c1b6-457b-992b-db93b1c840f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.575701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.576935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.577292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.577788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] PATH_INFO: `/v3/projects/c20a336609264784817ea8fe150c14ef/users/29407a381ff24f7aa852c5b6e3995fcf/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.581602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20a336609264784817ea8fe150c14ef, user_id=29407a381ff24f7aa852c5b6e3995fcf, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.585237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399baa7b-94c6-4e63-9f1f-fb4304a7405f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.611716 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1020/2070] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:19 2022] PUT /identity/v3/projects/c20a336609264784817ea8fe150c14ef/users/29407a381ff24f7aa852c5b6e3995fcf/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:19.613941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.614325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.614703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.640287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d8a20-58f1-4a22-b942-879a583b5fac None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:19.685650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] MFA Rules not processed for user `29407a381ff24f7aa852c5b6e3995fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:19.688588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:19.776316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:19.777496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:19.777950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:19.779723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:19.923484 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1021/2071] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:19 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:53:19.961485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:19.963066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:19.994871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1051/2072] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:20.242062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:20.250701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:20.280922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db525295-1b84-42fe-b05b-550260b3d41a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:20.288060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:20.290204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:20.290539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:20.290873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] PATH_INFO: `/v3/users/817a1c522a084c3fa1d996b9ea743700` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:20.293244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817a1c522a084c3fa1d996b9ea743700)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:20.294309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:20.296534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:20.300965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:20.376070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817a1c522a084c3fa1d996b9ea743700'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:20.377326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817a1c522a084c3fa1d996b9ea743700'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:20.387696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:20.393838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817a1c522a084c3fa1d996b9ea743700'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:20.394681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817a1c522a084c3fa1d996b9ea743700'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:20.416093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-55dcb025-28a3-44c7-9fe2-7dcb1c7c9057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817a1c522a084c3fa1d996b9ea743700'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:20.444645 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1022/2073] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:20 2022] DELETE /identity/v3/users/817a1c522a084c3fa1d996b9ea743700 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:20.450100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:20.452498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:20.452948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:20.486243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:20.494719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:20.496966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:20.541242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee99a2d-14a9-45d5-baf9-b637b691ec2c service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:20.613356 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1023/2074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:20.686182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:20.688828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:20.712647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:20.713464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:20.713868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:20.714323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:20.716313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:20.774802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3d2e5-9714-48e0-a537-2e4aff629e16 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:20.779051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:20.779804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:20.780085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:20.780500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:20.796022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:20.797885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078f7bf-7e88-4ace-a834-df62526c96ec service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:20.835149 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1024/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:20.836947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:20.839098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:20.854425 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1052/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:20 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:22.872257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:22.872822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:22.872822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:22.931031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] MFA Rules not processed for user `9d9acb7edff248c4802b8b514e59c90a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:22.932506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.036466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.038449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.041774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1025/2077] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:23.054536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4525155-f333-43a2-a4a2-eaac59471186 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.061489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.062421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.062710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.062988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.064288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.067112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:23.111750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1053/2078] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:23 2022] POST /identity/v3/projects => generated 403 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:23.115967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.122588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:23.131027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761bbb5-55c1-44e0-8ec8-bd870b860d50 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.171452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.175098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.321203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.322150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.323666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.324122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.324969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.328516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:23.377938 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1026/2079] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:23 2022] POST /identity/v3/users => generated 308 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:23.387539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.397893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.432467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5d7ea-807b-46f0-996f-0b67937461da admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.451317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.453030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.453524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.454219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] PATH_INFO: `/v3/users/e4bb796a1038475b82667e6ab615b3da` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.458435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba00ca-ac2a-4331-9605-4e1169dbe08f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.463752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bb796a1038475b82667e6ab615b3da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.470016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:23.474993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.481473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.482103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.482598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] PATH_INFO: `/v3/projects/b5a66410551e4ce78d9c492b20a70379` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.489701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a66410551e4ce78d9c492b20a70379)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.493572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:23.497871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:23.639966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bb796a1038475b82667e6ab615b3da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.641179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a66410551e4ce78d9c492b20a70379', 'request_id': 'req-1cf57b39-1d1d-4b74-9069-67994992c830'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.656831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a66410551e4ce78d9c492b20a70379', 'request_id': 'req-1cf57b39-1d1d-4b74-9069-67994992c830'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.664316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bb796a1038475b82667e6ab615b3da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.667732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bb796a1038475b82667e6ab615b3da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.668262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a66410551e4ce78d9c492b20a70379', 'request_id': 'req-1cf57b39-1d1d-4b74-9069-67994992c830'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.669777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bb796a1038475b82667e6ab615b3da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.695115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] The token cache is being invalidate because project b5a66410551e4ce78d9c492b20a70379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:23.695115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.695773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.699715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1027/2080] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:23 2022] DELETE /identity/v3/projects/b5a66410551e4ce78d9c492b20a70379 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:23.703892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.709060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bb796a1038475b82667e6ab615b3da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:23.719410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.764427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1054/2081] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:23 2022] DELETE /identity/v3/users/e4bb796a1038475b82667e6ab615b3da => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:23.768741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.773252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.859975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf57b39-1d1d-4b74-9069-67994992c830 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.932671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:23.970559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8b77-d4ee-48e7-b9af-8397ae742086 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.983149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.984131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.984605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.984887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] PATH_INFO: `/v3/users/1a767c507b2e4b57890efe462797121b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.986363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a767c507b2e4b57890efe462797121b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.988411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.055023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:24.055886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.056237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.056605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.057975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:24.059266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd026e36-9436-4dc5-ab27-af1af658311d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.082250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a767c507b2e4b57890efe462797121b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:24.087291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1028/2082] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:24.093243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.094170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.094668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.096600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a767c507b2e4b57890efe462797121b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:24.098492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a767c507b2e4b57890efe462797121b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:24.099562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a767c507b2e4b57890efe462797121b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:24.137247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:24.139325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:24.140269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a767c507b2e4b57890efe462797121b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:24.163806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1029/2083] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:24.168805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:24.181351 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1055/2084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:23 2022] DELETE /identity/v3/users/1a767c507b2e4b57890efe462797121b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:24.185586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:24.191615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:24.193531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:24.208634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:24.223735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bcd90-6a2f-4468-9b95-22f311d97001 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:24.458647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e88ec-bc24-4bec-a569-5b35188d61bd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:24.480722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:24.484914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.486350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.486913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.558930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:24.561444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.562397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.563069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] PATH_INFO: `/v3/projects/7c5bb0b3677e47bca64a19e190c1f528/users/8876b2482d5e45f7a2354661d7109858/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.616818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5bb0b3677e47bca64a19e190c1f528, user_id=8876b2482d5e45f7a2354661d7109858, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:24.632094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.668924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1030/2085] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:24 2022] PUT /identity/v3/projects/7c5bb0b3677e47bca64a19e190c1f528/users/8876b2482d5e45f7a2354661d7109858/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:24.674619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:24.805073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:24.810229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.842378 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1056/2086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:24.846177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e289e8-3cac-4bcb-b8f4-2c2be5127a6a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:24.860084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:24.860962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.861404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.861677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.862425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:24.867207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.891174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1031/2087] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:24.896368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:24.907738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46377b1-dde7-4fa8-89e0-713178ce1306 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:24.916829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:24.918225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:24.918717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:24.919150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] PATH_INFO: `/v3/projects/7c5bb0b3677e47bca64a19e190c1f528/users/8876b2482d5e45f7a2354661d7109858/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:24.922955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5bb0b3677e47bca64a19e190c1f528, user_id=8876b2482d5e45f7a2354661d7109858, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:24.926789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:24.940234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1057/2088] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:24 2022] PUT /identity/v3/projects/7c5bb0b3677e47bca64a19e190c1f528/users/8876b2482d5e45f7a2354661d7109858/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:25.297461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:25.302056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:25.322569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9e3b-2ac4-4704-8ab8-114e43986c0f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:25.404004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:25.463485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:25.465028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:25.465775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:25.466140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] PATH_INFO: `/v3/users/6c28978004214999bd5ff400f05fdc73` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:25.467749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c28978004214999bd5ff400f05fdc73)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:25.471687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:25.590478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c28978004214999bd5ff400f05fdc73'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.591501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c28978004214999bd5ff400f05fdc73'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.604345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c28978004214999bd5ff400f05fdc73'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.605598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c28978004214999bd5ff400f05fdc73'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.626625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97353c50-a3c3-45ed-baa6-97f4b64906a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c28978004214999bd5ff400f05fdc73'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.670576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:25.672161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1032/2089] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:25 2022] DELETE /identity/v3/users/6c28978004214999bd5ff400f05fdc73 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:25.674628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:25.677203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:25.677532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:25.678470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:25.704328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bae90-71e3-4d55-aae4-a5760a0ac81d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:25.734850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:25.736219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:25.867798 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1033/2090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:25.870134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:25.872939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:25.873540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:25.874694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] PATH_INFO: `/v3/projects/c6d67b538d474c6c8bac76cc0447660d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:25.876701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d67b538d474c6c8bac76cc0447660d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:25.880025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:25.957464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:25.959396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:25.960307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:25.964310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d67b538d474c6c8bac76cc0447660d', 'request_id': 'req-df0c63d2-a0b1-48f9-a406-f132e1f7468c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.975265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d67b538d474c6c8bac76cc0447660d', 'request_id': 'req-df0c63d2-a0b1-48f9-a406-f132e1f7468c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:25.983115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d67b538d474c6c8bac76cc0447660d', 'request_id': 'req-df0c63d2-a0b1-48f9-a406-f132e1f7468c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:26.000470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] The token cache is being invalidate because project c6d67b538d474c6c8bac76cc0447660d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:26.001386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:26.003303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df0c63d2-a0b1-48f9-a406-f132e1f7468c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:26.005500 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1058/2091] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:25 2022] DELETE /identity/v3/projects/c6d67b538d474c6c8bac76cc0447660d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:26.010692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9df27-24a7-4932-9147-e1f258fdcc32 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.011097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9df27-24a7-4932-9147-e1f258fdcc32 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.011657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9df27-24a7-4932-9147-e1f258fdcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.031548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-04d9df27-24a7-4932-9147-e1f258fdcc32 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:26.032842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-04d9df27-24a7-4932-9147-e1f258fdcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:26.071973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767d0b7-ea8e-40cd-9e01-a5a40bf16a02 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.077828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:26.142501 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1059/2092] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:26.151213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.152606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.153301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.182297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:26.183136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.184173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.184766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.185193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.187102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:26.187724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:26.207103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.210497 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1060/2093] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:53:26.212446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.214685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.233599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a1a7-a35c-41da-a63f-c9f42b69fb95 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.238675 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1034/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:26.241087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.242013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.242297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.242576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.243326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:26.243665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.245744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.260089 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1061/2095] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:26.264352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.276982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1a22-53a2-4c72-aaf3-2cf298b3daf6 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.283174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.283882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.284163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.284436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.285137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.287087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.336790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1035/2096] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:26.341306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.352723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78f84-58f3-4782-a9ae-ce66d0201258 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.430085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.430867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.431173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.431452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.432206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.434442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.463347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1062/2097] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:26.468405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.480957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35df21-afff-4f5a-8824-e0a6c755e78b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.487319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.488056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.488314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.488608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.489341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.490959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.502710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1036/2098] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:26.506659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.520898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9abc-7af9-4b02-afde-cb34114ad9d0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.526899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.527901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.528215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.528461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.529226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.531462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afb67c-32b4-4b5f-9cb1-1ef4b2d44ee3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.552132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.553170 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1063/2099] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:26.562934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef96f9-8323-4b54-9aaf-8ff44cbe16a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.567798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.569146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.569560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.570587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] PATH_INFO: `/v3/projects/9ee37fb7d9164b519240b601b70013c7/users/5a7bf375260044768c222158a30bf499/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.596430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee37fb7d9164b519240b601b70013c7, user_id=5a7bf375260044768c222158a30bf499, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.599408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.649397 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1037/2100] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:26 2022] PUT /identity/v3/projects/9ee37fb7d9164b519240b601b70013c7/users/5a7bf375260044768c222158a30bf499/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:26.651885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.652614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.652614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.689353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] MFA Rules not processed for user `5a7bf375260044768c222158a30bf499`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:26.691478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:26.722769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:26.863312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.867723 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1064/2101] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:26.946084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:26.948172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:26.961055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928feb9-0ee9-449a-8305-f0a03e1f20e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.972735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.973755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.974046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.974320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.975037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.975864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262a0c-487c-4fba-8326-5e3fa01d889b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:26.979685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:26.988935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:26.988935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:26.989213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:26.989287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] PATH_INFO: `/v3/projects/0af910452e1d476fad0c05ca42e35ec4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:26.991113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af910452e1d476fad0c05ca42e35ec4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:26.994151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.044293 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1038/2102] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:26 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:27.044293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.049886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.136004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af910452e1d476fad0c05ca42e35ec4', 'request_id': 'req-856a6d78-3f98-47fc-87e2-3f573c8f18ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.147009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af910452e1d476fad0c05ca42e35ec4', 'request_id': 'req-856a6d78-3f98-47fc-87e2-3f573c8f18ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.155251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:27.156809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af910452e1d476fad0c05ca42e35ec4', 'request_id': 'req-856a6d78-3f98-47fc-87e2-3f573c8f18ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.181542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] The token cache is being invalidate because project 0af910452e1d476fad0c05ca42e35ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:27.182210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.183444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.188232 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1065/2103] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:26 2022] DELETE /identity/v3/projects/0af910452e1d476fad0c05ca42e35ec4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:27.189630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.191775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.195051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3b5a0-0191-43ec-a6d1-82520cad7240 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.296451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.298695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.299282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.299808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] PATH_INFO: `/v3/projects/0d9e0c4a4f7b409bab8b012092f7d1f2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.301439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9e0c4a4f7b409bab8b012092f7d1f2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.308335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.316332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6d78-3f98-47fc-87e2-3f573c8f18ac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.330460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.331229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.331599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.332214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.333020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.335289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.393032 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1066/2104] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:27 2022] POST /identity/v3/users => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:27.394264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.396989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.413238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c571-24b9-43be-b756-c45ed414e84f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.426779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'request_id': 'req-0b2a9826-b536-4653-868b-0466e0ee58c1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.456177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'request_id': 'req-0b2a9826-b536-4653-868b-0466e0ee58c1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.462762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:27.485680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'request_id': 'req-0b2a9826-b536-4653-868b-0466e0ee58c1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.504380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.505926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.506265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.506568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] PATH_INFO: `/v3/users/29407a381ff24f7aa852c5b6e3995fcf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.508131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29407a381ff24f7aa852c5b6e3995fcf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.510968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.521284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] The token cache is being invalidate because project 0d9e0c4a4f7b409bab8b012092f7d1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:27.521652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.522410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.524714 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1039/2105] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:27 2022] DELETE /identity/v3/projects/0d9e0c4a4f7b409bab8b012092f7d1f2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:27.525681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.534234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.565132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a9826-b536-4653-868b-0466e0ee58c1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.571486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.572342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.572739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.573102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.574796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.576674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.592865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1040/2106] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:27.592865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.594901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.606404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29407a381ff24f7aa852c5b6e3995fcf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.609474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2136-ee43-4c3d-ba4b-c713ee4e8b18 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.616081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.617493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.617850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.618219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] PATH_INFO: `/v3/users/b31c087a046b40cca85dd462b3aaecc4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.619738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31c087a046b40cca85dd462b3aaecc4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.622175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.625671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29407a381ff24f7aa852c5b6e3995fcf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.628681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29407a381ff24f7aa852c5b6e3995fcf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.630442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29407a381ff24f7aa852c5b6e3995fcf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.650537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29407a381ff24f7aa852c5b6e3995fcf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.673667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1067/2107] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:27 2022] DELETE /identity/v3/users/29407a381ff24f7aa852c5b6e3995fcf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:27.674733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.694270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.695544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31c087a046b40cca85dd462b3aaecc4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.696522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31c087a046b40cca85dd462b3aaecc4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.707020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31c087a046b40cca85dd462b3aaecc4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.708040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31c087a046b40cca85dd462b3aaecc4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.710972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:27.733065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31c087a046b40cca85dd462b3aaecc4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:27.755991 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1041/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:27 2022] DELETE /identity/v3/users/b31c087a046b40cca85dd462b3aaecc4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:27.816791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493cbb-97b5-4dbb-8425-6cfa0a10ff6d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:27.909111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:27.918451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:27.919763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:27.920342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:27.920880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] PATH_INFO: `/v3/projects/5098e59e61f24d3d94ace17ec005d192/users/062377c2269d4c5399c3b0cea65eb174/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:27.945587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5098e59e61f24d3d94ace17ec005d192, user_id=062377c2269d4c5399c3b0cea65eb174, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:27.948556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:27.967288 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1068/2109] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:27 2022] PUT /identity/v3/projects/5098e59e61f24d3d94ace17ec005d192/users/062377c2269d4c5399c3b0cea65eb174/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:27.971440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:27.972906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:27.988381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d34-eb24-42b9-aa81-b646e807f37c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.057367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.058000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.058331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.058546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.059533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.060995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.072517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1042/2110] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:53:28.082124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.104447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f82f30-160a-4ade-b503-5b24cb87b164 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.110367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.113802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.114715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.115680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.115967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.116247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] PATH_INFO: `/v3/projects/5098e59e61f24d3d94ace17ec005d192/users/062377c2269d4c5399c3b0cea65eb174/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.118282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5098e59e61f24d3d94ace17ec005d192, user_id=062377c2269d4c5399c3b0cea65eb174, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.121351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aa847-224f-4cf3-ac9e-f7ebf231a8e3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.133610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d2ebd-9f2c-4959-a99e-cc272708b757 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.145084 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1069/2111] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:28 2022] PUT /identity/v3/projects/5098e59e61f24d3d94ace17ec005d192/users/062377c2269d4c5399c3b0cea65eb174/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:28.160890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828758e-da57-48ff-b00c-78445b44ed93 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.162095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828758e-da57-48ff-b00c-78445b44ed93 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.162703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828758e-da57-48ff-b00c-78445b44ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.207912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6828758e-da57-48ff-b00c-78445b44ed93 None None] MFA Rules not processed for user `062377c2269d4c5399c3b0cea65eb174`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.209204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6828758e-da57-48ff-b00c-78445b44ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.245261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.246935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.247269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.247838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] PATH_INFO: `/v3/projects/c20a336609264784817ea8fe150c14ef` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.249793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20a336609264784817ea8fe150c14ef)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.253931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.331871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1070/2112] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.333250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.333538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.333820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.362942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20a336609264784817ea8fe150c14ef', 'request_id': 'req-2b5827f4-fa21-4fd0-bafc-cf9842c82156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.366204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] MFA Rules not processed for user `8876b2482d5e45f7a2354661d7109858`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.367463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.369327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20a336609264784817ea8fe150c14ef', 'request_id': 'req-2b5827f4-fa21-4fd0-bafc-cf9842c82156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.383855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20a336609264784817ea8fe150c14ef', 'request_id': 'req-2b5827f4-fa21-4fd0-bafc-cf9842c82156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.400538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] The token cache is being invalidate because project c20a336609264784817ea8fe150c14ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:28.400906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.401538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.403608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1043/2113] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:28 2022] DELETE /identity/v3/projects/c20a336609264784817ea8fe150c14ef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:28.404598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.407128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.412425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:28.453471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1071/2114] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.454934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.457728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.494479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5827f4-fa21-4fd0-bafc-cf9842c82156 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.499644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.500663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.501203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.501611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] PATH_INFO: `/v3/projects/fc2cac01bd5043c39d678555c481266f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.503208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2cac01bd5043c39d678555c481266f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.504811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.515092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:28.553867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e22e6-624f-4265-b45b-89e8a6da612e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.565364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2cac01bd5043c39d678555c481266f', 'request_id': 'req-6dc49b10-5380-4b91-a44d-834d426fda9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.572300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2cac01bd5043c39d678555c481266f', 'request_id': 'req-6dc49b10-5380-4b91-a44d-834d426fda9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.580085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2cac01bd5043c39d678555c481266f', 'request_id': 'req-6dc49b10-5380-4b91-a44d-834d426fda9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.597882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] The token cache is being invalidate because project fc2cac01bd5043c39d678555c481266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:28.598256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.598882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6dc49b10-5380-4b91-a44d-834d426fda9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:28.601334 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1044/2115] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:28 2022] DELETE /identity/v3/projects/fc2cac01bd5043c39d678555c481266f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:28.602687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3999-c249-43b7-9b2e-9bcc05afb997 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.603019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3999-c249-43b7-9b2e-9bcc05afb997 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.603376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3999-c249-43b7-9b2e-9bcc05afb997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.628982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.629355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bfcb3999-c249-43b7-9b2e-9bcc05afb997 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.629655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.629942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.630223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.630605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bfcb3999-c249-43b7-9b2e-9bcc05afb997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.632322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.725434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.727295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90135b-6b69-4aaa-a20a-e7f497bb64da service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.739969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1045/2116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.741639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88624-634a-4b7c-8c4a-5396130e8e23 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.741933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88624-634a-4b7c-8c4a-5396130e8e23 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.742212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88624-634a-4b7c-8c4a-5396130e8e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.744508 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1072/2117] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:28.748437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.748739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.749030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.771822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-18e88624-634a-4b7c-8c4a-5396130e8e23 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.773332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18e88624-634a-4b7c-8c4a-5396130e8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.783205 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1046/2118] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.792550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.792970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.793265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.793549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.793772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.807990 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1073/2119] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.808658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.818989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff7944-b29b-4b35-b984-249ed7b42ba7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.824054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.824722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.825147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.825366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.826102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:28.826404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.826508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:28.828049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.829708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:28.843552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1074/2120] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:28.848034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.855776 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1047/2121] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:28.856288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.860221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481f8e-f972-48f9-acfb-94a2fc9ceb58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.877796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9ba45-a634-41ba-a6fe-ee7ffeea3692 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.882297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.884426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.884769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.885051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.888326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.891215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:28.892857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:28.893927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.895879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:28.896271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:28.897119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:28.897498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:28.899888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:28.928039 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1048/2122] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:28.931492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.958064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fba10-9069-4388-a0eb-ebb11b62e54f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:28.964578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1075/2123] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:28.965721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:28.971260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.022098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.060927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.061612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.061900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.063084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.064042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.079579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.112127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eef6fa-dd84-4115-9c8c-91e92a961ff3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.118643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.119385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.119838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.120119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.120861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.122775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.141539 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1049/2124] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:29.144518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.165858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1076/2125] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:28 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:53:29.179592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.196813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197697c-6aca-458d-819a-33ae34cde277 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.253845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa33be6-4400-4e45-88c6-80b664e42b29 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.261851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.262769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.262988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.263268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.264374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.266533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.295372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1050/2126] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:29 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:29.296723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.301211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.314482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.315817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.316051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.317221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.319109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.321058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.325864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b64c1-8a55-4357-b749-de61d7804825 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.338661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1077/2127] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:29.338661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.340257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.341857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.342332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.343927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] PATH_INFO: `/v3/users/5a7bf375260044768c222158a30bf499` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.347384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7bf375260044768c222158a30bf499)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.350253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d439-7e04-41d6-8d3c-8a8630d83c75 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.353401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.363564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.363564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.363564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.363564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.364003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.364238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.384885 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1078/2128] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:29.386146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.400221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac699ac-48ba-40f8-ae0e-7160573695d1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.408871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.413928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.414216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.414481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.415226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.416893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.429870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7bf375260044768c222158a30bf499'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:29.430759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7bf375260044768c222158a30bf499'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:29.434178 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1079/2129] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:29.434178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.436167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.440735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7bf375260044768c222158a30bf499'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:29.441469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7bf375260044768c222158a30bf499'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:29.453284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033230d1-3830-4da6-bcdb-65b4142958b4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.461058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.461788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.462569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.462569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.463357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.465049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.471984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fab8b98-dd03-40b8-a312-9d0430121562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7bf375260044768c222158a30bf499'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:29.475898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.476780 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1080/2130] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:29.477686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.479610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.494516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce7699-f9fe-4d57-a96b-c0051809769d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.500662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.502659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.503544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.503544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91/users/ad8f2774f3254b9785b484f87f9563bf/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.504118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1051/2131] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:29 2022] DELETE /identity/v3/users/5a7bf375260044768c222158a30bf499 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:29.506876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef307e6-3cbb-47d7-bf20-7c39343a9d73 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.508072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef307e6-3cbb-47d7-bf20-7c39343a9d73 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.508554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef307e6-3cbb-47d7-bf20-7c39343a9d73 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.512334 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1052/2132] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:53:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:29.513945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef307e6-3cbb-47d7-bf20-7c39343a9d73 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.529220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a805d2ab9d034eedb588e3efcae07c91, user_id=ad8f2774f3254b9785b484f87f9563bf, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.532712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba333a2a-cfc0-482a-9d56-5be1d3e7442a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.555782 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1081/2133] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:29 2022] PUT /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91/users/ad8f2774f3254b9785b484f87f9563bf/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:29.557308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88335a-aaad-488a-94e2-a5668498d1db None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.557601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88335a-aaad-488a-94e2-a5668498d1db None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.557890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88335a-aaad-488a-94e2-a5668498d1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.595660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ae88335a-aaad-488a-94e2-a5668498d1db None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:29.597163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae88335a-aaad-488a-94e2-a5668498d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.617183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef307e6-3cbb-47d7-bf20-7c39343a9d73 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.670645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.697132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1082/2134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:29.698567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.698930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.699282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.707235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.708176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.708456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.708886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] PATH_INFO: `/v3/projects/fe25927971764166811068e158422c43/users/4aa6164c410742cdae06f3e269022ae0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.724933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:29.728081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.747529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe25927971764166811068e158422c43, user_id=4aa6164c410742cdae06f3e269022ae0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:29.750524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19d06d-29b7-46f5-a2d2-d79aec3190a3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:29.779303 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1053/2135] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:29 2022] PUT /identity/v3/projects/fe25927971764166811068e158422c43/users/4aa6164c410742cdae06f3e269022ae0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:29.789863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8670-0778-44cf-a7d3-fb798667ac72 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.790153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8670-0778-44cf-a7d3-fb798667ac72 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.790485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8670-0778-44cf-a7d3-fb798667ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.824086 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1083/2136] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:29.824995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:29.827091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.848701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e65b8670-0778-44cf-a7d3-fb798667ac72 None None] MFA Rules not processed for user `ad8f2774f3254b9785b484f87f9563bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:29.851788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e65b8670-0778-44cf-a7d3-fb798667ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:29.901904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca0e36-7d9f-47c2-bfa9-aba054cd2d28 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:29.948027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1054/2137] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:29.949897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.950470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.950887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:29.979129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:29.980532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:29.981133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:29.981849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.000118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:30.004297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] MFA Rules not processed for user `4aa6164c410742cdae06f3e269022ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:30.005544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:30.083678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.085298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.092514 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1055/2138] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:30.093240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:30.094135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.098297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:30.102754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1084/2139] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:30.103568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.117919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb436d98-9566-4158-af1f-eec720b7a784 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.129513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.130350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.130652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.131915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.134120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.136125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.178618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1085/2140] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:30.180084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.221903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd103e-2790-4ec7-bfa1-ab87fccd5ee1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.265937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58667e-2ca5-4773-874d-4efd6f87b658 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.277543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.278263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.278573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.278888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.279695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.281939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.333696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.334624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.334961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.335296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.343193 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1086/2141] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:30.344838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.352502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.354501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.372481 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1056/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:30.373210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.385982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4b7e1-5c0d-4686-9215-8b5bc342839e service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.431420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:30.461754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.462758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.462758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.463038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.464058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.466612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.492954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d84a79-7aaa-4fed-bc76-7eee83642aca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.498804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.499723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.500274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.500686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.501614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.504138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.506319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1057/2143] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:30 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:30.511605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.538533 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1087/2144] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:30 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:30.543116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.560990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6433f0-73c4-46da-b749-3f3af518cc58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.562440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2856c0e-e4d4-4455-943f-4907fbe60b13 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.572347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.573327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.573735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.574201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.575219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.575818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.576700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.577094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.577450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.578318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.578807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.581130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.620066 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1058/2145] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:30.620515 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1088/2146] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:30.621594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.625083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.628884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:30.652347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2592a9-8651-439f-a876-8a44b352b555 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.663687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.663892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c026-3236-4aef-9371-800ac2b70606 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.676749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.677756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.678862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.679579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.679888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] PATH_INFO: `/v3/projects/9ee37fb7d9164b519240b601b70013c7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.681344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.681855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] PATH_INFO: `/v3/projects/c944b2478c7d4517856228fdd16c3a73/users/ec8ebb6eb4d24bfb9094dfc28688a374/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.682418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee37fb7d9164b519240b601b70013c7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.692662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.721011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944b2478c7d4517856228fdd16c3a73, user_id=ec8ebb6eb4d24bfb9094dfc28688a374, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.724510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:30.759663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1089/2147] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:30 2022] PUT /identity/v3/projects/c944b2478c7d4517856228fdd16c3a73/users/ec8ebb6eb4d24bfb9094dfc28688a374/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:30.760531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.806915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee37fb7d9164b519240b601b70013c7', 'request_id': 'req-1c5de794-1a5d-4c3e-9773-831d283c5c8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:30.819930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee37fb7d9164b519240b601b70013c7', 'request_id': 'req-1c5de794-1a5d-4c3e-9773-831d283c5c8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:30.832711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee37fb7d9164b519240b601b70013c7', 'request_id': 'req-1c5de794-1a5d-4c3e-9773-831d283c5c8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:30.840200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:30.852883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] The token cache is being invalidate because project 9ee37fb7d9164b519240b601b70013c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:30.853290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:30.854156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:30.856276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1059/2148] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:30 2022] DELETE /identity/v3/projects/9ee37fb7d9164b519240b601b70013c7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:30.857240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:30.858833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:30.916825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59b62a-50fe-4d09-99d8-a60c0d8e69e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.960133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de794-1a5d-4c3e-9773-831d283c5c8a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:30.966104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:30.967156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:30.967549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:30.967933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] PATH_INFO: `/v3/users/9d9acb7edff248c4802b8b514e59c90a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:30.969270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9acb7edff248c4802b8b514e59c90a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:30.971447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.027166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.028111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.028669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.028997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] PATH_INFO: `/v3/projects/c1b2a31608234c28a731f9bbb396b02d/users/74de1647e7ff4317a78ce22de8e4aca4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.035546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:31.043936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9acb7edff248c4802b8b514e59c90a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.045202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9acb7edff248c4802b8b514e59c90a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.057088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9acb7edff248c4802b8b514e59c90a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.057910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9acb7edff248c4802b8b514e59c90a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.061641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b2a31608234c28a731f9bbb396b02d, user_id=74de1647e7ff4317a78ce22de8e4aca4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.065492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.073618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9acb7edff248c4802b8b514e59c90a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.087415 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1090/2149] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:30 2022] PUT /identity/v3/projects/c1b2a31608234c28a731f9bbb396b02d/users/74de1647e7ff4317a78ce22de8e4aca4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:31.088848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.091919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.094720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1060/2150] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:30 2022] DELETE /identity/v3/users/9d9acb7edff248c4802b8b514e59c90a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:31.096017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.098608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.214037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd8bca-982e-47f7-953d-5a72a9c3b17c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.285368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b59c-cc18-42bc-ad9f-134c2e35cb93 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.310864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.312452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.312730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.313007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] PATH_INFO: `/v3/users/062377c2269d4c5399c3b0cea65eb174` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.316323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] RBAC: Authorizing `identity:delete_user(user_id=062377c2269d4c5399c3b0cea65eb174)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.320711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.337704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:31.363632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.363632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.363632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.363632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.364227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.364227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.398237 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1091/2151] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:31.401114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.405038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.440534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038c30-cf2e-4cf5-9427-cb7d1c8104d6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.448221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.448482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.448820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.449296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.450377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.452479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.466251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062377c2269d4c5399c3b0cea65eb174'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.467165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062377c2269d4c5399c3b0cea65eb174'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.478562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1092/2152] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:31.480139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.482283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.489214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062377c2269d4c5399c3b0cea65eb174'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.490311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062377c2269d4c5399c3b0cea65eb174'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.499168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e600b3-0c49-405b-9386-fcfb77c99450 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.504973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.505960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.506251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.506621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] PATH_INFO: `/v3/projects/c944b2478c7d4517856228fdd16c3a73/users/ec8ebb6eb4d24bfb9094dfc28688a374/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.509142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c944b2478c7d4517856228fdd16c3a73, user_id=ec8ebb6eb4d24bfb9094dfc28688a374, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.512215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.519575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-899304b6-b08b-443d-aae7-e88515f9885d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062377c2269d4c5399c3b0cea65eb174'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:31.530805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1093/2153] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:31 2022] PUT /identity/v3/projects/c944b2478c7d4517856228fdd16c3a73/users/ec8ebb6eb4d24bfb9094dfc28688a374/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:31.532187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.534453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.550740 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1061/2154] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:31 2022] DELETE /identity/v3/users/062377c2269d4c5399c3b0cea65eb174 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:31.554958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.556048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.557104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.647370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] MFA Rules not processed for user `ec8ebb6eb4d24bfb9094dfc28688a374`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:31.648866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.651193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6f04-dad8-4005-9bfb-71f4f2b74cc7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.710892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:31.784494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:31.785129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:31.785301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:31.786488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] PATH_INFO: `/v3/projects/c1b2a31608234c28a731f9bbb396b02d/users/74de1647e7ff4317a78ce22de8e4aca4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:31.789440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b2a31608234c28a731f9bbb396b02d, user_id=74de1647e7ff4317a78ce22de8e4aca4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:31.795258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:31.800386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1062/2155] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:31.811876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.814507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.833102 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1094/2156] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:31 2022] PUT /identity/v3/projects/c1b2a31608234c28a731f9bbb396b02d/users/74de1647e7ff4317a78ce22de8e4aca4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:31.834048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:31.838219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:31.988450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeae5cd-3f09-47de-b2d8-eb9e94cd9a49 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:31.995069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b148be-4788-4949-bdd4-ad06eb1ab55b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.003264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.004597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.007252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.008136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] PATH_INFO: `/v3/projects/aec2eb2be3bf4569978af88238bcd375` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.011472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec2eb2be3bf4569978af88238bcd375)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.013986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.035772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:32.128254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec2eb2be3bf4569978af88238bcd375', 'request_id': 'req-a1de8dba-007f-4ab7-91bb-4bc540402dff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.129482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.130510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.131368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.133479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.142749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec2eb2be3bf4569978af88238bcd375', 'request_id': 'req-a1de8dba-007f-4ab7-91bb-4bc540402dff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.152063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec2eb2be3bf4569978af88238bcd375', 'request_id': 'req-a1de8dba-007f-4ab7-91bb-4bc540402dff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.168746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] The token cache is being invalidate because project aec2eb2be3bf4569978af88238bcd375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:32.169487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.170206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1de8dba-007f-4ab7-91bb-4bc540402dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.172172 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1095/2157] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:31 2022] DELETE /identity/v3/projects/aec2eb2be3bf4569978af88238bcd375 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:32.173535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.173822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.174187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.203368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] MFA Rules not processed for user `74de1647e7ff4317a78ce22de8e4aca4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:32.204718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.214012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:32.224763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.226494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.237311 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1063/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:32.238062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:32.239420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.254659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72cc6-c777-4f09-a867-a823e9846f1b service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.296397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1096/2159] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:32.296844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:32.299229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.332209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.333110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.333479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.333752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] PATH_INFO: `/v3/users/66b6d873574540ad866d203f7a562270` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.334986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b6d873574540ad866d203f7a562270)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.337554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.385106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f1dbc-c9f0-49b5-87eb-e308929b5c52 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.390100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.390981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.391336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.391636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] PATH_INFO: `/v3/projects/5098e59e61f24d3d94ace17ec005d192` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.392992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5098e59e61f24d3d94ace17ec005d192)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.395944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.401499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b6d873574540ad866d203f7a562270'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.402246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b6d873574540ad866d203f7a562270'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.409983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b6d873574540ad866d203f7a562270'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.410738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b6d873574540ad866d203f7a562270'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.422286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:32.426464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b6d873574540ad866d203f7a562270'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.448544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1064/2160] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:32 2022] DELETE /identity/v3/users/66b6d873574540ad866d203f7a562270 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:32.449476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:32.450896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.452639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5098e59e61f24d3d94ace17ec005d192', 'request_id': 'req-75aab448-535c-4b36-91ff-090794c2ef83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.462762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5098e59e61f24d3d94ace17ec005d192', 'request_id': 'req-75aab448-535c-4b36-91ff-090794c2ef83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.471100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5098e59e61f24d3d94ace17ec005d192', 'request_id': 'req-75aab448-535c-4b36-91ff-090794c2ef83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.495232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] The token cache is being invalidate because project 5098e59e61f24d3d94ace17ec005d192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:32.495435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.496218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.498074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1097/2161] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:32 2022] DELETE /identity/v3/projects/5098e59e61f24d3d94ace17ec005d192 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:32.502653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:32.504072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.543690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66541dd-02cc-4345-9a29-e0df30a78013 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.549033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.550037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.550380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.550718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] PATH_INFO: `/v3/users/8876b2482d5e45f7a2354661d7109858` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.552062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8876b2482d5e45f7a2354661d7109858)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.554076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.568952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:32.595775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aab448-535c-4b36-91ff-090794c2ef83 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.619006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8876b2482d5e45f7a2354661d7109858'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.619926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8876b2482d5e45f7a2354661d7109858'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.629313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8876b2482d5e45f7a2354661d7109858'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.630830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8876b2482d5e45f7a2354661d7109858'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.644783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9eef96e0-4309-4690-b7d1-7018450c5854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8876b2482d5e45f7a2354661d7109858'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:32.662305 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1065/2162] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:32 2022] DELETE /identity/v3/users/8876b2482d5e45f7a2354661d7109858 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:32.665336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37c27-b6f5-4b31-9e66-1bbc43ace4a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.665336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37c27-b6f5-4b31-9e66-1bbc43ace4a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.665336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37c27-b6f5-4b31-9e66-1bbc43ace4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.689310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.690251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.690631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.691004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.694180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.699993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ecb37c27-b6f5-4b31-9e66-1bbc43ace4a6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:32.701436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ecb37c27-b6f5-4b31-9e66-1bbc43ace4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.753677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:32.794619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:32.795844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1066/2163] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:32.796239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:32.797359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c26ee-91d9-422d-8e93-a99016dcb93d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.797715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c26ee-91d9-422d-8e93-a99016dcb93d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.798132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c26ee-91d9-422d-8e93-a99016dcb93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.814453 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1098/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:32.815595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:32.817076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.837788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7b6c26ee-91d9-422d-8e93-a99016dcb93d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:32.839054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b6c26ee-91d9-422d-8e93-a99016dcb93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.857423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1067/2165] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:32.858592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023d-ae17-4f8a-932e-6f5754959a45 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.858971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023d-ae17-4f8a-932e-6f5754959a45 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.859253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023d-ae17-4f8a-932e-6f5754959a45 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.860748 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1068/2166] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:32.864755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.865034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.865370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:32.902773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:32.904469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.915255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc6579-d5b5-4f42-83ce-395a3033f26f service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:32.921258 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1069/2167] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:32.923060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:32.925765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:32.990447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:32.991108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:32.991388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:32.991717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.004227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.005619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.016283 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1099/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:33.017190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.018911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.035643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05592b2-2a90-494d-bb22-1f8d866230b0 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.040920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.042040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.042654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.043263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] PATH_INFO: `/v3/projects/7c5bb0b3677e47bca64a19e190c1f528` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.044746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5bb0b3677e47bca64a19e190c1f528)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.046690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.062009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.085171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:33.122766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5bb0b3677e47bca64a19e190c1f528', 'request_id': 'req-d0eb1287-1618-4e16-abf5-61b9525ec9d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.136146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5bb0b3677e47bca64a19e190c1f528', 'request_id': 'req-d0eb1287-1618-4e16-abf5-61b9525ec9d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.143169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5bb0b3677e47bca64a19e190c1f528', 'request_id': 'req-d0eb1287-1618-4e16-abf5-61b9525ec9d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.163452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] The token cache is being invalidate because project 7c5bb0b3677e47bca64a19e190c1f528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:33.163779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.164555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.167665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1100/2169] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:33 2022] DELETE /identity/v3/projects/7c5bb0b3677e47bca64a19e190c1f528 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:33.168885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e431f-8bee-47a4-906e-63b3c23ba4f4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.172331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.174123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.207675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:33.263276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1287-1618-4e16-abf5-61b9525ec9d2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.273855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.275330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.276047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.276477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.278409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:33.278729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.281688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31389eb4-debf-4ab7-8a37-8ba87d673894 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.287111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.288532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.288904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.289171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.291092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.293804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.298960 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1070/2170] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:32 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:33.298960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.298960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.312018 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1101/2171] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:33.317658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.317853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.318957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.319212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1755ae-f3a9-4326-83bd-a35bd312e67c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.325897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.328273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.328607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.329176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] PATH_INFO: `/v3/users/4aa6164c410742cdae06f3e269022ae0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.330372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa6164c410742cdae06f3e269022ae0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.332568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.348266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:33.349472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.367969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1102/2172] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:33.369181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.370893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.387857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5b448-4d72-4e31-ae74-8eae4b4aab3a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.395750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.397626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.398002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.398826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] PATH_INFO: `/v3/projects/2d9304b76a754b31bb48d933a61eb508` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.400729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9304b76a754b31bb48d933a61eb508)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.404163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.420595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa6164c410742cdae06f3e269022ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.421541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa6164c410742cdae06f3e269022ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.434731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa6164c410742cdae06f3e269022ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.436228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa6164c410742cdae06f3e269022ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.474278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9304b76a754b31bb48d933a61eb508', 'request_id': 'req-c1262f9d-4301-48dd-89b3-959456684c83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.474388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa6164c410742cdae06f3e269022ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.474480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9304b76a754b31bb48d933a61eb508', 'request_id': 'req-c1262f9d-4301-48dd-89b3-959456684c83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.480076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9304b76a754b31bb48d933a61eb508', 'request_id': 'req-c1262f9d-4301-48dd-89b3-959456684c83'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.495388 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1071/2173] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:33 2022] DELETE /identity/v3/users/4aa6164c410742cdae06f3e269022ae0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:33.497142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.499696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.515465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] The token cache is being invalidate because project 2d9304b76a754b31bb48d933a61eb508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:33.515794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.516567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1262f9d-4301-48dd-89b3-959456684c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.521662 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1103/2174] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:33 2022] DELETE /identity/v3/projects/2d9304b76a754b31bb48d933a61eb508 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:33.521662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6f58-166a-4313-a5ab-a6e1f748084e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.521662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6f58-166a-4313-a5ab-a6e1f748084e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.521662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee6f58-166a-4313-a5ab-a6e1f748084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.541813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-02ee6f58-166a-4313-a5ab-a6e1f748084e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:33.543069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02ee6f58-166a-4313-a5ab-a6e1f748084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.584849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:33.636328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1104/2175] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:33.638235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13c646-59d2-45d7-baf3-245f99eaac20 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.638468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13c646-59d2-45d7-baf3-245f99eaac20 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.638544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13c646-59d2-45d7-baf3-245f99eaac20 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.641945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1105/2176] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:33.643567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.645583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.645756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.650477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121abd-d01e-4572-b5b4-5a1131c2c791 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.662341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.663240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.664557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.664902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.665619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.668860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.698286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:33.699605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.705544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1072/2177] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:33 2022] POST /identity/v3/projects => generated 411 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:33.706757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.711359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.721076 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1106/2178] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:33.721997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.743761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe035-3494-4fd1-bc88-a31c45a7bebc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.784843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:33.831161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.831937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.832282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.832621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.834067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:33.834415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315fbf-9c2f-4ed3-b7c9-81794d770a32 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:33.834550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.836391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.841369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:33.842513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:33.842974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:33.843413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] PATH_INFO: `/v3/users/be43d67f52be4362abfd5c144057e5bd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:33.844929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be43d67f52be4362abfd5c144057e5bd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:33.847826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:33.851789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1107/2179] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:33.853017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:33.854840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.919761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be43d67f52be4362abfd5c144057e5bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.921337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be43d67f52be4362abfd5c144057e5bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.932382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be43d67f52be4362abfd5c144057e5bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.933526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be43d67f52be4362abfd5c144057e5bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.949187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be43d67f52be4362abfd5c144057e5bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:33.967194 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1073/2180] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:33 2022] DELETE /identity/v3/users/be43d67f52be4362abfd5c144057e5bd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:33.968159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.970374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:33.981904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:33.983337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.034025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:34.068522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a082e-6838-4979-96e2-c0c5d25c44e4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.072530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fd9-61e3-427f-bd79-8b676cefa4a8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.081862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.082757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.083164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.083562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.085333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.087882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.118744 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1074/2181] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:33 2022] POST /identity/v3/users => generated 306 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:34.119735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.121682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.164593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.166029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.166265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.166734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.168312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.171009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.173954 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1108/2182] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:33 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:34.174842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.178280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.199012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5895f10-4b4e-45a9-b9e2-a45cfad993c6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.208216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.210101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.210586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.210968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.212619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.218944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.229622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:34.239243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655682a9-47c6-4a66-a39c-1bb355609c55 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.246719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.250153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.250856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.251880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.256129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.283537 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1109/2183] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:34 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:34.285114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.289965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.295768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.322836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1075/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:34.324092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.357529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d7893-ee40-4ade-8368-3a1e097bb755 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.492875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe5b7c-3ee6-4dc6-82b4-4d5ec65dc664 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.506015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.507732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.508441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.509784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.511840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.517601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1624-1541-49a1-ad6a-939d9bfffb5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.545549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1110/2185] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:34.548933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.550753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.551410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.561296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.565008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.565632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.565921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.566647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.579869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.587233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] MFA Rules not processed for user `ad8f2774f3254b9785b484f87f9563bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:34.590118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.623852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1076/2186] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:34 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:34.624951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.637974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54795718-2040-4e78-ade4-9bf866e835dc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.650841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.652901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.654040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.654952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.657951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.661606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.691701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1077/2187] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:34.692801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.713904 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1111/2188] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:34.720930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.734750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a598ce-ab7b-4c44-b840-5f0294fc77cf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.741392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676c8ca-1e6c-42ac-b37b-4ec38f1ce5e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.748116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.748419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.749305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.750190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.750680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] PATH_INFO: `/v3/projects/5cbc12f9365047c9b7999773c46d4a4a/users/ff96d77ee4344ac5945c49400c23b0e1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.751462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.756146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.756796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.759875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.768923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.773852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbc12f9365047c9b7999773c46d4a4a, user_id=ff96d77ee4344ac5945c49400c23b0e1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.776665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.792428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1078/2189] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:34.796328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.798862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:34.803598 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1112/2190] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:34 2022] PUT /identity/v3/projects/5cbc12f9365047c9b7999773c46d4a4a/users/ff96d77ee4344ac5945c49400c23b0e1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:34.804587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:34.876413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:34.913454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd0608-5014-4c66-ade1-cb90b811f6b9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.918214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e45f97-2548-466a-be61-33c50b893cfc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:34.918869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:34.920035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.920334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.920683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.921395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:34.923736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc15a-1c4d-43e0-bd25-e6a808e4f6de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:34.933152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:34.948469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1113/2191] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:34.950671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:34.951241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:34.951529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:34.997864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] MFA Rules not processed for user `ff96d77ee4344ac5945c49400c23b0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:34.999493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.077547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.078706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.079113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.081438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.085403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.131745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1114/2192] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:35.132643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.158829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ec03-7154-49f9-91af-9b989c68e947 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.169385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.170793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.171203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.171659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] PATH_INFO: `/v3/projects/b3a244c436984bd2a081c670a15ebc66/users/892bd60afe3a411c8aaf951acf49cbd6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.193065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a244c436984bd2a081c670a15ebc66, user_id=892bd60afe3a411c8aaf951acf49cbd6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.196417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.200488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.202500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.214615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1079/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:35.215726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.217130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.235951 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1115/2194] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:35 2022] PUT /identity/v3/projects/b3a244c436984bd2a081c670a15ebc66/users/892bd60afe3a411c8aaf951acf49cbd6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:35.235951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.236622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51eff4-4325-4b22-96e7-6d90f5d3a4f0 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.333111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.334016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.334302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.334584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] PATH_INFO: `/v3/projects/c7790ed18a2d410da270e2ab6717ea3d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.335894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7790ed18a2d410da270e2ab6717ea3d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.337862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.341438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf578db-1ff1-4fea-b941-ef337393bb2b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.350043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.351039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.351495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.352499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.353348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.357109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5bf87-4224-40de-b91a-03a3d973305f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.365599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:35.420061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1116/2195] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:35.422449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.423566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.424296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.426610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7790ed18a2d410da270e2ab6717ea3d', 'request_id': 'req-537c3181-8130-45cb-84b9-ee7f89fbbf62'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.435954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7790ed18a2d410da270e2ab6717ea3d', 'request_id': 'req-537c3181-8130-45cb-84b9-ee7f89fbbf62'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.447143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7790ed18a2d410da270e2ab6717ea3d', 'request_id': 'req-537c3181-8130-45cb-84b9-ee7f89fbbf62'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.463500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] MFA Rules not processed for user `892bd60afe3a411c8aaf951acf49cbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:35.464945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.471158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] The token cache is being invalidate because project c7790ed18a2d410da270e2ab6717ea3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:35.471641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.472717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.475230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1080/2196] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:35 2022] DELETE /identity/v3/projects/c7790ed18a2d410da270e2ab6717ea3d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:35.476166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.477908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.513010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:35.554711 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1117/2197] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:35.555573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.557116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.557370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c3181-8130-45cb-84b9-ee7f89fbbf62 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.637338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17cc61-0589-4c96-8771-af2e353998e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.644099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.652906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.653069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.654111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.654801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.655180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] PATH_INFO: `/v3/projects/fe25927971764166811068e158422c43` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.656808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe25927971764166811068e158422c43)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.657787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.658750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.659014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.659773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.662288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e830bb-dda9-4ec2-b352-405d90b5a30c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.691113 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1118/2198] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/users => generated 311 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:35.694576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.694576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.694576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.716191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:35.717501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.729868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe25927971764166811068e158422c43', 'request_id': 'req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.732110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:35.737805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe25927971764166811068e158422c43', 'request_id': 'req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.745551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe25927971764166811068e158422c43', 'request_id': 'req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.760206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] The token cache is being invalidate because project fe25927971764166811068e158422c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:35.760490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.761174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.763144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1081/2199] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:35 2022] DELETE /identity/v3/projects/fe25927971764166811068e158422c43 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:35.764286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.765856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.799831 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1119/2200] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:35.801519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.803750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.823100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5c3b6-f0ef-4de7-9c29-e57eda47155d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.829517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.829857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.830139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.830414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.831151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.834100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5a42-0e74-446a-a9ad-545b68eb3c1a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.843992 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1120/2201] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:35.846000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.846290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.846568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.848131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1121/2202] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:35.848638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532cbf-7b65-4e78-91a9-c3b5ae0d3abd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.848827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.850576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.857628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.857628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.857628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.861545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.861545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.861545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e504-7485-470b-a404-c299a7295910 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.871394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840dceb-9a71-4a35-8fba-d776bb3b631b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:35.877599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:35.878741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.878968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.879204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] PATH_INFO: `/v3/users/ec8ebb6eb4d24bfb9094dfc28688a374` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.880792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8ebb6eb4d24bfb9094dfc28688a374)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:35.882906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:35.891369 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1082/2203] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:35.892925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:35.893353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:35.893720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:35.919921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:35.921324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:35.944520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8ebb6eb4d24bfb9094dfc28688a374'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.949561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:35.952824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8ebb6eb4d24bfb9094dfc28688a374'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.954231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8ebb6eb4d24bfb9094dfc28688a374'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.954977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8ebb6eb4d24bfb9094dfc28688a374'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.969990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8ebb6eb4d24bfb9094dfc28688a374'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:35.991118 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1122/2204] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:35 2022] DELETE /identity/v3/users/ec8ebb6eb4d24bfb9094dfc28688a374 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:35.992786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:35.995363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.002605 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1083/2205] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:36.003853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:36.005564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.122297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:36.133598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.138499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.138938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfd7fc-78df-4e65-a001-c1da270aaaa8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.148601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.150253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.150673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.151143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] PATH_INFO: `/v3/projects/c3b5ab25488544b3a376ca33a4f1435d/users/a944f5dd13e84ec2bb07722a5ef6a6b7/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.182000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b5ab25488544b3a376ca33a4f1435d, user_id=a944f5dd13e84ec2bb07722a5ef6a6b7, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.187324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.211489 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1123/2206] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:35 2022] PUT /identity/v3/projects/c3b5ab25488544b3a376ca33a4f1435d/users/a944f5dd13e84ec2bb07722a5ef6a6b7/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:36.212702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.214467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.253529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43e01c-a95d-4507-968c-f2775e7828dd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.291823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaeb2e5-7075-4c42-acd9-befcdd1634c4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.297110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.297870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.298153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.298519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.299160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.301166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.322522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.323831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.323944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.324406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.325538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.328426 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1124/2207] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:36.328682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.328868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.329792 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1084/2208] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:36 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:36.330579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.332365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.346828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4488afe-13c5-4597-9355-3ce917cf9f55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.347037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284056e2-67ee-4687-b8da-aa6b3cd03f43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.352136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.353033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.354276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.354554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] PATH_INFO: `/v3/users/71d0d753d0314e44b9cd7fba3ab1cd26` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.355824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d0d753d0314e44b9cd7fba3ab1cd26)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.359073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.369212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.369910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.370664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.376114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.378560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:36.380905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.386069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.400995 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1085/2209] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:36.401931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.422759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd11268-e23c-4b93-8d8e-27ea19d2ec55 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.428815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.429972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.430613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.431040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.432071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:36.434093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.438020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.445187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d0d753d0314e44b9cd7fba3ab1cd26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.451199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1086/2210] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:36.453126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d0d753d0314e44b9cd7fba3ab1cd26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.453882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d0d753d0314e44b9cd7fba3ab1cd26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.454612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d0d753d0314e44b9cd7fba3ab1cd26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.455366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.457252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.467041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d0d753d0314e44b9cd7fba3ab1cd26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.469975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3419608-6125-4e38-a18b-7f5b677e6f27 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.475300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.476036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.476309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.476618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.477350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.479147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.483039 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1125/2211] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:36 2022] DELETE /identity/v3/users/71d0d753d0314e44b9cd7fba3ab1cd26 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:36.483991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.485592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.489872 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1087/2212] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:36.490683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.492917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.509382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614f03-57f2-496a-a3c7-1451ca0c91f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.553446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dfea6-e79d-4f46-94e2-7a9dc6aba9d4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.558285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.559166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.559445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.559793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] PATH_INFO: `/v3/projects/c944b2478c7d4517856228fdd16c3a73` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.560930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c944b2478c7d4517856228fdd16c3a73)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.562842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.570173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.570912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.571270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.571575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.572272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.574178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3c976-daa0-48b9-89d7-7e962957c833 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.602213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:36.609906 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1088/2213] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:36.611896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.612377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.612885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.613983 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1089/2214] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:36.614778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.617554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.622921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c944b2478c7d4517856228fdd16c3a73', 'request_id': 'req-97d8b105-0cb0-445d-90f5-b6e3be6a3985'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.631704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c944b2478c7d4517856228fdd16c3a73', 'request_id': 'req-97d8b105-0cb0-445d-90f5-b6e3be6a3985'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.638282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c944b2478c7d4517856228fdd16c3a73', 'request_id': 'req-97d8b105-0cb0-445d-90f5-b6e3be6a3985'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.652349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] The token cache is being invalidate because project c944b2478c7d4517856228fdd16c3a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:36.652637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.653290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-97d8b105-0cb0-445d-90f5-b6e3be6a3985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:36.654890 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1126/2215] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:36 2022] DELETE /identity/v3/projects/c944b2478c7d4517856228fdd16c3a73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:36.656152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.656439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.656830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.674799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:36.676079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.696866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9b54-279f-4a88-93fa-9dead818e8e7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.703874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.705386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.705676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.705954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] PATH_INFO: `/v3/projects/c3b5ab25488544b3a376ca33a4f1435d/users/a944f5dd13e84ec2bb07722a5ef6a6b7/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.708251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b5ab25488544b3a376ca33a4f1435d, user_id=a944f5dd13e84ec2bb07722a5ef6a6b7, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.710939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.720669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:36.722897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1090/2216] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:36 2022] PUT /identity/v3/projects/c3b5ab25488544b3a376ca33a4f1435d/users/a944f5dd13e84ec2bb07722a5ef6a6b7/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:36.723572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.725682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.761915 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1127/2217] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:36.762803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.764207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.778739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9203c8-3f56-4423-bbc9-fee5228ba003 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.818915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6e449-19a6-4a62-91f1-9f00bf68684a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:36.824688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.825715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.826081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.826451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] PATH_INFO: `/v3/projects/b331425a1e474f02a8134b7269265e59/users/cb11a06599d448559a7baf49764381ea/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.842257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b331425a1e474f02a8134b7269265e59, user_id=cb11a06599d448559a7baf49764381ea, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.845155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.850386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:36.851110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.851378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.851689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.852584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:36.854332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e989-e9a4-4342-878b-7e8e5ca7421d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:36.864101 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1091/2218] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:36 2022] PUT /identity/v3/projects/b331425a1e474f02a8134b7269265e59/users/cb11a06599d448559a7baf49764381ea/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:36.865545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:36.867696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.880267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1128/2219] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:36.882184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d11f2-2acb-4139-b502-679767a1758a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.882639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d11f2-2acb-4139-b502-679767a1758a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.882922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d11f2-2acb-4139-b502-679767a1758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:36.903763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-339d11f2-2acb-4139-b502-679767a1758a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:36.905229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-339d11f2-2acb-4139-b502-679767a1758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.951984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:36.953422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:36.971469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:36.972053 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1129/2220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:36.973520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:36.973759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:36.974045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.008585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] MFA Rules not processed for user `a944f5dd13e84ec2bb07722a5ef6a6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:37.009736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.045750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e74473-6337-4586-b942-bbe209f03573 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.052065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.052960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.053250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.053530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.054812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.057043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.059336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1092/2221] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:36 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:37.060273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.064826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.122007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1130/2222] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:37.122990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.124998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:37.139766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebec93-5b39-44f7-9f19-6e78641e1494 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.146353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.147049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.147333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.147665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.148568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.150442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.170509 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1131/2223] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:37.171419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59567e-ba6b-40ed-b6a6-151221c86631 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.171976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.176589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.177458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.177736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.178007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.183204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034211a-81cd-421e-ac77-8502a99d7ce3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.188484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.189164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.189444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.189725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.189876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.190475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.191218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0d0c3-7414-4dfb-b69b-4d0531aa46b0 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.192481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dd5e5-0150-4792-829f-14c0730537d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.204090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1132/2224] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:37.212653 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1093/2225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:37.214577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54525e-7276-4b7d-98c8-ce2f457b6b7b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.216225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54525e-7276-4b7d-98c8-ce2f457b6b7b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.217576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54525e-7276-4b7d-98c8-ce2f457b6b7b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.227332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1094/2226] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:37.228664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54525e-7276-4b7d-98c8-ce2f457b6b7b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.230919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.231202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.231480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.265578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54525e-7276-4b7d-98c8-ce2f457b6b7b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.272438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.273362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.273768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.274338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.287422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.289058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:37.291288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.292322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.323745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1095/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:37.325860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.326251 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1133/2228] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:37.327347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.356877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bf8d-65ff-49c1-9bd3-ae2b0748c65f service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.365278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a537-7111-47cf-97c0-d5ccd76b950e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.375858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.375858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.376187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.376284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.376284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] PATH_INFO: `/v3/projects/b331425a1e474f02a8134b7269265e59/users/cb11a06599d448559a7baf49764381ea/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.376462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.376462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.376462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.376462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.376462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.378480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b331425a1e474f02a8134b7269265e59, user_id=cb11a06599d448559a7baf49764381ea, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.381361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.405624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1134/2229] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:37.410301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:37.412147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.418480 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1096/2230] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:37 2022] PUT /identity/v3/projects/b331425a1e474f02a8134b7269265e59/users/cb11a06599d448559a7baf49764381ea/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:37.436551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.443224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.469028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4d742-134a-4378-8b9a-601d5b79b031 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.591914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.593044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b651c-b0c0-4dd4-8000-a3ee2de4b971 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.593656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.594191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.594569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.596204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.598631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.604129 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1135/2231] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:37.605473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.606722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.607490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.607831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.608191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.608944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:37.609444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.611487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.636104 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1097/2232] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:37.637721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.652447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8c5f-48c2-45d6-9ba9-6fa9762af59b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.658288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.660087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.660230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.660494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] PATH_INFO: `/v3/projects/3ef34a6d89d0462d8643be6625b114d9/users/05553baaba2b4467abbb9ca58afcebd9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.681467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef34a6d89d0462d8643be6625b114d9, user_id=05553baaba2b4467abbb9ca58afcebd9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.684777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc07dc-64fd-4aff-89c1-28f05f8be746 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.702361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:37.726681 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1098/2233] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:37 2022] PUT /identity/v3/projects/3ef34a6d89d0462d8643be6625b114d9/users/05553baaba2b4467abbb9ca58afcebd9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:37.727451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0a76b-e04b-4fac-9ff2-50b8d8511bc7 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:37.727852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.728141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.728419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.766095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] MFA Rules not processed for user `cb11a06599d448559a7baf49764381ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:37.768049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.807111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:37.822642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:37.823288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:37.823599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:37.823883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:37.825764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.867639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1099/2234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:37.867639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.876928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:37.910659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:37.913198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:37.927841 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1136/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:37.928963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:37.993851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ba139-cad9-4cec-aba6-7ddf9d23735d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.000652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.001876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.002196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.002542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] PATH_INFO: `/v3/projects/b2009577e16e48458dd3eebf04938841` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.004346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2009577e16e48458dd3eebf04938841)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.006397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.031844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12943a4e-3df3-4cdb-90a3-7e03cb3f238b service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.038984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.039816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.040451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.040585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.041547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.044248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552d799-1002-49a1-890f-13706440ab99 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.080124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2009577e16e48458dd3eebf04938841', 'request_id': 'req-da13a357-655b-4c60-97f4-187caa74a248'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.083339 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1137/2236] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:37 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:38.085285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.085711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.085928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.092905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2009577e16e48458dd3eebf04938841', 'request_id': 'req-da13a357-655b-4c60-97f4-187caa74a248'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.107598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2009577e16e48458dd3eebf04938841', 'request_id': 'req-da13a357-655b-4c60-97f4-187caa74a248'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.120156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] MFA Rules not processed for user `ad8f2774f3254b9785b484f87f9563bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:38.120893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.132947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] The token cache is being invalidate because project b2009577e16e48458dd3eebf04938841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:38.135560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.137906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da13a357-655b-4c60-97f4-187caa74a248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.138616 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1100/2237] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:37 2022] DELETE /identity/v3/projects/b2009577e16e48458dd3eebf04938841 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:38.140510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.141024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.141582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.174440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] MFA Rules not processed for user `05553baaba2b4467abbb9ca58afcebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:38.176063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.185464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:38.219636 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1138/2238] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:38.221415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.224903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.285007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:38.285221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1101/2239] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:38.286381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.287994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.357625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817404e-e2ab-473a-befa-7217ce7b9993 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.366086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.366992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.367343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.368720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.369783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:38.370501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.373125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.387754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456866a-b9e6-4d21-9551-40fabc5612b5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.390266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1139/2240] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:38.391842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.396983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.398333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.399630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.399978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.400361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] PATH_INFO: `/v3/users/ff96d77ee4344ac5945c49400c23b0e1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.402419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff96d77ee4344ac5945c49400c23b0e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.404345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.412208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4543e1-d767-4d3d-9724-47153a629b0c tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.416620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.417303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.417584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.418541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.418541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.420575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.444959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1140/2241] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:38.445814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.447879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.464772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c18bf-6dea-47e8-8f3f-e98d9e1e182c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.470143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.471127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.471402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.471780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] PATH_INFO: `/v3/users/2b7abc81647948b58d455c411ff55853` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.472988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7abc81647948b58d455c411ff55853)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.474484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff96d77ee4344ac5945c49400c23b0e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.474953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.479593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff96d77ee4344ac5945c49400c23b0e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.488222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff96d77ee4344ac5945c49400c23b0e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.489021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff96d77ee4344ac5945c49400c23b0e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.509990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff96d77ee4344ac5945c49400c23b0e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.526830 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1102/2242] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:38 2022] DELETE /identity/v3/users/ff96d77ee4344ac5945c49400c23b0e1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:38.530664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.532317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.537126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7abc81647948b58d455c411ff55853'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.546674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7abc81647948b58d455c411ff55853'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.547733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7abc81647948b58d455c411ff55853'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.548775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7abc81647948b58d455c411ff55853'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.562708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7abc81647948b58d455c411ff55853'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.571434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:38.582421 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1141/2243] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:38 2022] DELETE /identity/v3/users/2b7abc81647948b58d455c411ff55853 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:38.583744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.585634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.626859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772e851-531c-4cc1-b81c-c510ddd8f0df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.672316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5ba5c-ba16-4b2d-bb2b-81823514ce3e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.678450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.679150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.679848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.680120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.681316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.683540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.703868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.705819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.706154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.706474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] PATH_INFO: `/v3/users/90ddce5b88fa408ea66da1aba6af4a8f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.708172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ddce5b88fa408ea66da1aba6af4a8f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.710463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.711412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:38.725823 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1142/2244] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:38.726752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.729678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.784902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ddce5b88fa408ea66da1aba6af4a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.785559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ddce5b88fa408ea66da1aba6af4a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.796078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ddce5b88fa408ea66da1aba6af4a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.798145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ddce5b88fa408ea66da1aba6af4a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.808665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc213-e1e4-4dab-b7a4-26318ac8cc1a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.814734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:38.815415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.815732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.816786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.816786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:38.817648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ddce5b88fa408ea66da1aba6af4a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:38.818642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8f3a-01cb-4098-848c-667b72042f24 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:38.844776 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1103/2245] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:38 2022] DELETE /identity/v3/users/90ddce5b88fa408ea66da1aba6af4a8f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:38.849143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.851470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.862051 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1143/2246] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:38.863492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a339c5-4f02-452e-887d-41b39b58fbf4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.864026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a339c5-4f02-452e-887d-41b39b58fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.864163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a339c5-4f02-452e-887d-41b39b58fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.885589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-20a339c5-4f02-452e-887d-41b39b58fbf4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:38.886809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20a339c5-4f02-452e-887d-41b39b58fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:38.921448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:38.945994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4483ea-eb3f-46e0-9d3a-2e54ca707c25 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:38.970935 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1144/2247] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:38.972455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:38.972714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:38.972996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:38.974425 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1145/2248] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:38.981534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:38.983345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.005259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec32a1-5878-465b-9e90-44905f831c42 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.009874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.010577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.010862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.011133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.011865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.013832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.021136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.022045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.022389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.022778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.023546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.025152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30647b1-f148-4ce7-92f1-4bc897095f95 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.039943 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1104/2249] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:39.039943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030bc-e974-4000-876b-938db78a4913 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.039943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030bc-e974-4000-876b-938db78a4913 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.039943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a030bc-e974-4000-876b-938db78a4913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.040587 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1146/2250] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:38 2022] POST /identity/v3/users => generated 303 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:39.041818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.043920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.057680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-28a030bc-e974-4000-876b-938db78a4913 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:39.058881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-28a030bc-e974-4000-876b-938db78a4913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.066720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1105/2251] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:39.067545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a030bc-e974-4000-876b-938db78a4913 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.068917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-28a030bc-e974-4000-876b-938db78a4913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.080986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a030bc-e974-4000-876b-938db78a4913 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.085735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.086607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.086885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.087163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] PATH_INFO: `/v3/projects/4935f1f1adc44a51a1219c7258357184` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.088379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4935f1f1adc44a51a1219c7258357184)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.090277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.132138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0431-684b-475c-8d4a-a00b3653b7ea admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.142721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.146787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4935f1f1adc44a51a1219c7258357184', 'request_id': 'req-451c52b7-3c31-4af8-9240-12d995e6c013'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:39.153980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4935f1f1adc44a51a1219c7258357184', 'request_id': 'req-451c52b7-3c31-4af8-9240-12d995e6c013'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:39.161284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4935f1f1adc44a51a1219c7258357184', 'request_id': 'req-451c52b7-3c31-4af8-9240-12d995e6c013'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:39.175845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] The token cache is being invalidate because project 4935f1f1adc44a51a1219c7258357184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:39.176126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:39.176794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:39.178390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1106/2252] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:39 2022] DELETE /identity/v3/projects/4935f1f1adc44a51a1219c7258357184 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:39.179160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:39.180499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.207214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.207926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.208206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.208482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.209221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:39.209526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.211186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.223752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1147/2253] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:39.225384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.227115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.266027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.267580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.275697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.298152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6ebd-640e-4b8b-890f-6557b01fbddd tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.301889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.302490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.302741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.303008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.305782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.347073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c52b7-3c31-4af8-9240-12d995e6c013 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.352837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.353725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.354011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.354293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.355642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.357781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.359831 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1107/2254] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:39.360475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.362652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.376119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.378108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.378370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d590-5eae-4363-9bd8-70a4e5d9dead tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.383081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.383802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.384092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.384901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.385108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.386723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.391235 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1148/2255] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:39.391454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.393531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.401506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1108/2256] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:39.401506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.408243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a614f8-b7dd-4ef0-9deb-ff7ccb0c7f39 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.411106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcb15c-0bcd-4c90-afbe-2462aa7fc6c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.415281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.415452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.415980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.416428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.416798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.416909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.417250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.417621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.418631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.418745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.420971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd8a37-860d-4163-9978-d6cf2a6bf83a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.433148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.434125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1149/2257] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:39.435913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.436306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.437282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.439076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.451091 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1109/2258] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:39.452027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.453906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.469569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:39.472262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.475876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae907b-e460-4af1-8513-31742adbbc5f service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.489009 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1150/2259] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:39.489216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.489319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.489396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.489396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.489396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.492602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.512726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.513117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8436e38-8902-4f2a-a764-fd34d675717f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.513219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.526107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1110/2260] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:39.527182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.537302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.538315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.538744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.539030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] PATH_INFO: `/v3/projects/64f58e2ac15e44a2b0cadd5f9efc1a56/users/656e73f2cfc34336823facedf4b1a23a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.546733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28bf1d-b9ed-48f6-811b-ecf595781ccb service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.552238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.552885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.553166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.554364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] PATH_INFO: `/v3/projects/88c4fc51e48a41f7901df21322139226/users/aea29c7af6ba4ebda8b491e0ba2ae9f6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.561324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f58e2ac15e44a2b0cadd5f9efc1a56, user_id=656e73f2cfc34336823facedf4b1a23a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.565123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8b2ff-c0b1-44d9-82bd-d8d4319fd807 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.570689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c4fc51e48a41f7901df21322139226, user_id=aea29c7af6ba4ebda8b491e0ba2ae9f6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.573874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3d125-ec12-4a01-ab5b-2bf1c3fea380 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.584197 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1151/2261] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:39 2022] PUT /identity/v3/projects/64f58e2ac15e44a2b0cadd5f9efc1a56/users/656e73f2cfc34336823facedf4b1a23a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:39.586197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.586197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.586502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.603371 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1111/2262] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:39 2022] PUT /identity/v3/projects/88c4fc51e48a41f7901df21322139226/users/aea29c7af6ba4ebda8b491e0ba2ae9f6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:39.603371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7df0e-099c-4d84-8cdc-ae4ee6cc3d71 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.603371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7df0e-099c-4d84-8cdc-ae4ee6cc3d71 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.603371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7df0e-099c-4d84-8cdc-ae4ee6cc3d71 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.605839 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1112/2263] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:39.607575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ddc8-dfe8-4ccb-819d-0b03fa8dda40 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.607857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ddc8-dfe8-4ccb-819d-0b03fa8dda40 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.608202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7ddc8-dfe8-4ccb-819d-0b03fa8dda40 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.609922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1113/2264] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:39.611479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.611872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.612791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.616498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:39.617961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.633509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.661102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] MFA Rules not processed for user `656e73f2cfc34336823facedf4b1a23a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:39.663408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.703180 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1152/2265] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:39.705212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.719426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cab34-eeee-446b-912a-c6f52b3aedf5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.737503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.738208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.738490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.738769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.739930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.742791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.758666 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1153/2266] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:39.759598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:39.775757 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1114/2267] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:39.776763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:39.831317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.847562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.874632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.917972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb3be6-ec97-4d41-ba4d-fd4b013e2905 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.922840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.923825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.924139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.924414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects/68fdb6ec9d2b4580b68677281a07afec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.925600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:get_project(project_id=68fdb6ec9d2b4580b68677281a07afec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.927691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.929490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1154/2268] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/projects/68fdb6ec9d2b4580b68677281a07afec => generated 369 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:39.930263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.938651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062982a-2743-480f-9f73-9bfe4178deb2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.941157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a56f-84fb-485b-8f3b-fed211d494a6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.946426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.947271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.947881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.948305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.949455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.949810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:39.950490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.950672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.950956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.951304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.952628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.953042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.955668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.961750 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1115/2269] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:39.965056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.966942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1155/2270] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:39.967869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:39.969699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:39.980959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdc917-343e-4bd8-8b11-c59f62090e92 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.984078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ee457-9eac-4956-81b2-6ae7f1ee82b9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:39.987007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.988098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.988520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.988870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] PATH_INFO: `/v3/projects/88c4fc51e48a41f7901df21322139226/users/aea29c7af6ba4ebda8b491e0ba2ae9f6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.989775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:39.991308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:39.991778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c4fc51e48a41f7901df21322139226, user_id=aea29c7af6ba4ebda8b491e0ba2ae9f6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.991917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:39.992358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] PATH_INFO: `/v3/projects/eec20993c56848f3b51ef657573fd2fa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:39.993774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec20993c56848f3b51ef657573fd2fa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:39.994959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:39.996140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.007822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1116/2271] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:39 2022] PUT /identity/v3/projects/88c4fc51e48a41f7901df21322139226/users/aea29c7af6ba4ebda8b491e0ba2ae9f6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:40.008609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.036265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.062247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec20993c56848f3b51ef657573fd2fa', 'request_id': 'req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.069239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec20993c56848f3b51ef657573fd2fa', 'request_id': 'req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.074923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec20993c56848f3b51ef657573fd2fa', 'request_id': 'req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.079442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f6d41-aa11-441d-8e58-25b8be33e636 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.089001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] The token cache is being invalidate because project eec20993c56848f3b51ef657573fd2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:40.089381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.090039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.091684 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1156/2272] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:39 2022] DELETE /identity/v3/projects/eec20993c56848f3b51ef657573fd2fa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:40.092528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.093941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.142303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.142885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.143164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.143438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.144168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.146664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.157436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.163685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6a0e-ebbf-443c-86c8-677ceffa3e41 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.169136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.170028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.170347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.170626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] PATH_INFO: `/v3/projects/5cbc12f9365047c9b7999773c46d4a4a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.171901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbc12f9365047c9b7999773c46d4a4a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.173989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.178413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1117/2273] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/projects => generated 399 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:40.179571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.181228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.224943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbc12f9365047c9b7999773c46d4a4a', 'request_id': 'req-25305e37-a9cd-40a4-a12c-2298b76be067'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.231422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbc12f9365047c9b7999773c46d4a4a', 'request_id': 'req-25305e37-a9cd-40a4-a12c-2298b76be067'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.237030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbc12f9365047c9b7999773c46d4a4a', 'request_id': 'req-25305e37-a9cd-40a4-a12c-2298b76be067'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.248837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea029d-e667-46ca-9212-bcff24ce95a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.253130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] The token cache is being invalidate because project 5cbc12f9365047c9b7999773c46d4a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:40.253521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.254107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-25305e37-a9cd-40a4-a12c-2298b76be067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.255787 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1157/2274] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:40 2022] DELETE /identity/v3/projects/5cbc12f9365047c9b7999773c46d4a4a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:40.257171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348983-2ada-4d27-b8ac-e5c59044971d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.257452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348983-2ada-4d27-b8ac-e5c59044971d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.257725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47348983-2ada-4d27-b8ac-e5c59044971d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.259408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1158/2275] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:40.260492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.260772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.261063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.289640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] MFA Rules not processed for user `aea29c7af6ba4ebda8b491e0ba2ae9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:40.290938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.319174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.319902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.320188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.320462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.321172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.323119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d616e5e-094e-4097-83fc-5eed75af164d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.325122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.353943 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1118/2276] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:40.355419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49500-c9d3-4dee-95a1-f3ef7dbc5299 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.355763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49500-c9d3-4dee-95a1-f3ef7dbc5299 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.356050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49500-c9d3-4dee-95a1-f3ef7dbc5299 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.357542 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1119/2277] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:40.358485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f371-031e-4ee4-83be-df941858723d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.358777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f371-031e-4ee4-83be-df941858723d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.359056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f371-031e-4ee4-83be-df941858723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.389357 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1159/2278] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:40.390360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.391356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1037f371-031e-4ee4-83be-df941858723d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:40.391895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.392647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1037f371-031e-4ee4-83be-df941858723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.406294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed190bb6-9952-47ec-b37f-a213763d3be3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.455076 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1120/2279] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:40.462130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f371-031e-4ee4-83be-df941858723d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.463479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1037f371-031e-4ee4-83be-df941858723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.465982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.466664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.466938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.467209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.467946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.470093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.475702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f371-031e-4ee4-83be-df941858723d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.480731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.481621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.481946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.482196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] PATH_INFO: `/v3/users/a944f5dd13e84ec2bb07722a5ef6a6b7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.483416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a944f5dd13e84ec2bb07722a5ef6a6b7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.485522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.495802 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1160/2280] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/users => generated 306 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:40.495802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:40.495802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.507674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.536175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a944f5dd13e84ec2bb07722a5ef6a6b7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.536853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a944f5dd13e84ec2bb07722a5ef6a6b7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.543922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a944f5dd13e84ec2bb07722a5ef6a6b7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.544736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a944f5dd13e84ec2bb07722a5ef6a6b7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.557741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a944f5dd13e84ec2bb07722a5ef6a6b7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:40.573920 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1121/2281] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:40 2022] DELETE /identity/v3/users/a944f5dd13e84ec2bb07722a5ef6a6b7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:40.574970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.577204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.578286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.578753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.639028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.657375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a77b-dc0e-45cf-959b-8140058f8ae8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.662394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2873e-a91b-4367-b58e-3336e0bd62f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.667248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.667973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.668253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.668529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.669227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.671148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.695840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1122/2282] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:40.696884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:40.698688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.726428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.727780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.728071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.728881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.730231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.732352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75426e-5665-49b7-a283-44606e07ccca tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.734297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1161/2283] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:40.735785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398a47-9247-4912-b09d-7d6df0579bf4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.736076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398a47-9247-4912-b09d-7d6df0579bf4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.736361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398a47-9247-4912-b09d-7d6df0579bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.766748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5c398a47-9247-4912-b09d-7d6df0579bf4 None None] MFA Rules not processed for user `05553baaba2b4467abbb9ca58afcebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:40.768322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c398a47-9247-4912-b09d-7d6df0579bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.784545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.786283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.819686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:40.844054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1162/2284] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:40.845443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.845730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.846027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.874907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:40.876186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.885502 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1163/2285] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:40.886431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.888089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.899975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c635-0ead-4893-a118-2efd471f3b7f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.901757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3106f-a50f-4a51-8ac9-435381b5920c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.904490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.905454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.905921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.906223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects/68fdb6ec9d2b4580b68677281a07afec` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.907097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.907837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:get_project(project_id=68fdb6ec9d2b4580b68677281a07afec)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.908099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.908472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.908816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.909645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.910581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.911442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.912889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1123/2286] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/projects/68fdb6ec9d2b4580b68677281a07afec => generated 369 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:40.917522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.926279 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1164/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:40.927226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.929006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.935781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ff9-43d7-4dd1-8c93-e207143199e8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.943574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.944291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.944532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.944948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.945065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046c23a-fd82-4e2e-8ed0-b79db6ebce96 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:40.945720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.947626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adafa8-f7ea-4f1e-bd30-2d8c24339629 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.951949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:40.956288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.956650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.956999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.959243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.963335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1124/2288] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:40.963335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:40.963335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:40.963335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:40.973209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:40.974808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:40.980658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] MFA Rules not processed for user `ad8f2774f3254b9785b484f87f9563bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:40.981798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:40.985233 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1165/2289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:40.986212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:40.997000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938481e5-2449-4e38-9e7b-a084b860461a service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.002518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.003296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.003607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.003889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.004635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:41.005084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.006926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.020166 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1166/2290] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:41.021423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.023184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.036516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f799715-aea2-4129-acb9-97cf389b3b57 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.041675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.042616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.042958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.043297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] PATH_INFO: `/v3/projects/c3b5ab25488544b3a376ca33a4f1435d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.044656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b5ab25488544b3a376ca33a4f1435d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.046850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.047005 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1125/2291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:41.048609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.063773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef102cb-6bff-4a0f-8d60-6cc9518efc0e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.069464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.070453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.070809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.071155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] PATH_INFO: `/v3/projects/a3250985e6ce4eb9ae0c50349138ab30/users/0dc2bc0acede47c48697da3f140a49da/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.092780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3250985e6ce4eb9ae0c50349138ab30, user_id=0dc2bc0acede47c48697da3f140a49da, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.097183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.126067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b5ab25488544b3a376ca33a4f1435d', 'request_id': 'req-90045843-6eef-42fc-80ac-0c3de07da0b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:41.133707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b5ab25488544b3a376ca33a4f1435d', 'request_id': 'req-90045843-6eef-42fc-80ac-0c3de07da0b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:41.135886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1126/2292] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:41 2022] PUT /identity/v3/projects/a3250985e6ce4eb9ae0c50349138ab30/users/0dc2bc0acede47c48697da3f140a49da/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:41.136315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:41.136693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.144694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b5ab25488544b3a376ca33a4f1435d', 'request_id': 'req-90045843-6eef-42fc-80ac-0c3de07da0b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:41.163456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] The token cache is being invalidate because project c3b5ab25488544b3a376ca33a4f1435d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:41.163795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:41.164448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:41.166330 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1167/2293] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:41 2022] DELETE /identity/v3/projects/c3b5ab25488544b3a376ca33a4f1435d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:41.166998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.168444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.219525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2e56-e228-459e-b0ae-c674f067b3b7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.224739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.225420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.225839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.226129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.226862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:41.227174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.228829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.241385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1127/2294] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:41.242178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.243766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.258030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045843-6eef-42fc-80ac-0c3de07da0b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.279053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:41.325433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cad80-e48c-49c8-9542-1c2996176d1d tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.331835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.332603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.332949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.333291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.334132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.336127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8589a-a4c9-4a9c-bd76-e61d274aea7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.340258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.341124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.341483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.341886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.342839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.345492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.370368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1168/2295] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:41.370573 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1128/2296] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:41.370670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.370780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.370780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.371253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.383689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.394914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f53c20-faae-47bf-aac4-5619bde46898 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.422461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:41.423768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.484176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.484994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.485345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.485694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.487082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.489342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.506942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1169/2297] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:41.507982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.509730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.513778 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1129/2298] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:41.524799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.540811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b053-0af5-40c0-bcef-da0bd1bf2fd8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.547583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.548842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.549312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.549738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] PATH_INFO: `/v3/projects/f0c265f01b2b41dc8c64171c9f4d0a85/users/e095d344f97e422faaccc049c97c40bf/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.569715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c265f01b2b41dc8c64171c9f4d0a85, user_id=e095d344f97e422faaccc049c97c40bf, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.572467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.576174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:41.605759 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1130/2299] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:41 2022] PUT /identity/v3/projects/f0c265f01b2b41dc8c64171c9f4d0a85/users/e095d344f97e422faaccc049c97c40bf/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:41.606632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.645040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e43379-bf48-49cc-b4c8-5a616eaf99a6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.705649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a891c66-5c89-48c2-9791-196368604add admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.711430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.712350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.712719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.713014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.713753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.715653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.724497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.725354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.725943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.726222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.727034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.729170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b19a0-e651-4aa9-beeb-76954b0c7da6 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.740867 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1131/2300] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:41.742004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.760775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120dd48-9cb4-4eaf-8e03-ac87d53eab32 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.765250 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1170/2301] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/users => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:41.765250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.765250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.765250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.771891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.773063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.773419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.773792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] PATH_INFO: `/v3/projects/a3250985e6ce4eb9ae0c50349138ab30/users/0dc2bc0acede47c48697da3f140a49da/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.777440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3250985e6ce4eb9ae0c50349138ab30, user_id=0dc2bc0acede47c48697da3f140a49da, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.780661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff4b8-0f7d-4083-bd27-a2a3e729ca44 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.791634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:41.793124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.794770 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1132/2302] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:41 2022] PUT /identity/v3/projects/a3250985e6ce4eb9ae0c50349138ab30/users/0dc2bc0acede47c48697da3f140a49da/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ca143-71d9-41fd-bbcd-3416efb12977 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ca143-71d9-41fd-bbcd-3416efb12977 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ca143-71d9-41fd-bbcd-3416efb12977 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1133/2303] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.803567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.804164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.810930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:41.834505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] MFA Rules not processed for user `e095d344f97e422faaccc049c97c40bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:41.835812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.870376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1171/2304] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:41.871251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.881481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace17623-db8e-42c9-b540-9236aa0cb5b2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:41.887248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:41.887761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:41.888111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:41.888449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:41.889256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:41.891050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:41.904845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1172/2305] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:41.905744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:41.927045 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1134/2306] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:41.931387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:41.933839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:41.978057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:41.995614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bff8f-a2e6-4fca-8a96-d4d597d20014 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.000735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.001555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.001975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.002604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.003657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:42.004129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.005748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1b750-a472-4b0e-bdf9-b7f0ddc1a7e9 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.023175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1173/2307] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:42.024503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.024799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.025074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.058508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.058912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] MFA Rules not processed for user `0dc2bc0acede47c48697da3f140a49da`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:42.060195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:42.060317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:42.147429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1174/2308] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:42.151931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.154382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbc049-726f-49aa-a1ef-f2d8392c119b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.160530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74de1647e7ff4317a78ce22de8e4aca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b2a31608234c28a731f9bbb396b02d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.161333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.161621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.161903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.163125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorizing `identity:get_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.164430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2cd73-680d-4a7f-b168-2caef59049a4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.166095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.168247 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1135/2309] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:41 2022] GET /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 383 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:42.169060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.176137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.177690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.178397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.178397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.179106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:42.179325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.181311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.182468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beaa2e-cb15-49b9-b632-3327ea410ce2 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.189357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.190276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.190586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.191243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.192480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.194204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f11e-e7ec-4de0-95e2-5372312c4a93 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.198542 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1175/2310] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:42.199828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.213418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93719-361a-4835-91f4-198d52d3272a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.215970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1136/2311] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:42.218949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6780a3-4cbb-4243-ba49-21f5b6feb086 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.219102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.219871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.220006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6780a3-4cbb-4243-ba49-21f5b6feb086 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.220244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6780a3-4cbb-4243-ba49-21f5b6feb086 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.220363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.220800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.221397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.223611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.224014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1137/2312] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:42.225307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6780a3-4cbb-4243-ba49-21f5b6feb086 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.242838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6780a3-4cbb-4243-ba49-21f5b6feb086 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.249721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.251390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.252087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.252631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.253638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.256172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.268882 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1176/2313] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:42.268882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.293723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:42.307690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1138/2314] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:42.307690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:42.311807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:42.361874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365bf6c-3d5d-4b03-8feb-c16735ae78c5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.410140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:42.422662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.429732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.430765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.431108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.431449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] PATH_INFO: `/v3/projects/4072d36726b74996b41a0766341df70b/users/54fc456b8d764e2b8e457627d3b6818e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.452406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4072d36726b74996b41a0766341df70b, user_id=54fc456b8d764e2b8e457627d3b6818e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.456868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.474576 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1177/2315] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:42 2022] PUT /identity/v3/projects/4072d36726b74996b41a0766341df70b/users/54fc456b8d764e2b8e457627d3b6818e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:42.475673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.495085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8addeab-73b4-415d-a134-5c13416d26d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.545083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a15f73-fc80-4f2d-b3ae-ed572a24617b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.549946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.550632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.550917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.551224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.552102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.554239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.567546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.569354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.569852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.570146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects/68fdb6ec9d2b4580b68677281a07afec` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.571411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:get_project(project_id=68fdb6ec9d2b4580b68677281a07afec)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.573613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.575910 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1139/2316] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/projects/68fdb6ec9d2b4580b68677281a07afec => generated 369 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:42.576694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.577883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1178/2317] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:42.579254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.590567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45670-b75c-41a8-993f-f5b1b4736631 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.598725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.601635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.601883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.602290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.603461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.608652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c6f7-87af-4274-b690-ddbdc1b4d83f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.640508 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1179/2318] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:42.640508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.640508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.640508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.667294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:42.680107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] MFA Rules not processed for user `54fc456b8d764e2b8e457627d3b6818e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:42.681654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:42.716047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a433a31-3100-49ff-a51a-91ae5fccd774 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.734105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.736337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.737455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.739457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.808669 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1180/2319] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:42.813366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.830361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910e532-ebb2-470a-b4d6-b4e0c34a2782 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.836912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.837583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.837861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.838198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.838986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.840910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.856874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1181/2320] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:42.859985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.873803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebb573-2a20-4c60-8c8e-db519d8c464f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.880369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.881052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.881334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.882243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.884425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.886942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:42.901609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1182/2321] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:42.902960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:42.905412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:42.917649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:42.922944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8d0de-eca0-4bdd-8c60-4f03efc8f144 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:42.930886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:42.931943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:42.932557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:42.933374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] PATH_INFO: `/v3/users/ad8f2774f3254b9785b484f87f9563bf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:42.935586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8f2774f3254b9785b484f87f9563bf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:42.937383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.007462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8f2774f3254b9785b484f87f9563bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:43.014927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.017519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.018420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8f2774f3254b9785b484f87f9563bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:43.019182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8f2774f3254b9785b484f87f9563bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:43.019865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8f2774f3254b9785b484f87f9563bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:43.033536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8f2774f3254b9785b484f87f9563bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:43.039829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1140/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:43.040728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.060627 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1183/2323] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:42 2022] DELETE /identity/v3/users/ad8f2774f3254b9785b484f87f9563bf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:43.062478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.063622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b7f9-35d2-4bac-84aa-a5cae9a75916 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.065312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.149711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.150928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.151281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.151740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] PATH_INFO: `/v3/projects/60dffe200b8441a6806554dec92abbcb/users/bf132bdc7bb94ae4869d49036c28cdca/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.162087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ddb8-82a9-4729-ae65-bdde63988231 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.167282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.167994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.168333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.168754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.169656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.171333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25ef3-d06a-499b-a6dd-a96dc820af81 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.173629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60dffe200b8441a6806554dec92abbcb, user_id=bf132bdc7bb94ae4869d49036c28cdca, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.176610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.183560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1184/2324] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:43.184970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faabba2-aaec-47d0-8157-232c7ca1abd0 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.185329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faabba2-aaec-47d0-8157-232c7ca1abd0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.185679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faabba2-aaec-47d0-8157-232c7ca1abd0 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.187574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1185/2325] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:53:43.194061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.194381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.194701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.196926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1141/2326] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:43 2022] PUT /identity/v3/projects/60dffe200b8441a6806554dec92abbcb/users/bf132bdc7bb94ae4869d49036c28cdca/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:43.197577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.199256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.214215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:43.215879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.267139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:43.290763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1186/2327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:43.290763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.303015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e0ec5-79a3-4627-bd9d-c647d25b3bf6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.308372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.309398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.309799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.310164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] PATH_INFO: `/v3/projects/55d1f67de5f9427bae166a10a5edff26/users/859de04797504bcbb5134dba5c8183a5/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.318484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb004-61b5-466b-9a83-e780135f4f72 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.324426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.325461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.325929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.326502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:43.327129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.330003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d1f67de5f9427bae166a10a5edff26, user_id=859de04797504bcbb5134dba5c8183a5, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.330950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.333337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.360597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1187/2328] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:43 2022] PUT /identity/v3/projects/55d1f67de5f9427bae166a10a5edff26/users/859de04797504bcbb5134dba5c8183a5/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:43.362061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:53:43.363643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.421242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.423891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.434530 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1142/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:43.435171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.439231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.461843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460f0d-1b71-435d-b41e-102679e5b117 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.477515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.478835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.550613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.552356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.552643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.552912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.553703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.555419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.560453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a2452-48ab-43ba-abc6-dfc027162d00 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.566626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.567579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.567834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.568108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects/68fdb6ec9d2b4580b68677281a07afec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.569618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:get_project(project_id=68fdb6ec9d2b4580b68677281a07afec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.572414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b31ce-192b-40f5-95e1-3082984e3bb3 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.574770 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1143/2330] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:43.576079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.577979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.579580 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1188/2331] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:53:43 2022] GET /identity/v3/projects/68fdb6ec9d2b4580b68677281a07afec => generated 369 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:43.580984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.581275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.581540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.620717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] MFA Rules not processed for user `859de04797504bcbb5134dba5c8183a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:43.622580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:43.711298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1189/2332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:43.712468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.723305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75a56-311f-478d-b088-35e7e7336998 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.725288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185daedc-7cce-441f-ac30-3233482912a5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.731107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.731265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.732219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.732543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.732734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.732935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] PATH_INFO: `/v3/projects/60dffe200b8441a6806554dec92abbcb/users/bf132bdc7bb94ae4869d49036c28cdca/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.733051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.733399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.735267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60dffe200b8441a6806554dec92abbcb, user_id=bf132bdc7bb94ae4869d49036c28cdca, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.738154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.760076 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1190/2333] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:43 2022] PUT /identity/v3/projects/60dffe200b8441a6806554dec92abbcb/users/bf132bdc7bb94ae4869d49036c28cdca/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:43.760076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.760532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.760532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.768015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:43.796516 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1144/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:43.799951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:43.824388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d2397-f16a-4225-a251-83b4c9a85ee3 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.888247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:43.906092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe641-2cbc-453a-88bd-6fcffc9409b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:43.914727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.915920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.916316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.916761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/users/2e6cc75f4673455697c3ee3c140c4550` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.943535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2e6cc75f4673455697c3ee3c140c4550)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.955715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:43.956362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:43.957054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:43.957339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:43.957619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:43.958333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:43.960342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436381c3-d460-462b-8805-23b0664ffeab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:44.036634 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1145/2335] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:43 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:44.036634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.036634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.036634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.078761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6cc75f4673455697c3ee3c140c4550'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.089244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] MFA Rules not processed for user `bf132bdc7bb94ae4869d49036c28cdca`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:44.090500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.091563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6cc75f4673455697c3ee3c140c4550'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.094515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6cc75f4673455697c3ee3c140c4550'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.099129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6cc75f4673455697c3ee3c140c4550'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.136527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6cc75f4673455697c3ee3c140c4550'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.187664 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1191/2336] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:43 2022] DELETE /identity/v3/users/2e6cc75f4673455697c3ee3c140c4550 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:44.187664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.188737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.270904 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1146/2337] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:44.272334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.278137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.286402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f1e2-96aa-4521-a8d6-bec7ee1cd7f8 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:44.296118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:44.297140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.297366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.297638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] PATH_INFO: `/v3/users/54fc456b8d764e2b8e457627d3b6818e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.299076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fc456b8d764e2b8e457627d3b6818e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:44.302123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:44.320044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:44.386171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fc456b8d764e2b8e457627d3b6818e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.390660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8db255-db5e-48ab-886b-44c45451e595 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:44.396618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:44.397445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.397824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.398525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fc456b8d764e2b8e457627d3b6818e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.398789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.399297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fc456b8d764e2b8e457627d3b6818e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.399727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:44.400444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fc456b8d764e2b8e457627d3b6818e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.401836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:44.424741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fc456b8d764e2b8e457627d3b6818e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.431886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1147/2338] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:44 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:44.433072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.435640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.450244 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1192/2339] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:44 2022] DELETE /identity/v3/users/54fc456b8d764e2b8e457627d3b6818e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:44.450244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.452755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.500719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:44.539126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf6df6-e273-45f1-8d07-f385ab582d56 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:44.571930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba5ac9-0aac-4b98-9dcb-47aa5a3a861a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:44.580134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:44.580804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.581084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.581357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.583266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.606908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb11a06599d448559a7baf49764381ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b331425a1e474f02a8134b7269265e59', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:44.607936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.608380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.608662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] PATH_INFO: `/v3/projects/68fdb6ec9d2b4580b68677281a07afec` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.611135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68fdb6ec9d2b4580b68677281a07afec)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:44.613329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:44.670023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:44.670883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:44.685824 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1193/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:44.686583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.689705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.701943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fdb6ec9d2b4580b68677281a07afec', 'request_id': 'req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.720456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fdb6ec9d2b4580b68677281a07afec', 'request_id': 'req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.738103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fdb6ec9d2b4580b68677281a07afec', 'request_id': 'req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.764072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] The token cache is being invalidate because project 68fdb6ec9d2b4580b68677281a07afec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:44.764841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.765589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:44.768655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0b7c70a2-cc29-4278-93af-ec1d21ea89b4 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:44.772671 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1148/2341] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:44 2022] DELETE /identity/v3/projects/68fdb6ec9d2b4580b68677281a07afec => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:44.774043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.774478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.774751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.803299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:44.805110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.842520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d3aa-1ead-4cf4-8f0f-67574f26240a service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:44.907139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1149/2342] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:44.908644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:44.911935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:44.935313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:44.990170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:44.991032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:44.991433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:44.991981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:44.992785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:44.994942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.009109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1194/2343] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:45.010055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.011895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.030390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980a03-0f7e-4f8c-a1ef-0acaef520b70 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.041046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.041046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.041345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.041647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] PATH_INFO: `/v3/projects/a805d2ab9d034eedb588e3efcae07c91` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.043009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a805d2ab9d034eedb588e3efcae07c91)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.045268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.064926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b4d7b-031c-4725-ad05-ed0708634f01 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.075769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.076677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.077247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.077398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.079653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.133115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a805d2ab9d034eedb588e3efcae07c91', 'request_id': 'req-13b59811-21c0-410d-b07d-e66f55608c79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.149782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a805d2ab9d034eedb588e3efcae07c91', 'request_id': 'req-13b59811-21c0-410d-b07d-e66f55608c79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.157303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.159034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.173913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1150/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:45.175024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.185869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.193491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a805d2ab9d034eedb588e3efcae07c91', 'request_id': 'req-13b59811-21c0-410d-b07d-e66f55608c79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.229803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9a883-e57f-4b15-96a3-a605c28e114a service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.234978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] The token cache is being invalidate because project a805d2ab9d034eedb588e3efcae07c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:45.235773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.237546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.242985 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1195/2345] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:45 2022] DELETE /identity/v3/projects/a805d2ab9d034eedb588e3efcae07c91 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:45.242985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.243377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.336927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b59811-21c0-410d-b07d-e66f55608c79 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.338876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:45.342547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.343342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.343732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.344322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.347305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.388525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.389611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.390002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.390408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] PATH_INFO: `/v3/users/892bd60afe3a411c8aaf951acf49cbd6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.392135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892bd60afe3a411c8aaf951acf49cbd6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.395480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.475861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.479359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.514410 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1196/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:45.515349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.517473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892bd60afe3a411c8aaf951acf49cbd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.518552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892bd60afe3a411c8aaf951acf49cbd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.524403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.533074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:45.548804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892bd60afe3a411c8aaf951acf49cbd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.550003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892bd60afe3a411c8aaf951acf49cbd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.571885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ed057-a832-4950-b823-6f44a78a5b6d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.586307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.587575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.587575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.587867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] PATH_INFO: `/v3/projects/00850f9935c54861ac162b84570e1213/users/09b153e10d99483cbd0a5d0cba215739/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.594362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892bd60afe3a411c8aaf951acf49cbd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.618245 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1151/2347] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:45 2022] DELETE /identity/v3/users/892bd60afe3a411c8aaf951acf49cbd6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:45.618245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.618245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.621037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00850f9935c54861ac162b84570e1213, user_id=09b153e10d99483cbd0a5d0cba215739, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.629000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.665495 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1197/2348] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:45 2022] PUT /identity/v3/projects/00850f9935c54861ac162b84570e1213/users/09b153e10d99483cbd0a5d0cba215739/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:45.668627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:45.674083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:45.767696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe2eba-08ee-43a3-bf29-443cf178b817 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.777778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83dc3-7377-4c96-a1db-add7eca29b03 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:45.779216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.780554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:45.781106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.781748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.781877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:45.782190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:45.782483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] PATH_INFO: `/v3/users/74de1647e7ff4317a78ce22de8e4aca4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.784109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=74de1647e7ff4317a78ce22de8e4aca4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.786337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.788299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] PATH_INFO: `/v3/users/e095d344f97e422faaccc049c97c40bf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:45.791344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e095d344f97e422faaccc049c97c40bf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:45.797265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:45.886568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74de1647e7ff4317a78ce22de8e4aca4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.916135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74de1647e7ff4317a78ce22de8e4aca4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.917287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74de1647e7ff4317a78ce22de8e4aca4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.917997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74de1647e7ff4317a78ce22de8e4aca4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.929063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e095d344f97e422faaccc049c97c40bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.930444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e095d344f97e422faaccc049c97c40bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.944331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e095d344f97e422faaccc049c97c40bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.945307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e095d344f97e422faaccc049c97c40bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.956259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87dc8ae8-7f58-43ba-b155-fa0eb71a8aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74de1647e7ff4317a78ce22de8e4aca4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:45.961833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:45.986223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e095d344f97e422faaccc049c97c40bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:46.003765 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1198/2349] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:45 2022] DELETE /identity/v3/users/74de1647e7ff4317a78ce22de8e4aca4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:46.017690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1152/2350] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:45 2022] DELETE /identity/v3/users/e095d344f97e422faaccc049c97c40bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:46.019618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.021020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.022247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.022247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.025214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.086575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:46.088614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.118687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:46.150685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7eedf-0962-4182-b62c-d9398dad8132 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.161012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:46.162776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.163172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.163596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.166141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:46.170985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93e184-213a-4d8e-afc0-b09308d869d2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:46.220031 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1153/2351] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:46.222099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.222581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.222964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.258742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:46.262942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.272885 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1199/2352] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:46.276119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.282657 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1154/2353] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:46.292270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf254c-a37a-4d63-9bb6-2970584212e7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.296683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.302710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:46.303951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.305218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.305218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] PATH_INFO: `/v3/projects/00850f9935c54861ac162b84570e1213/users/09b153e10d99483cbd0a5d0cba215739/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.306983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.308069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00850f9935c54861ac162b84570e1213, user_id=09b153e10d99483cbd0a5d0cba215739, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:46.311405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872f99d-61da-4fb1-bbc2-d824829acf82 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:46.327987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1200/2354] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:46 2022] PUT /identity/v3/projects/00850f9935c54861ac162b84570e1213/users/09b153e10d99483cbd0a5d0cba215739/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:46.343253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.344127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.344619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.412727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] MFA Rules not processed for user `09b153e10d99483cbd0a5d0cba215739`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:46.414379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.455713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3b439-2331-428e-a489-90be6525b824 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.534516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:46.535804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.536305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.536801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.539621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1201/2355] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:53:46.540629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.542656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.570759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c71d-8c20-4ced-9c3f-d59b601f6a90 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.578832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:46.579909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.580166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.580461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.686924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:46.689114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11950657-b48c-4516-a075-3c13d947442f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:46.715959 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1155/2356] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:53:46.719155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.719450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.719766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.728346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:46.730678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:46.737775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:46.745328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1202/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:46.746560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.748337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.763448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] MFA Rules not processed for user `859de04797504bcbb5134dba5c8183a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:46.766530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.790479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d5a6-ee31-4f5e-8816-3fd44404be69 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.809375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:46.813575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:46.814747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:46.815304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] PATH_INFO: `/v3/projects/c1b2a31608234c28a731f9bbb396b02d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:46.826121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b2a31608234c28a731f9bbb396b02d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:46.831304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:46.883850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:46.912866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1156/2358] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:46.914197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:46.916040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:46.929861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b2a31608234c28a731f9bbb396b02d', 'request_id': 'req-4d9824c6-22d7-45e9-a09d-e8f735c7453b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:46.936330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529414-ab21-4a96-bbc3-5b0f34f48e0c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:46.940800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b2a31608234c28a731f9bbb396b02d', 'request_id': 'req-4d9824c6-22d7-45e9-a09d-e8f735c7453b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:46.950344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b2a31608234c28a731f9bbb396b02d', 'request_id': 'req-4d9824c6-22d7-45e9-a09d-e8f735c7453b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:46.996872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] The token cache is being invalidate because project c1b2a31608234c28a731f9bbb396b02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:46.997175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:46.998841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.005428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1203/2359] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:46 2022] DELETE /identity/v3/projects/c1b2a31608234c28a731f9bbb396b02d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.006550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.012252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.046147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.047112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.047382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.047709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] PATH_INFO: `/v3/projects/4072d36726b74996b41a0766341df70b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.049698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4072d36726b74996b41a0766341df70b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.052664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.145756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4072d36726b74996b41a0766341df70b', 'request_id': 'req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.154905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4072d36726b74996b41a0766341df70b', 'request_id': 'req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.158423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9824c6-22d7-45e9-a09d-e8f735c7453b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.166770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4072d36726b74996b41a0766341df70b', 'request_id': 'req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.187674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] The token cache is being invalidate because project 4072d36726b74996b41a0766341df70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:47.187960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.189779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.192950 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1157/2360] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:46 2022] DELETE /identity/v3/projects/4072d36726b74996b41a0766341df70b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.193971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.195443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.286948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.288172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.288454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.288738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] PATH_INFO: `/v3/users/656e73f2cfc34336823facedf4b1a23a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.291553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] RBAC: Authorizing `identity:delete_user(user_id=656e73f2cfc34336823facedf4b1a23a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.295122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.324892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8a0bd-3ef7-4c25-90a5-bd82c85141df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.334726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.335558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.335856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.336175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.338803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.350007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:47.366787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:47.376793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656e73f2cfc34336823facedf4b1a23a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.389357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656e73f2cfc34336823facedf4b1a23a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.391039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656e73f2cfc34336823facedf4b1a23a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.392150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656e73f2cfc34336823facedf4b1a23a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.411615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebc57c7a-3fa3-41cf-85b8-a4ae2fd6048a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656e73f2cfc34336823facedf4b1a23a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.430638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1204/2361] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:47 2022] DELETE /identity/v3/users/656e73f2cfc34336823facedf4b1a23a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.432277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.432659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.433055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.433546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.435658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390adb9-3eef-47ca-bb03-0044d45c2046 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.447691 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1158/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:47.449447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.449761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.450047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.469494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:47.471453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.473578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:47.475387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.580824 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1205/2363] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:47.580824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.580824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.583383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1159/2364] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:47.584206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.585801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.594262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fd2e-78ac-4a67-8c5c-ac3f621760a4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.599455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6c79-a668-4340-8f5c-3991f994931d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.599896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.600811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.601173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.601406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] PATH_INFO: `/v3/projects/f0c265f01b2b41dc8c64171c9f4d0a85` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.602635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c265f01b2b41dc8c64171c9f4d0a85)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.605559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.606412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.607438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.607906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.608198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] PATH_INFO: `/v3/projects/b3a244c436984bd2a081c670a15ebc66` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.609709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a244c436984bd2a081c670a15ebc66)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.611956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.669295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c265f01b2b41dc8c64171c9f4d0a85', 'request_id': 'req-55689af9-405a-4ad4-b055-f1a735b9f4ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.677063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c265f01b2b41dc8c64171c9f4d0a85', 'request_id': 'req-55689af9-405a-4ad4-b055-f1a735b9f4ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.681090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a244c436984bd2a081c670a15ebc66', 'request_id': 'req-174a6dd8-069f-4183-838c-b82cdd6aecea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.684990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c265f01b2b41dc8c64171c9f4d0a85', 'request_id': 'req-55689af9-405a-4ad4-b055-f1a735b9f4ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.689747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a244c436984bd2a081c670a15ebc66', 'request_id': 'req-174a6dd8-069f-4183-838c-b82cdd6aecea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.697642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a244c436984bd2a081c670a15ebc66', 'request_id': 'req-174a6dd8-069f-4183-838c-b82cdd6aecea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.707896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] The token cache is being invalidate because project f0c265f01b2b41dc8c64171c9f4d0a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:47.708369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.709081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-55689af9-405a-4ad4-b055-f1a735b9f4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.714287 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1206/2365] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:47 2022] DELETE /identity/v3/projects/f0c265f01b2b41dc8c64171c9f4d0a85 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.714287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd71b36-4e70-43ec-a8bc-b931204b5695 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.714287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd71b36-4e70-43ec-a8bc-b931204b5695 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.714287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd71b36-4e70-43ec-a8bc-b931204b5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.717969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] The token cache is being invalidate because project b3a244c436984bd2a081c670a15ebc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:47.718297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.719089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-174a6dd8-069f-4183-838c-b82cdd6aecea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.722713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1160/2366] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:47 2022] DELETE /identity/v3/projects/b3a244c436984bd2a081c670a15ebc66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.724141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.724489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.724773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.740618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5fd71b36-4e70-43ec-a8bc-b931204b5695 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:47.743045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5fd71b36-4e70-43ec-a8bc-b931204b5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.749763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:47.751853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.780902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:47.796298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:47.826640 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1207/2367] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:47.828094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.828709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.829047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.836919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1161/2368] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:47.838173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.840867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.853362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e33e30-d839-4924-8dbc-89dcd1ef7293 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.855765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:47.857083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.859711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.860866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.861211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.861573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] PATH_INFO: `/v3/users/bf132bdc7bb94ae4869d49036c28cdca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.862852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf132bdc7bb94ae4869d49036c28cdca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.864971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.869280 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1208/2369] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:47.869280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.869280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.883006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c48-3e0b-4567-a4d1-389b71593060 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:47.887859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:47.888787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:47.889274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:47.889542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] PATH_INFO: `/v3/users/cb11a06599d448559a7baf49764381ea` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:47.891003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb11a06599d448559a7baf49764381ea)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:47.893323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:47.934171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf132bdc7bb94ae4869d49036c28cdca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.934867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf132bdc7bb94ae4869d49036c28cdca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.947978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf132bdc7bb94ae4869d49036c28cdca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.948670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf132bdc7bb94ae4869d49036c28cdca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.958518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb11a06599d448559a7baf49764381ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.966498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf132bdc7bb94ae4869d49036c28cdca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.974727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb11a06599d448559a7baf49764381ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.975901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb11a06599d448559a7baf49764381ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.977725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb11a06599d448559a7baf49764381ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:47.986352 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1162/2370] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:47 2022] DELETE /identity/v3/users/bf132bdc7bb94ae4869d49036c28cdca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:47.987310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:47.996701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:47.999257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb11a06599d448559a7baf49764381ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:48.021271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1209/2371] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:47 2022] DELETE /identity/v3/users/cb11a06599d448559a7baf49764381ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:48.022472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.024749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.095296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de8a8-71f7-4bcd-bd3c-7fe29e30316c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.110042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c0dc-7eb8-467c-b15b-2d8a31431f3a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.116664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.117896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.118520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.118941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.122298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.179541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:48.192116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.193712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.194510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.195211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.196671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:48.197608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.202808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.232165 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1163/2372] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:48.233461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.235395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.252980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c28c3-579d-491a-b198-8898c60026c8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.254437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:48.258772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.259452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.259809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.260089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.260892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:48.261233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.264624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.281821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.284227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.285602 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1164/2373] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:48.287212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.291945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.297147 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1210/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:48.298884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.312470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343149-2531-496f-bac0-b0d4c80f8d5a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.314793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cabfa7-d9a1-4c01-bfed-4be9109a40eb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.320601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.321224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.321768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.322247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.322737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.322849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.323409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.323987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.324513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.325633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.326836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.328490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.380048 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1165/2375] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/projects => generated 407 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:48.380511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1211/2376] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:48.393578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.396504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.547816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0127a5-49cc-4617-9968-7fc1a2c474f6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.553402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.553656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.553907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.554183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.554984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.557284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.573153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2c6b-19c0-45cf-a6e6-cfda48c82fd6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.581896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.582926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.583682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.584989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.586605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.589308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.600779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1166/2377] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:48.601807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.626124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0aa4-c762-4a50-8647-134e059415b9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.631925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1212/2378] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/users => generated 304 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:48.633774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.641765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.643985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.644503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.645793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.646963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.650658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06bd0f-c628-4efd-91e6-9e7b74f7b823 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.652198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.657663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.658627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.659054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.659450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.660628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.663001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.679910 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1213/2379] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:48.680207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1167/2380] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:48.682438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.686116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.696036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b041de7-54a9-4f0e-b19a-589f5f61fc8c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.700585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7221b1-fd81-4d7b-8666-eb82d5aa7110 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.702109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.702796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.703270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.703466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.704791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.706697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.706807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.708101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.708651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.708932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.710201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.711907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.723652 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1214/2381] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:48.724918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.725859 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1168/2382] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:48.731221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.739937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329a57-e922-4cc7-a61b-89bfa8b217cf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.746926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795475-7980-4484-9d9f-f846884a9491 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.758123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.759502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.760248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.760641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] PATH_INFO: `/v3/projects/2736f0fea46045bebe448cac84248068/users/d3880c5280854af0ac97ada50bb1397a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.761340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.762311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.762642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.762980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] PATH_INFO: `/v3/projects/0ffa53e4daee4f5fa4a90be14ec73f30/users/a1cec701ff3f48ae81ada0d239cafc5f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.785934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffa53e4daee4f5fa4a90be14ec73f30, user_id=a1cec701ff3f48ae81ada0d239cafc5f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.787713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2736f0fea46045bebe448cac84248068, user_id=d3880c5280854af0ac97ada50bb1397a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:48.790062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d110-acb8-40e8-9295-59c40eea969b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.793046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:48.813319 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1215/2384] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:48 2022] PUT /identity/v3/projects/2736f0fea46045bebe448cac84248068/users/d3880c5280854af0ac97ada50bb1397a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:48.815002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:48.815871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1169/2384] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:48 2022] PUT /identity/v3/projects/0ffa53e4daee4f5fa4a90be14ec73f30/users/a1cec701ff3f48ae81ada0d239cafc5f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:48.823579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.829679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0399-8232-4695-9182-759384166f3a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.830188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0399-8232-4695-9182-759384166f3a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.830402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0399-8232-4695-9182-759384166f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.874931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9cdb0399-8232-4695-9182-759384166f3a None None] MFA Rules not processed for user `a1cec701ff3f48ae81ada0d239cafc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:48.877373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9cdb0399-8232-4695-9182-759384166f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:48.943192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:48.976648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1170/2385] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:48.976648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.976648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.976648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.984184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c748-f210-426a-90ef-c7be19a2a961 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:48.991470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:48.992772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:48.993234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:48.994558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] PATH_INFO: `/v3/projects/60dffe200b8441a6806554dec92abbcb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:48.997921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60dffe200b8441a6806554dec92abbcb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.000480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.023727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] MFA Rules not processed for user `d3880c5280854af0ac97ada50bb1397a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:49.025186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.034971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:49.164908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60dffe200b8441a6806554dec92abbcb', 'request_id': 'req-9b71318a-002d-4e36-826b-fa3b9d2f1960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.167891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1171/2386] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:49.168805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.170223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.176852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60dffe200b8441a6806554dec92abbcb', 'request_id': 'req-9b71318a-002d-4e36-826b-fa3b9d2f1960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.183813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60dffe200b8441a6806554dec92abbcb', 'request_id': 'req-9b71318a-002d-4e36-826b-fa3b9d2f1960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.205788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] The token cache is being invalidate because project 60dffe200b8441a6806554dec92abbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:49.205788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.208667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.211738 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1216/2387] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:48 2022] DELETE /identity/v3/projects/60dffe200b8441a6806554dec92abbcb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:49.213309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.216601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.265885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737dae7-7c18-4666-8230-aaf5ae27e46b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.304489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71318a-002d-4e36-826b-fa3b9d2f1960 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.309760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.311206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.312141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.312141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] PATH_INFO: `/v3/projects/b331425a1e474f02a8134b7269265e59` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.313825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b331425a1e474f02a8134b7269265e59)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.317303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.361252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.362683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.363019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.363382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.366626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.389736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:49.414470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b331425a1e474f02a8134b7269265e59', 'request_id': 'req-41de47d6-5c1c-465a-a0dc-ba710194384a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.431938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b331425a1e474f02a8134b7269265e59', 'request_id': 'req-41de47d6-5c1c-465a-a0dc-ba710194384a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.456377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b331425a1e474f02a8134b7269265e59', 'request_id': 'req-41de47d6-5c1c-465a-a0dc-ba710194384a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.457375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.459559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.477320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] The token cache is being invalidate because project b331425a1e474f02a8134b7269265e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:49.477805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.479940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.482403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1217/2388] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:49 2022] DELETE /identity/v3/projects/b331425a1e474f02a8134b7269265e59 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:49.483129 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1172/2389] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:49.484461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.487319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.491703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.493756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.513445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c91c-d59b-4285-8c27-5236354a297c service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.546085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:49.597310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de47d6-5c1c-465a-a0dc-ba710194384a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.603272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.604400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.604694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.604978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] PATH_INFO: `/v3/projects/64f58e2ac15e44a2b0cadd5f9efc1a56` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.606264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f58e2ac15e44a2b0cadd5f9efc1a56)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.607343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.608059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.608298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.608397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.608777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.609302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.612254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c5932-0a83-4b0c-a055-d9cb3103e8ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.649350 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1173/2390] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:49 2022] POST /identity/v3/projects => generated 407 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:49.649350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.649350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.649350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.669527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:49.670782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.680669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'request_id': 'req-21631eda-e323-4e62-8e60-6e6e15746ec8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.688067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'request_id': 'req-21631eda-e323-4e62-8e60-6e6e15746ec8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.694726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'request_id': 'req-21631eda-e323-4e62-8e60-6e6e15746ec8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.711943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] The token cache is being invalidate because project 64f58e2ac15e44a2b0cadd5f9efc1a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:49.712236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.713203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-21631eda-e323-4e62-8e60-6e6e15746ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.715172 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1218/2391] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:49 2022] DELETE /identity/v3/projects/64f58e2ac15e44a2b0cadd5f9efc1a56 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:49.716589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.716874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.717153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.737724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:49.739103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.747682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1174/2392] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:49.748824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.750498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.764879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffd507-c541-4dce-8410-8b307aaae4ba None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.771121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.772282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.772576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.773451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] PATH_INFO: `/v3/users/a1cec701ff3f48ae81ada0d239cafc5f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.774902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cec701ff3f48ae81ada0d239cafc5f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.777756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.837614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:49.848408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1219/2393] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:49.849700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.851620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.856403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cec701ff3f48ae81ada0d239cafc5f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.858507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cec701ff3f48ae81ada0d239cafc5f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.869309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f821-fa48-4651-812e-0d4142365cdd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.872127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cec701ff3f48ae81ada0d239cafc5f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.872529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cec701ff3f48ae81ada0d239cafc5f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.880275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:49.881861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.882185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.883020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.883767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:49.885853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:49.903939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52935f8d-bcac-404c-96e6-d9396b757f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cec701ff3f48ae81ada0d239cafc5f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:49.920634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1220/2394] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:49 2022] POST /identity/v3/users => generated 310 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:49.922020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:49.923361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1175/2395] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:49 2022] DELETE /identity/v3/users/a1cec701ff3f48ae81ada0d239cafc5f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:49.923361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30e93-0a80-4c5f-abdf-980abd5332a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:49.926276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30e93-0a80-4c5f-abdf-980abd5332a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:49.926351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c30e93-0a80-4c5f-abdf-980abd5332a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:49.927387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:49.942081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555d30-4dc6-4735-8580-d874b09f1df7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:49.952092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d4c30e93-0a80-4c5f-abdf-980abd5332a6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:49.953544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4c30e93-0a80-4c5f-abdf-980abd5332a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.000970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:50.032996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.034261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1176/2396] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:50.036561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.037061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.037440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.037698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.038099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.038478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] PATH_INFO: `/v3/users/0dc2bc0acede47c48697da3f140a49da` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.040346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc2bc0acede47c48697da3f140a49da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.042756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.061763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:50.063081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.077914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1177/2397] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:50.079075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.080647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.102405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88074-8554-4952-bdc5-0fc282ea262e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.118695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.119957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.122580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.123238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.125546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.133485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9881ad-e9af-48f7-a184-89f17554b677 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.151048 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1178/2398] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:50.152623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.152924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.153211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.169526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc2bc0acede47c48697da3f140a49da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:50.175214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:50.176489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.177637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc2bc0acede47c48697da3f140a49da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:50.178370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc2bc0acede47c48697da3f140a49da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:50.178972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc2bc0acede47c48697da3f140a49da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:50.184885 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1179/2399] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:50.189243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.190891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.200281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc2bc0acede47c48697da3f140a49da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:50.205083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d89c9-a182-46d2-8a31-1d41a8c3601e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.210898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.212527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.212527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.212527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.213748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:50.214065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.215731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.221597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1221/2400] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:49 2022] DELETE /identity/v3/users/0dc2bc0acede47c48697da3f140a49da => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:50.222409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.224096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.243866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1180/2401] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:50.245390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.247384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.268307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6113b7-914e-43ba-9587-905b88ea5763 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.323712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ff8cb-b9eb-4215-a97a-7624180a189b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.335930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.337819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.338414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.339046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.340180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:50.341053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.344929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.362458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1222/2402] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:50.363305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.365739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.398826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.399772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.400267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.400428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] PATH_INFO: `/v3/projects/2c14c2532c714e71b80ee8fbceff54df/users/d80fd05ea13e4658bb89acd07d7cb0a2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.417818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c14c2532c714e71b80ee8fbceff54df, user_id=d80fd05ea13e4658bb89acd07d7cb0a2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.421059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.432380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:50.435572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721349-f792-44ac-a603-db0ab1ba3fa9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.443771 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1181/2403] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:50 2022] PUT /identity/v3/projects/2c14c2532c714e71b80ee8fbceff54df/users/d80fd05ea13e4658bb89acd07d7cb0a2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:50.444709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.450952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:50.503377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.504055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.504346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.504624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.545276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e5111-c04c-4c24-b374-6e752b1f7480 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.550791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.551478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.551801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.552078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.552826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.555769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.586919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.588460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.591655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1182/2404] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:50.591655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.600403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1223/2405] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:50.601462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.611880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db48b-7f9d-440a-84eb-e289673bf25a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.665988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ead3fd-7ddc-4a7e-bfce-7df4ee16bf9f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.671946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.672629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.672908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.673499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.673880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.675890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.686742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.687862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.688008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.688368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.689213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.690961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.705721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1224/2406] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:50.706938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.711097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1183/2407] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:50.712225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.722013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92acf78-123b-49b1-a6dd-3743804c6f6d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.784552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.785453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.785678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.785963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.786659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.789518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.797319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:50.820009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe00b6-e298-42e1-b219-3ec99f8d4c67 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.823865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1225/2408] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:50.824943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.829964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.830978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.831288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.831596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] PATH_INFO: `/v3/projects/2c14c2532c714e71b80ee8fbceff54df/users/d80fd05ea13e4658bb89acd07d7cb0a2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.834242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c14c2532c714e71b80ee8fbceff54df, user_id=d80fd05ea13e4658bb89acd07d7cb0a2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.837176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.839458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a9ce-e495-4265-92a3-fbda90ad8225 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:50.847481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:50.848288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:50.848622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:50.848951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:50.849673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:50.863470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1184/2409] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:50 2022] PUT /identity/v3/projects/2c14c2532c714e71b80ee8fbceff54df/users/d80fd05ea13e4658bb89acd07d7cb0a2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:50.863470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.864291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:50.872641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:50.905962 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1226/2410] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:50 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:50.906871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:50.909712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:50.928463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dca5e-ad65-4c3a-8d6a-24e43b85e166 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.008960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.011181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.011585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.012225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] PATH_INFO: `/v3/projects/a3250985e6ce4eb9ae0c50349138ab30` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.013573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3250985e6ce4eb9ae0c50349138ab30)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.014958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd210-1c94-46aa-baf1-80d12f36b071 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.015875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.020771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.021869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.022384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.022704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.024416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.027175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.066903 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1185/2411] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:51.072404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.087379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955ece6-a677-4c31-84b3-38b4319b87a4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.089582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3250985e6ce4eb9ae0c50349138ab30', 'request_id': 'req-48c906b3-4427-4655-b997-6d8612394e3d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.098705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3250985e6ce4eb9ae0c50349138ab30', 'request_id': 'req-48c906b3-4427-4655-b997-6d8612394e3d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.107241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3250985e6ce4eb9ae0c50349138ab30', 'request_id': 'req-48c906b3-4427-4655-b997-6d8612394e3d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.123052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] The token cache is being invalidate because project a3250985e6ce4eb9ae0c50349138ab30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:51.123398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.124090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48c906b3-4427-4655-b997-6d8612394e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.127702 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1227/2412] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:50 2022] DELETE /identity/v3/projects/a3250985e6ce4eb9ae0c50349138ab30 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:51.130239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.130842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.131196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.167960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.168800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.169288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.169656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.171404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.172245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.178403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] MFA Rules not processed for user `d80fd05ea13e4658bb89acd07d7cb0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:51.179825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.183438 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1186/2413] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:51.184931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.186803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.203852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cf74b-a8ef-47d2-ab59-4bf591a5764b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.210833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.212156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.212156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.212413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.213091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.214884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ec74b-70e8-407d-b42d-ff64dc626447 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.227133 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1187/2414] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:51.228781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.229148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.229654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.249783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:51.251341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.256976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:51.262057 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1188/2415] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:51.268478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.268478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.277924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fc628-1e55-47e7-8842-5899552277b8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.283307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.284154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.284783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.285065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.285840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.287912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a61a0-9a75-4605-ad99-8b8fe7fafe17 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.305701 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1228/2416] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:51.305701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.309057 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1189/2417] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:51.310691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.311167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.311677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.317114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adbf66-f6be-4e06-9f12-8f1c6769deb9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.322099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.323044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.323327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.323642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] PATH_INFO: `/v3/projects/0aeb9ab07bf8476082d5add829aec29f/users/ac8ef83fa94e4c9db70a0115cc867dfc/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.333988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:51.335298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.350250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aeb9ab07bf8476082d5add829aec29f, user_id=ac8ef83fa94e4c9db70a0115cc867dfc, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.354200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.366567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1190/2418] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:51.367669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.372796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.402466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d19c9-c807-4e29-905c-9b9b5cc1c6cd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.412902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.415395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.420073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1229/2419] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:51 2022] PUT /identity/v3/projects/0aeb9ab07bf8476082d5add829aec29f/users/ac8ef83fa94e4c9db70a0115cc867dfc/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:51.424121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.424255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.424345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] PATH_INFO: `/v3/users/d3880c5280854af0ac97ada50bb1397a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.424638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3880c5280854af0ac97ada50bb1397a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.426589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.429110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.558672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3880c5280854af0ac97ada50bb1397a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.559667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3880c5280854af0ac97ada50bb1397a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.569560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d880ef-6e7b-41b5-95c8-7a3cab607d4e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.574508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:51.576166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3880c5280854af0ac97ada50bb1397a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.577375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3880c5280854af0ac97ada50bb1397a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.582558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.583776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.584151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.584713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] PATH_INFO: `/v3/projects/0ffa53e4daee4f5fa4a90be14ec73f30` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.587699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffa53e4daee4f5fa4a90be14ec73f30)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.590637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.612499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3880c5280854af0ac97ada50bb1397a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.649034 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1191/2420] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:51 2022] DELETE /identity/v3/users/d3880c5280854af0ac97ada50bb1397a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:51.652674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.656808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.701042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffa53e4daee4f5fa4a90be14ec73f30', 'request_id': 'req-20d171f9-71e2-411a-bd7a-2286792d3a73'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.708519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffa53e4daee4f5fa4a90be14ec73f30', 'request_id': 'req-20d171f9-71e2-411a-bd7a-2286792d3a73'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.722246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffa53e4daee4f5fa4a90be14ec73f30', 'request_id': 'req-20d171f9-71e2-411a-bd7a-2286792d3a73'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.745205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] The token cache is being invalidate because project 0ffa53e4daee4f5fa4a90be14ec73f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:51.745883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.747361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:51.750455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1230/2421] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:51 2022] DELETE /identity/v3/projects/0ffa53e4daee4f5fa4a90be14ec73f30 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:51.751692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:51.753843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.775755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d76abf-15fc-423e-9dff-6a28dfeede61 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.846125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:51.863438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d171f9-71e2-411a-bd7a-2286792d3a73 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:51.876337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.877595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.878207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.878564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.879646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:51.880029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.882447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77697731-aad4-4783-acb0-ebcc4b722f75 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.893171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:51.895469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.895791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.896073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] PATH_INFO: `/v3/projects/406b8e76c3464355b7c897fc90e783c4/users/d57e5637ee194b27888af0b55136c83e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.900046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1231/2422] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:51.901730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786a89a-9e1c-493d-b170-b29f83ac9e08 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.902158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786a89a-9e1c-493d-b170-b29f83ac9e08 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.902580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786a89a-9e1c-493d-b170-b29f83ac9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.915486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406b8e76c3464355b7c897fc90e783c4, user_id=d57e5637ee194b27888af0b55136c83e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:51.919436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b8617-a855-4683-8fc5-8c7c9dd51bb1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:51.928038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4786a89a-9e1c-493d-b170-b29f83ac9e08 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:51.929815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4786a89a-9e1c-493d-b170-b29f83ac9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:51.941274 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1192/2423] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:51 2022] PUT /identity/v3/projects/406b8e76c3464355b7c897fc90e783c4/users/d57e5637ee194b27888af0b55136c83e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:51.943227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:51.943668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:51.944045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:51.964090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:51.965722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.013255 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1232/2424] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:52.014599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f693e-3136-404e-871c-02d270f8e2d2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.015571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f693e-3136-404e-871c-02d270f8e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.015571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f693e-3136-404e-871c-02d270f8e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.040946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c60f693e-3136-404e-871c-02d270f8e2d2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:52.042881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c60f693e-3136-404e-871c-02d270f8e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.052589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1193/2425] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:52.052935 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1233/2426] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:52.054451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a14d-6886-41a2-9c68-fbd436c02b34 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.054745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a14d-6886-41a2-9c68-fbd436c02b34 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.055022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67a14d-6886-41a2-9c68-fbd436c02b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.060093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.069245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:52.077022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9e66e-a966-401d-a7c0-0732d026a83e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.103431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7b67a14d-6886-41a2-9c68-fbd436c02b34 None None] MFA Rules not processed for user `d57e5637ee194b27888af0b55136c83e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:52.103431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b67a14d-6886-41a2-9c68-fbd436c02b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.103689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.105350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.105818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.106075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.106808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.112896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.162037 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1194/2427] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:52.164524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.172865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.249766 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1234/2428] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:52.249766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.249766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.249766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.276259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841aa9a-d09e-43f5-906b-49c7158afdf2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.281292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.282117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.282498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.282871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.298133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:52.300467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.378588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.380634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.393704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1195/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:52.395003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.406253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a59b-5dfe-42ce-89ad-8b23db6a98e3 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.414594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.415647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.416222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.417370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.439009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.440684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.450080 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1235/2430] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:52.451768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.459553 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1196/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:52.460418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.462004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:52.464790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6c066-919c-40f8-91b2-f1eb4f6a28dc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.475986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.476695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.476981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.477262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.479477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.501199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.510814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:52.543359 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1236/2432] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:52.547846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.573366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdee7d-9951-4222-8cba-b105337da5c5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.583460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.584518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.584950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.585380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.586089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2706f-1b34-4a80-9b53-d0aef87a7e01 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.586647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:52.587114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.589882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.593984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.594858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.595148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.595429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.607222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1237/2433] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:52.622049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:52.624391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.659761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386c453-4e2a-4f87-a2c2-99ea0ff77e32 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.667601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.668895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.669461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.669844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.670972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.673769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.698733 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1238/2434] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:52.698733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.707661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.710181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.739576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3828d8-ab72-4735-8bc0-610da01c4c5d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.745132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.746047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.746340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.746620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.748948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.751103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.758101 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1197/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:52.760504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.778995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff65b15-3518-421d-afb3-4179852e170d service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.792959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1239/2436] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:52.797303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.798541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.799388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.799771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.800115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.800967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.802825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:52.814895 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1198/2437] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:52.820632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:52.842298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c4e31-1652-4f9a-b407-3c262d520ad7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.954953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cede-319a-482e-9bde-7a61c09c6dbc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:52.963564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.964521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:52.965357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.965930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.966177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:52.967288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:52.968025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] PATH_INFO: `/v3/projects/0fcce4b9445545fca456e2f844be191d/users/bc0cab89b5814ff59de8f6008f2f0d62/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.968813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:52.971528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:52.978074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c51d58-4fa5-4c3a-9d1d-524758f45de8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.004165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcce4b9445545fca456e2f844be191d, user_id=bc0cab89b5814ff59de8f6008f2f0d62, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.008127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.024342 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1240/2438] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:52 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:53.029014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1199/2439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:52 2022] PUT /identity/v3/projects/0fcce4b9445545fca456e2f844be191d/users/bc0cab89b5814ff59de8f6008f2f0d62/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:53.029997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.037243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.038334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.039000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.111304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:53.112843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.122204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3706-a85f-4bd2-811a-8e770fb90b95 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.128489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.129175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.129592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.130183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.130748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.132672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5eb39-ec3b-491b-b72f-90ab35162013 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.145487 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1200/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:53.146983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.147573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.156005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.205312 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1241/2441] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:53.206334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.218973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] MFA Rules not processed for user `bc0cab89b5814ff59de8f6008f2f0d62`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:53.220476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.231365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a76a5-a17a-4574-8f00-ff9daf5a73fb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.242223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:53.252524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.254269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.254557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.256373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.258423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.261965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.271168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:53.312384 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1242/2442] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:53.314294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.327881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.387285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1201/2443] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:53.387285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.408024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3fe05-577b-483f-8ed7-02ad66d73b63 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.415563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.417495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.417880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.418306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] PATH_INFO: `/v3/projects/3520db4ec6ed48a49ecf074c3cfc9cb2/users/3c1cee5825a64b68b9f870c52c2d38ff/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.457659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3520db4ec6ed48a49ecf074c3cfc9cb2, user_id=3c1cee5825a64b68b9f870c52c2d38ff, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.470116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.497521 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1202/2444] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:53 2022] PUT /identity/v3/projects/3520db4ec6ed48a49ecf074c3cfc9cb2/users/3c1cee5825a64b68b9f870c52c2d38ff/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:53.498503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.507878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a544e-77a4-43a1-854b-dc81e46c5961 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.606935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad391b7-30b7-40a7-9557-0f0634cdb6d7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.611432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.612400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.612697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.613035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.621440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.622750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.623057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.623334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.686501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.688501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e246e7-d64c-45c1-9e7a-82b3cbb4586a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.696326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.699300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.704731 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1243/2445] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:53.705974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.706657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.706657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.713042 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1203/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:53.714248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.715825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.745142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] MFA Rules not processed for user `3c1cee5825a64b68b9f870c52c2d38ff`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:53.746427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.764420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:53.780366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:53.823585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b24d-e40d-411a-af0d-126fc1dde441 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:53.830913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:53.832590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:53.832590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:53.832590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] PATH_INFO: `/v3/projects/2736f0fea46045bebe448cac84248068` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:53.834539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2736f0fea46045bebe448cac84248068)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:53.836756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:53.852835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1244/2447] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:53.865320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:53.867161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:53.949475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2736f0fea46045bebe448cac84248068', 'request_id': 'req-de5ad80f-22aa-4eb0-867c-cf22da27c914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:53.967430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2736f0fea46045bebe448cac84248068', 'request_id': 'req-de5ad80f-22aa-4eb0-867c-cf22da27c914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:53.981034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2736f0fea46045bebe448cac84248068', 'request_id': 'req-de5ad80f-22aa-4eb0-867c-cf22da27c914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.006540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] The token cache is being invalidate because project 2736f0fea46045bebe448cac84248068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:54.007212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.009087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-de5ad80f-22aa-4eb0-867c-cf22da27c914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.012166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1204/2448] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:53 2022] DELETE /identity/v3/projects/2736f0fea46045bebe448cac84248068 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:54.013345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49c01-c766-46ef-b997-a9f9fa036c61 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.015096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.015760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.016245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.066697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] MFA Rules not processed for user `ac8ef83fa94e4c9db70a0115cc867dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:54.068339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.119653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.120390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.120671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.120945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.122848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.171970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1205/2449] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:54.172865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.178008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.190339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:54.206244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.208018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7358a-2d1a-412e-9e79-d8edd131d11c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.219490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1245/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:54.221193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.221556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.221837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.243546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] MFA Rules not processed for user `d57e5637ee194b27888af0b55136c83e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:54.245438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.264022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497e49b-b0bf-43a8-9d4e-0dd6b62f7cab None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.272436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.273823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.273823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.274013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] PATH_INFO: `/v3/users/d80fd05ea13e4658bb89acd07d7cb0a2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.275258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80fd05ea13e4658bb89acd07d7cb0a2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.277254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.280101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:54.332555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1246/2451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:54.333891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.337941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.353860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50f82-4eee-4f8c-a8f4-8960a35ef2bd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.359290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.360389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.360675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.360949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] PATH_INFO: `/v3/users/bc0cab89b5814ff59de8f6008f2f0d62` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.362459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0cab89b5814ff59de8f6008f2f0d62)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.367742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.368151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80fd05ea13e4658bb89acd07d7cb0a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.369092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80fd05ea13e4658bb89acd07d7cb0a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.410676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80fd05ea13e4658bb89acd07d7cb0a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.411980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80fd05ea13e4658bb89acd07d7cb0a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.428086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80fd05ea13e4658bb89acd07d7cb0a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.450004 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1206/2452] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:54 2022] DELETE /identity/v3/users/d80fd05ea13e4658bb89acd07d7cb0a2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:54.450004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.450886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.461262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0cab89b5814ff59de8f6008f2f0d62'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.471304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0cab89b5814ff59de8f6008f2f0d62'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.472547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0cab89b5814ff59de8f6008f2f0d62'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.473561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0cab89b5814ff59de8f6008f2f0d62'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.490654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0cab89b5814ff59de8f6008f2f0d62'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.516357 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1247/2453] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:54 2022] DELETE /identity/v3/users/bc0cab89b5814ff59de8f6008f2f0d62 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:54.517170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.519036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.550757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51042bd-1068-4339-8245-37d4f8267934 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.602677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7b5f8-11db-4bdc-8e42-77b68bffde55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.639944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.642287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.642659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.642968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] PATH_INFO: `/v3/users/3c1cee5825a64b68b9f870c52c2d38ff` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.645574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1cee5825a64b68b9f870c52c2d38ff)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.649378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.653441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.654122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.654400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.654670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.655600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.657434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e270-7ecd-475d-9a07-be65b9d7ed45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.661873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:54.697511 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1207/2454] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:54.697511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.697511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.697511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.724231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:54.727330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.741554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:54.755861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1cee5825a64b68b9f870c52c2d38ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.764613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1cee5825a64b68b9f870c52c2d38ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.765362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1cee5825a64b68b9f870c52c2d38ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.766650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1cee5825a64b68b9f870c52c2d38ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.785855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1cee5825a64b68b9f870c52c2d38ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:54.801602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1248/2455] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:54 2022] DELETE /identity/v3/users/3c1cee5825a64b68b9f870c52c2d38ff => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:54.802893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.806349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.847822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1208/2456] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:54.849109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:54.850544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:54.867021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26a79d-bc3e-4a5c-96ac-8177443d0981 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.944039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.945389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.945789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.946455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.947549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:54.949869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5bf6a-2c71-4abe-aec5-984ea12a7df3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:54.964536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691323-0b95-42f7-b8ab-e6579ec33ee1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:54.978541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1209/2457] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:54.983047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.983381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.983703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.985479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:54.986381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:54.986664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:54.986976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:54.989341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.008951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:55.010651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.048551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1210/2458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:55.049443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.058960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.082502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.084274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e4099-2fcf-41ef-8233-f9d594942779 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.095201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1249/2459] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:55.096726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.097301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.097426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.119613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:55.121009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.128949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e3278-cc92-4d05-b2ab-cedb1bd5c483 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.133452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.133452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.133789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.133789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.138033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:55.143984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.145862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.156234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1211/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:55.157787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.167666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c1c9a-b1ca-40d2-b365-27569ec344a2 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.173685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.174103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.174388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.174667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.175406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.177096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.189383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1212/2461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:55.190376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.193969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.198818 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1250/2462] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:55.199718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.201155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.210373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8992f-6a47-43e4-be82-214970ba8aeb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.215208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369109e-7ecb-49ab-b8e3-7d4a1e7ae94f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.217047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.218016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.218379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.218807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] PATH_INFO: `/v3/projects/2c14c2532c714e71b80ee8fbceff54df` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.220629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c14c2532c714e71b80ee8fbceff54df)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.220762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.221689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.221896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.222243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.223396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.233802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.235947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003682b5-5915-4d7d-9ba5-4f31ae12b406 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.248270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1251/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:55.249343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.249626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.249985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.256565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:55.275133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] MFA Rules not processed for user `05553baaba2b4467abbb9ca58afcebd9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:55.277483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.294106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c14c2532c714e71b80ee8fbceff54df', 'request_id': 'req-4e23aa49-ce7c-4f1c-a295-e615f11e942e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.302716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c14c2532c714e71b80ee8fbceff54df', 'request_id': 'req-4e23aa49-ce7c-4f1c-a295-e615f11e942e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.309413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c14c2532c714e71b80ee8fbceff54df', 'request_id': 'req-4e23aa49-ce7c-4f1c-a295-e615f11e942e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.333750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] The token cache is being invalidate because project 2c14c2532c714e71b80ee8fbceff54df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:55.334194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.335070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.339644 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1213/2464] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:55 2022] DELETE /identity/v3/projects/2c14c2532c714e71b80ee8fbceff54df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:55.339644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.345081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.368105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1252/2465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:55.369265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.370788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.449489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23aa49-ce7c-4f1c-a295-e615f11e942e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.455673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.456691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.457033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.457458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] PATH_INFO: `/v3/projects/a2401931660d4c928ac8119ce7ec8736/users/c39b50c6acd14d2aa8dc4c4e59c83fe3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.476928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2401931660d4c928ac8119ce7ec8736, user_id=c39b50c6acd14d2aa8dc4c4e59c83fe3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.477202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873af472-67ba-41aa-9c72-21990cf23255 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.480901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa325b9d-7a4b-4920-acc6-3d6f2b8e6a69 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.484820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.486570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.487056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.487341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.489879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.507041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1214/2466] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:55 2022] PUT /identity/v3/projects/a2401931660d4c928ac8119ce7ec8736/users/c39b50c6acd14d2aa8dc4c4e59c83fe3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:55.514874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.516008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.516651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.546381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:55.552955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.605137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:55.609928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.612639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.632572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1253/2467] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:55.635831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.660455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c14551-1093-4622-ba5b-6bd38eb2dc88 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.711738 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1215/2468] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:55.721362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.726660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.742284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0def071-ec5f-4ee2-bd5b-b56dfab8ee7c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.747501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.748835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.749178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.749531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] PATH_INFO: `/v3/projects/0fcce4b9445545fca456e2f844be191d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.751055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcce4b9445545fca456e2f844be191d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.753121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.798366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.799774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.800115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.800408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.801163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.803260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85445cd3-26ab-4f2e-9f28-883981e3ac97 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.819560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1254/2469] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:55.820941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.821234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.821512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.840355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:55.846703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:55.847983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.870012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcce4b9445545fca456e2f844be191d', 'request_id': 'req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.878151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcce4b9445545fca456e2f844be191d', 'request_id': 'req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.886196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcce4b9445545fca456e2f844be191d', 'request_id': 'req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.906757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] The token cache is being invalidate because project 0fcce4b9445545fca456e2f844be191d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:55.907112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.907834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:55.919422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1216/2470] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:55 2022] DELETE /identity/v3/projects/0fcce4b9445545fca456e2f844be191d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:55.919422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.919422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.953009 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1255/2471] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:55.954158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:55.956010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:55.977009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97535611-7ca4-4f7e-9354-951a9f1cb5b4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:55.984679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:55.985929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:55.986301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:55.986648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] PATH_INFO: `/v3/projects/a2401931660d4c928ac8119ce7ec8736/users/c39b50c6acd14d2aa8dc4c4e59c83fe3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:55.989254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2401931660d4c928ac8119ce7ec8736, user_id=c39b50c6acd14d2aa8dc4c4e59c83fe3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:55.993110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:55.994361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c76c2e-83fe-4f23-9884-c751e14dc0d5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.004617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.005527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.005810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.006084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] PATH_INFO: `/v3/projects/3520db4ec6ed48a49ecf074c3cfc9cb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.012550 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1256/2472] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:55 2022] PUT /identity/v3/projects/a2401931660d4c928ac8119ce7ec8736/users/c39b50c6acd14d2aa8dc4c4e59c83fe3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:56.012860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3520db4ec6ed48a49ecf074c3cfc9cb2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.012961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.012961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.013143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.083912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3520db4ec6ed48a49ecf074c3cfc9cb2', 'request_id': 'req-5dba686e-9ba7-497a-ae6e-20afc15e4910'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.091708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3520db4ec6ed48a49ecf074c3cfc9cb2', 'request_id': 'req-5dba686e-9ba7-497a-ae6e-20afc15e4910'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.100408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3520db4ec6ed48a49ecf074c3cfc9cb2', 'request_id': 'req-5dba686e-9ba7-497a-ae6e-20afc15e4910'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.115189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715747e8-9914-4483-aeef-78d8e1a0ae5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.121933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] The token cache is being invalidate because project 3520db4ec6ed48a49ecf074c3cfc9cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:56.122228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.124016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dba686e-9ba7-497a-ae6e-20afc15e4910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.126207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1217/2473] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:55 2022] DELETE /identity/v3/projects/3520db4ec6ed48a49ecf074c3cfc9cb2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:56.128626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.128847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.129130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.161632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:56.163783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.171364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:56.235601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:56.241484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.243282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.243619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.244359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] PATH_INFO: `/v3/users/d57e5637ee194b27888af0b55136c83e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.246109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57e5637ee194b27888af0b55136c83e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.248601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.264883 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1218/2474] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:56.266046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.274862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.298736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65977c-fb9c-4f88-b80a-b27690be9a05 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.305320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.306504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.306932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.307274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.308107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:56.308433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.311292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c97bfd-d8d4-494c-ad0e-47fd0e3b3c3e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.330572 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1219/2475] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:56.332232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129e7b-8f05-471f-95f8-e5396a63e2b3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.332600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129e7b-8f05-471f-95f8-e5396a63e2b3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.332931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129e7b-8f05-471f-95f8-e5396a63e2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.356895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57e5637ee194b27888af0b55136c83e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.368070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57e5637ee194b27888af0b55136c83e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.369106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57e5637ee194b27888af0b55136c83e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.369609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3e129e7b-8f05-471f-95f8-e5396a63e2b3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:56.370624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57e5637ee194b27888af0b55136c83e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.382828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e129e7b-8f05-471f-95f8-e5396a63e2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.387976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57e5637ee194b27888af0b55136c83e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:56.393782 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1220/2476] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:56.395765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c254-72dc-4466-a970-7895cb1f3521 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.396196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c254-72dc-4466-a970-7895cb1f3521 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.396632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69c254-72dc-4466-a970-7895cb1f3521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.416398 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1257/2477] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:56 2022] DELETE /identity/v3/users/d57e5637ee194b27888af0b55136c83e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:56.417980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.420201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.431114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5b69c254-72dc-4466-a970-7895cb1f3521 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:56.433849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b69c254-72dc-4466-a970-7895cb1f3521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.510600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab960a7-b6f8-4f35-bc7b-75ce8bff9765 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.517882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.518711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.519007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.519287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.520390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.522425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835abbf-f1c5-4c58-9370-22f639609a72 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.522751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1221/2478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:56.524209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.524737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.525069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.556685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:56.563075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.568642 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1258/2479] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:56.570396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.570790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.571170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.579578 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1222/2480] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:56.582955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.596766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f5123-cc27-4a4c-b62a-196bd39addd2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.597057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:56.598741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.629829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:56.690699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.691352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.691670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.691945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.693184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:56.693184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.695004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.711887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1223/2481] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:56.712698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.717504 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1259/2482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:56.721922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.731969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a82f-4e53-4c79-b460-1f8f04ef8bc5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.737050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.737985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.737985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.738449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.739158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.739686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542a3a0-2d7d-446d-82d2-bf2ac85dc305 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.741323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.748805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.750561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.751817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.752812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.754058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:56.754894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.757814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.767911 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1224/2483] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:56.769798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.783995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5fe9b-a919-4c8a-ac99-ca046d1f3216 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.789805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1260/2484] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:56.790814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.793399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:56.795717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.797233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.799653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.800066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.801980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.806400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.855875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1225/2485] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:56 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:56.857048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:56.882293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347523a4-94aa-436f-842c-15dd20bafe01 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.885436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:56.963245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a97f-ea28-4124-9f80-d8ee9dad70ac admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:56.972439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.973661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.973952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.974760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.975711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.977539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:56.980956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:56.981941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:56.983145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:56.983551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:56.998071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:56.999866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.000819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1226/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.001993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.014037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844945-1741-421e-9db9-50d163244f17 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.019829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.021305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.021814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.022238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.023082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.026051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.030961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1261/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:57.033523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.066469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1227/2488] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:57.074881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.094264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550a874-fb5a-44ac-9615-4c901a1bfa2b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.168915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5cf2-2ce9-4f36-99a7-269baa435809 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.176012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.176742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.177250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.177573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.178561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.181367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dac4d-0744-4df4-aa68-e1d2ad958c9a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.196939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1228/2489] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.198647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.198942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.199307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.217231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.217923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.218252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.218698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.219645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.222243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.242421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] MFA Rules not processed for user `c39b50c6acd14d2aa8dc4c4e59c83fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:57.245204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.257333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1262/2490] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:57.258304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.279279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:57.285525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd41a4-ffcf-4fa1-a615-e8b3fee569fb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.308976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.309901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.312036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.313237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.315988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.321216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.396837 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1263/2491] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:57.396837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.416972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9260-a1e4-46a0-891f-bcad847da27d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.426326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1229/2492] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:57.427432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.428374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.428755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.429026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] PATH_INFO: `/v3/projects/6707eb81235a4370a48c97279b7cfd21/users/39e45a1e351c47bc8d9c9f317a7d915e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.430896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.451632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c0f48-f4f0-4222-a31b-dc87e10d55e0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.457038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.457987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.458684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.459058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.460559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.464279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.480771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6707eb81235a4370a48c97279b7cfd21, user_id=39e45a1e351c47bc8d9c9f317a7d915e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.483446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42210b-45f2-4fc4-9650-5c6e32c98163 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.484947 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1230/2493] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.486752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.494400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:57.504401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0f4b8-adb9-494e-8601-a001381308ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.511099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.512043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.512962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.513698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.514698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.516812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.521400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1264/2494] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:57 2022] PUT /identity/v3/projects/6707eb81235a4370a48c97279b7cfd21/users/39e45a1e351c47bc8d9c9f317a7d915e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:57.521400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.521400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.521400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.535497 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1231/2495] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.541615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.558100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b1a79-c159-43c1-b61c-e7eabc257d22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.562459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] MFA Rules not processed for user `ac8ef83fa94e4c9db70a0115cc867dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:57.564026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.653331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.654411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.654791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.655165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.664917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.669529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9794ee-b7f4-4ad7-9e21-939bfa646e2f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.688802 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1232/2496] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.688802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.688802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.688802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.694757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1265/2497] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:57.695536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.717361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582c28-ee29-47a3-87d8-446dca200701 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.719895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:57.721377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.727563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.728644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.733166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1233/2498] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:57.733166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.740512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.741040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.742295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.743794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306963b-9b37-4314-bdd3-156ec243ccf1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.745094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.749585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.751052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.751385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.751761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] PATH_INFO: `/v3/projects/61871d9c8a11410588f6ee0c66806462/users/e7725044a9c94dcc86c61e4e8f3facc9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.762060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1266/2499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:57.763156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.765904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.775632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61871d9c8a11410588f6ee0c66806462, user_id=e7725044a9c94dcc86c61e4e8f3facc9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.778491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.781238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948371a5-9b9d-4c8b-a216-56226b9c1b74 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.786600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.787595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.787903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.788192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] PATH_INFO: `/v3/projects/406b8e76c3464355b7c897fc90e783c4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.789387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406b8e76c3464355b7c897fc90e783c4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:57.791491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:57.799253 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1234/2500] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:57 2022] PUT /identity/v3/projects/61871d9c8a11410588f6ee0c66806462/users/e7725044a9c94dcc86c61e4e8f3facc9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:57.800308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.802382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.846857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406b8e76c3464355b7c897fc90e783c4', 'request_id': 'req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:57.854444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406b8e76c3464355b7c897fc90e783c4', 'request_id': 'req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:57.862951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406b8e76c3464355b7c897fc90e783c4', 'request_id': 'req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:57.879173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] The token cache is being invalidate because project 406b8e76c3464355b7c897fc90e783c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:53:57.879598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:57.880432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:53:57.886224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1267/2501] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:57 2022] DELETE /identity/v3/projects/406b8e76c3464355b7c897fc90e783c4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:57.886224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:57.886224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.901113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d931ae1-5ee1-43ef-b5ab-f9b5670bf024 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.935046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:57.950620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2771-cbf8-4a3b-9c74-9a9d299ac4f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:57.955157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389151-f341-4c20-a135-646743308461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.955943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389151-f341-4c20-a135-646743308461 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.956287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389151-f341-4c20-a135-646743308461 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.956626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389151-f341-4c20-a135-646743308461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.958602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd389151-f341-4c20-a135-646743308461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:57.961365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:57.980514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:57.981804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:57.981804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:57.982126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:57.988901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.039951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389151-f341-4c20-a135-646743308461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.041511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389151-f341-4c20-a135-646743308461 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.055394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1268/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:58.056485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389151-f341-4c20-a135-646743308461 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.057935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd389151-f341-4c20-a135-646743308461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.067473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.070175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303cdef-8987-4ffc-a8c6-34c7236469ec service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.072206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389151-f341-4c20-a135-646743308461 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.079855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.080978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.081276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.081642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] PATH_INFO: `/v3/projects/f8585f618d5f4203af8209f5483e2eca/users/6b0c4b5dd6f0478e81580d12594528aa/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.084034 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1235/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:58.086520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8edd-bfda-42c2-a83e-97f1e47698e2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.086826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8edd-bfda-42c2-a83e-97f1e47698e2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.087113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8edd-bfda-42c2-a83e-97f1e47698e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.109982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8585f618d5f4203af8209f5483e2eca, user_id=6b0c4b5dd6f0478e81580d12594528aa, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.113553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2cd15-c2d6-4bf5-b52d-0826d7186425 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.124427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b00f8edd-bfda-42c2-a83e-97f1e47698e2 None None] MFA Rules not processed for user `e7725044a9c94dcc86c61e4e8f3facc9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:58.126218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b00f8edd-bfda-42c2-a83e-97f1e47698e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.135592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1269/2504] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:58 2022] PUT /identity/v3/projects/f8585f618d5f4203af8209f5483e2eca/users/6b0c4b5dd6f0478e81580d12594528aa/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:58.137930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.138373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.138657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.159491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:58.160869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.213640 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1236/2505] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:58.214952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858253-aa20-4b1c-9858-4c823435ffe5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.215301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858253-aa20-4b1c-9858-4c823435ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.215683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858253-aa20-4b1c-9858-4c823435ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.232821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1270/2506] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:58.233852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.234279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e2858253-aa20-4b1c-9858-4c823435ffe5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:58.235537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2858253-aa20-4b1c-9858-4c823435ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.236367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.243877 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1237/2507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:58.245271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.245271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.245585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.249262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea52c9e-39d6-4f34-bd6c-882ce020651c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.256202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.256890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.257164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.258135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.259034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.261036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.266741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:58.268110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.285547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1238/2508] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:58.287462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.290045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:58.303291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1271/2509] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:58.304205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.363425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba4b0a-13af-406a-b30c-f26263bf3326 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.367390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:58.388237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc64d3-2465-4882-8eb9-f6a2b74861ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.394034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.394717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.395340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.395667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.396430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:53:58.397289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:58.397414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.398998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.412794 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1272/2510] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:53:58.414367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.425278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2ff9-365c-4d15-aa39-26946b5ccd97 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.439354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.439354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.439354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.439354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.439826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.439826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.447131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.448376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.448674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.448959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.461642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.465434 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1273/2511] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/users => generated 298 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:58.465696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.465779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.479682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde7dc-7094-4613-9d13-27016fed5512 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.486377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.486960 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1239/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:58.487216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.487609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.487800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.487933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.488896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.490943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.501543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9bb67-67b1-426a-8da1-5d26350cb868 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.507648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.508388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.509077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.509544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.510421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.512321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.530926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1240/2513] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:58.532599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.536578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1274/2514] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:58.542938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.545268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf19a8-f8f6-419a-b9a4-a1276276c2ec admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.637405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.638461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.638807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.640226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] PATH_INFO: `/v3/projects/d7c3dd534f58402a845989af0b54bbf4/users/ca7e13d358a64393b36238da00c86608/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.671452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c3dd534f58402a845989af0b54bbf4, user_id=ca7e13d358a64393b36238da00c86608, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.676371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.698035 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1241/2515] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:58 2022] PUT /identity/v3/projects/d7c3dd534f58402a845989af0b54bbf4/users/ca7e13d358a64393b36238da00c86608/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:53:58.702707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.739212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98db84-7fd4-474a-bd30-0b4e31a9d8d9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.872664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.873669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.874147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.877214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.878299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.880877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.910983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82472d-5d93-4234-bd0c-ae96424503fb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.915761 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1275/2516] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:53:58 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:53:58.917203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.923046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.924229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.924787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.926320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.927935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.933181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.938859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81388dd6-a4eb-4da4-b918-4291861cf3d2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.950482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.955997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1242/2517] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:58.957884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.958591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:58.961363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.961818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.963478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:58.970541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:58.974410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc3393-2270-44f4-a01d-cb49e77cb6b7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:58.988629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:58.990539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:58.994609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:58.995016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] PATH_INFO: `/v3/projects/d7c3dd534f58402a845989af0b54bbf4/users/ca7e13d358a64393b36238da00c86608/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:58.998604 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1276/2518] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:59.003917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:59.005700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c3dd534f58402a845989af0b54bbf4, user_id=ca7e13d358a64393b36238da00c86608, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.011349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:59.014699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51fe9-0bce-45be-8fe5-4f4b63da4fca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:59.021543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:59.022404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.022697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.023031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.023834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.025615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232ac3f-1bc9-46e6-940e-da6754deb89b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:59.038975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1243/2519] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:58 2022] PUT /identity/v3/projects/d7c3dd534f58402a845989af0b54bbf4/users/ca7e13d358a64393b36238da00c86608/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:59.040201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1277/2520] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:53:59.054321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:59.057422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1ac2-7e3c-4d8d-a1b2-d822ddb0f0f4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.057721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1ac2-7e3c-4d8d-a1b2-d822ddb0f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.058033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f1ac2-7e3c-4d8d-a1b2-d822ddb0f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.130199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:59.144463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:59.149189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1f6f1ac2-7e3c-4d8d-a1b2-d822ddb0f0f4 None None] MFA Rules not processed for user `ca7e13d358a64393b36238da00c86608`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:59.150370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f6f1ac2-7e3c-4d8d-a1b2-d822ddb0f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:59.247825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb755-062a-4877-bab7-78e9581d4785 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:59.260570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:59.261494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.263562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.263862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] PATH_INFO: `/v3/projects/c30f7e8904fe4a91a6f20bf28cd1e492/users/24b464a991224d9c80b8fd9f07afcf16/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.302955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30f7e8904fe4a91a6f20bf28cd1e492, user_id=24b464a991224d9c80b8fd9f07afcf16, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.305656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:59.323664 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1278/2521] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:59.349317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.349652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.349838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.352951 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1244/2522] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:53:59 2022] PUT /identity/v3/projects/c30f7e8904fe4a91a6f20bf28cd1e492/users/24b464a991224d9c80b8fd9f07afcf16/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:53:59.370381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:59.371935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:59.455563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1279/2523] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:59.466640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:59.565468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:59.567254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:59.579820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaff5b-b06b-4548-9da6-d77197fa8184 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:59.585815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:59.587533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.589436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.590130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.601706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.603203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fdbf7-79b1-4184-9d85-3793ee888b1b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:59.620845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1245/2524] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:59.622807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.623886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.624544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.650891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] MFA Rules not processed for user `90a9faf4a615437ca499c0ccbc1e7563`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:59.652887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:59.704309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247b2b7-e6e3-4d2c-a1f1-2a79dd465fe3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:59.715531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:59.717096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.717617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.718106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.765821 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1246/2525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:59.781193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:59.855410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.857124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43266b7-a410-4de6-b37e-62b1af1f1242 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:59.896835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1280/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:59.906451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:59.925540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3096737-c281-4389-b3ac-dc11ff91c80a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:59.948847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:59.949764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:59.950054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:59.950776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] PATH_INFO: `/v3/users/e7725044a9c94dcc86c61e4e8f3facc9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:59.951995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7725044a9c94dcc86c61e4e8f3facc9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:59.956765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:00.098932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7725044a9c94dcc86c61e4e8f3facc9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:00.100142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7725044a9c94dcc86c61e4e8f3facc9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:00.103700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:00.114464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7725044a9c94dcc86c61e4e8f3facc9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:00.118804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7725044a9c94dcc86c61e4e8f3facc9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:00.146730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7725044a9c94dcc86c61e4e8f3facc9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:00.169889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1247/2527] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:59 2022] DELETE /identity/v3/users/e7725044a9c94dcc86c61e4e8f3facc9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:00.174441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:00.175152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:00.175639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:00.199382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:00.200662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:00.404047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1281/2528] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:00.468260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:00.471564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:00.604166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a786163-9dcb-4536-bea3-8c43909b2b7d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:00.611197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:00.612024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:00.612310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:00.612974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:00.635162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:00.636725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:00.663999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1248/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:02.316810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:02.318947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:02.346319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046ce3-3ce0-42d8-847c-e813573644ff None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:02.379712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:02.380996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:02.381599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:02.382082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] PATH_INFO: `/v3/projects/61871d9c8a11410588f6ee0c66806462` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:02.383811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61871d9c8a11410588f6ee0c66806462)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:02.398171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:02.588501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61871d9c8a11410588f6ee0c66806462', 'request_id': 'req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.639389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61871d9c8a11410588f6ee0c66806462', 'request_id': 'req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.670435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61871d9c8a11410588f6ee0c66806462', 'request_id': 'req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.701498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] The token cache is being invalidate because project 61871d9c8a11410588f6ee0c66806462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:02.709144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.709949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.715832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1282/2530] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:02 2022] DELETE /identity/v3/projects/61871d9c8a11410588f6ee0c66806462 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:02.720261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:02.739495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d0c9-8fb6-4fc1-b31f-3f3c097dc537 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:02.858323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:02.859670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:02.860322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:02.860887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] PATH_INFO: `/v3/users/ca7e13d358a64393b36238da00c86608` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:02.862363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7e13d358a64393b36238da00c86608)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:02.865696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:02.978725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7e13d358a64393b36238da00c86608'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:02.980100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7e13d358a64393b36238da00c86608'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:03.000493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7e13d358a64393b36238da00c86608'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:03.002164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7e13d358a64393b36238da00c86608'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:03.046296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:03.049397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7e13d358a64393b36238da00c86608'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:03.075899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1249/2531] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:02 2022] DELETE /identity/v3/users/ca7e13d358a64393b36238da00c86608 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:04.879186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:04.881670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:05.097090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:05.129926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287a3a5-9ce8-48b2-bfbe-fc8f81dc8e88 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:05.244740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:05.245517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:05.245812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:05.246098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:05.263466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:05.377447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:05.379121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0de02-4406-4def-b034-ddb30241f6fd service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:05.398570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1283/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:06.159138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:06.160772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:06.306411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d1ad-32bd-4587-8869-968bb173ae6d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:06.324014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:06.324909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:06.325191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:06.325468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] PATH_INFO: `/v3/projects/d7c3dd534f58402a845989af0b54bbf4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:06.327049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c3dd534f58402a845989af0b54bbf4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:06.329698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:06.490545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c3dd534f58402a845989af0b54bbf4', 'request_id': 'req-4fc25052-b87f-49a5-9a24-eeb09f6e3384'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:06.505212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c3dd534f58402a845989af0b54bbf4', 'request_id': 'req-4fc25052-b87f-49a5-9a24-eeb09f6e3384'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:06.532405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c3dd534f58402a845989af0b54bbf4', 'request_id': 'req-4fc25052-b87f-49a5-9a24-eeb09f6e3384'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:06.556358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] The token cache is being invalidate because project d7c3dd534f58402a845989af0b54bbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:06.556657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:06.557363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fc25052-b87f-49a5-9a24-eeb09f6e3384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:06.582334 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1250/2533] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:06 2022] DELETE /identity/v3/projects/d7c3dd534f58402a845989af0b54bbf4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:06.583736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:06.584189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:06.584612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:06.623741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:06.626504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:06.737031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1284/2534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:06.739322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:06.739877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:06.740333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:06.760959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:06.762430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:06.775795 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1251/2535] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:06.776806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:06.788823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d257a42-2080-42a7-bed2-ba0fffe96644 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:06.794869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:06.795584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:06.795870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:06.797391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:06.798953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:54:06.799376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:06.801502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:06.825625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1285/2536] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:54:06.827261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:06.839609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5053c6-c38b-4004-8860-106be3987f20 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:06.845476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:06.846536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:06.846965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:06.847379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:06.848402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:06.854417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:06.908139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1252/2537] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:06 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:06.909160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:06.920950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a9a0-8566-4012-bf18-489f267d5ba2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:06.938096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:07.010438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.011252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.011485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.011932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.013642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.015769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a5be7-a77e-43ec-ae22-4abbfdb7baa2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:07.052086 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1286/2538] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:06 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:07.053911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:07.081009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1939-e0fb-41a7-9215-5bb784c41f8e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:07.086650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2946-3599-4299-9378-85d12b16c165 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.086944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2946-3599-4299-9378-85d12b16c165 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.087228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce2946-3599-4299-9378-85d12b16c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.119452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.120175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.120575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.120981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.121724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.123312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:07.134161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a5ce2946-3599-4299-9378-85d12b16c165 None None] MFA Rules not processed for user `859de04797504bcbb5134dba5c8183a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:07.135457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a5ce2946-3599-4299-9378-85d12b16c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:07.167646 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1253/2539] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:07.172052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:07.193194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c103-32e9-4805-8445-2c0bc1d5f18a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:07.206514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.207397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.207904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.208459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.209344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.211139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:07.223419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1254/2540] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:07.227600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:07.240847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b34b71-f1db-4ee3-b9be-cadc9b97245f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:07.254402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.255662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.256096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.256523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] PATH_INFO: `/v3/projects/007f08ee799d431fb8d18c31dd5991e0/users/3eef1a5b965a4d26adaed7af3344e7c9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.293419 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1287/2541] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:07.298209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007f08ee799d431fb8d18c31dd5991e0, user_id=3eef1a5b965a4d26adaed7af3344e7c9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.301387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:07.325364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1255/2542] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:07 2022] PUT /identity/v3/projects/007f08ee799d431fb8d18c31dd5991e0/users/3eef1a5b965a4d26adaed7af3344e7c9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:54:07.336967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.338008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.338615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.391402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:07.393660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:07.510374 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1288/2543] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:07.516114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:07.521423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:07.632538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d9944-7e04-4ed1-8e82-0db3f777b8f0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:07.637746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.638550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.638829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.639103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.639851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.642231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:07.745422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1256/2544] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:07 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:07.746887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:07.781457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e942c-6c29-4fb9-baba-8def907e81fa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:07.897861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:07.943596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:07.944487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:07.944882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:07.945276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:07.949547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:07.958504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:08.007694 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1289/2545] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:07 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:08.008924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:08.024501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741d68-3cec-4948-beb0-3dcaa6f5bfae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:08.049465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:08.055482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.055926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.056220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.057226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:08.065014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:08.112197 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1257/2546] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:08.113456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:08.135044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a4c48-7664-4b16-93db-324cfe890edf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:08.158003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:08.161153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.161557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.162268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] PATH_INFO: `/v3/projects/54c29d5599644defa46fabaaca04860a/users/2a730ea1fa8d4f53888df1551d71d391/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.222985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c29d5599644defa46fabaaca04860a, user_id=2a730ea1fa8d4f53888df1551d71d391, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:08.232989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:08.286469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1290/2547] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:08 2022] PUT /identity/v3/projects/54c29d5599644defa46fabaaca04860a/users/2a730ea1fa8d4f53888df1551d71d391/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:08.287699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:08.307046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3955-4ab1-48ff-bfa5-e355681e61bd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:08.494987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:08.495968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.496258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.496582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.497321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:08.501818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3027-ae9f-4d59-877d-98e821a0100c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:08.529942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:08.530556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1258/2548] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:08.548723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a204fb-0a4b-41a4-8dc6-cb6865d6f4a4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:08.561942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:08.563056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.563345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.563702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] PATH_INFO: `/v3/projects/54c29d5599644defa46fabaaca04860a/users/2a730ea1fa8d4f53888df1551d71d391/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.570251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c29d5599644defa46fabaaca04860a, user_id=2a730ea1fa8d4f53888df1551d71d391, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:08.572969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05f0a-b270-4673-b44b-15c10782c626 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:08.606543 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1291/2549] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:08 2022] PUT /identity/v3/projects/54c29d5599644defa46fabaaca04860a/users/2a730ea1fa8d4f53888df1551d71d391/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:54:08.617420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.617712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.617991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.671675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] MFA Rules not processed for user `2a730ea1fa8d4f53888df1551d71d391`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:08.672569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:08.853427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:08.884574 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1259/2550] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:08.901187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab04d-9725-4a72-8d83-cad50dc3a295 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:08.901824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab04d-9725-4a72-8d83-cad50dc3a295 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:08.901824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab04d-9725-4a72-8d83-cad50dc3a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:08.956125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5eaab04d-9725-4a72-8d83-cad50dc3a295 None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:08.957773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5eaab04d-9725-4a72-8d83-cad50dc3a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:09.137281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1292/2551] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:10.864133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:10.869291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:11.089088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f117f8-20cb-4d27-ba54-e3addbc41790 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:11.108238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:11.109581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:11.110033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:11.110477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:11.150532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:11.162778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:11.187596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1260/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:13.587382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970de960-4b1b-4a92-8e92-3c6f6eea387e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:13.589541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970de960-4b1b-4a92-8e92-3c6f6eea387e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:13.589838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970de960-4b1b-4a92-8e92-3c6f6eea387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:13.665141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-970de960-4b1b-4a92-8e92-3c6f6eea387e None None] MFA Rules not processed for user `6b0c4b5dd6f0478e81580d12594528aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:13.667285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-970de960-4b1b-4a92-8e92-3c6f6eea387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:13.840641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1293/2553] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:14.505952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:14.508046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:14.537723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743a0d-ff20-4a86-b957-9ab7a7af6737 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:14.564377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:14.566392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:14.566735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:14.567087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:14.591178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:14.596918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d87c20-3550-4677-ad0b-53cbd81222c5 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:14.626624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1261/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:22.068347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:22.069196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:22.069642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:22.158375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] MFA Rules not processed for user `6b0c4b5dd6f0478e81580d12594528aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:22.159666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:22.177478 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1294/2555] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:22.713691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:22.714899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:22.715370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:22.776125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] MFA Rules not processed for user `39e45a1e351c47bc8d9c9f317a7d915e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:22.777870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:22.873680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1262/2556] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:22.878543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:22.880465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:22.926055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:22.977436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec249d-bb6d-4804-96e3-aa7a4c43c47e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:22.983181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:22.984403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:22.984969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:22.985765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:22.986748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:22.989127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.027192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1295/2557] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:22 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:23.027718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.041321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d33163-9e55-4a86-9218-0ab2dd44c217 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.122630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.123466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.124088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.124655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.125446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.127795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.136506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:23.163774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.180565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1263/2558] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:23 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:23.184132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a751-048f-418d-aff3-5b3fef2e7644 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.190926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.191984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.192346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.192833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.193836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.195673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205860b-b5f5-4b30-bd4d-7ff77f191cb6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.220443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.231208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1296/2559] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:23.233516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b8124-7934-478a-82dd-01132d05ed6f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.239084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.240121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.240474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.241036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] PATH_INFO: `/v3/projects/45fe76ea85564cec9dcd88ffde256b9e/users/dc53aee23f114c189811e3abb323a204/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.277412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d18e-6e49-4da3-95c3-e0bdd6930997 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.277775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d18e-6e49-4da3-95c3-e0bdd6930997 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.278131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d18e-6e49-4da3-95c3-e0bdd6930997 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.280073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1297/2560] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:54:23.294944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe76ea85564cec9dcd88ffde256b9e, user_id=dc53aee23f114c189811e3abb323a204, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.298244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.298613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.298973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.316538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.331885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:23.333920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:23.349746 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1264/2561] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:23 2022] PUT /identity/v3/projects/45fe76ea85564cec9dcd88ffde256b9e/users/dc53aee23f114c189811e3abb323a204/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:23.353036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.495463 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1298/2562] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:23.503634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.506499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:23.534092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb490b-d197-4a61-a2b1-365f9b0196f1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.535936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06a47-5636-4c48-92d6-6c2c978192d0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.545030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.548025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.548608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.548899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.549180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.550960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.551249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.551542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.552304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.560196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.572060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.575802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3585ef-d04b-4e10-b6fb-b45a4449a12b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.595892 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1265/2563] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:23.597505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:23.609959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1299/2564] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:23.618130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65b1e-e911-4dba-8c29-803cb7814dc4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:23.625286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:23.626206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:23.626846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:23.627419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] PATH_INFO: `/v3/projects/45fe76ea85564cec9dcd88ffde256b9e/users/dc53aee23f114c189811e3abb323a204/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:23.631107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe76ea85564cec9dcd88ffde256b9e, user_id=dc53aee23f114c189811e3abb323a204, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:23.634652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:23.672479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1266/2565] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:23 2022] PUT /identity/v3/projects/45fe76ea85564cec9dcd88ffde256b9e/users/dc53aee23f114c189811e3abb323a204/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:24.545992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:24.547783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:24.548905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:24.662136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] MFA Rules not processed for user `24b464a991224d9c80b8fd9f07afcf16`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:24.668044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:24.853338 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1300/2566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:25.772222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:25.962911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344f6c-1327-49d5-8a2b-072ebfc2760b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:25.979075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:25.980529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:25.980836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:25.982416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:26.003859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:26.005629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab52aed-1446-4cb2-9b7a-4474199396c8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:26.034774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1267/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:28.566214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:28.586122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d763ad-842d-45a4-a28a-881dd0e0744d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:28.594806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:28.596243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:28.596719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:28.597287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:28.600131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:28.656077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:28.752209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:28.754258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ebc93-256d-43c0-bfed-229664b89c7a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:28.791562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1301/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:32.920970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:32.922691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:32.923144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:32.928059 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1268/2569] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:54:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:54:32.935028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:32.935658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:32.935658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:32.960696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:32.962437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:33.100590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1302/2570] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:33.129765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:33.131793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:33.161794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd977bc-e6fb-4ffa-8e64-3f642df6cb43 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:33.168631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:33.169653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:33.170153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:33.170693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:33.193177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:33.195864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3e61d-f6a8-4de6-bcf8-8ff7e25e8737 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:33.219427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1269/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:33.599583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:33.622263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c1ca-2a6a-494c-8305-c27a24643877 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:33.639144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:33.642020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:33.642224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:33.642502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:33.646467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:33.675413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:33.677080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3736f-6db4-4bab-aa93-013be1d409cb service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:33.720171 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1303/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:34.645792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ca8ca-8fba-4f0b-afa3-f0b9d3195c8d None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:34.647010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ca8ca-8fba-4f0b-afa3-f0b9d3195c8d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:34.647529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ca8ca-8fba-4f0b-afa3-f0b9d3195c8d None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:34.649410 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1270/2573] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:54:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:54:34.663368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907fa42-8e94-485c-80a7-4e2c8ef2b26e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:34.664535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907fa42-8e94-485c-80a7-4e2c8ef2b26e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:34.665395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907fa42-8e94-485c-80a7-4e2c8ef2b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:34.709984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b907fa42-8e94-485c-80a7-4e2c8ef2b26e None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:34.712097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b907fa42-8e94-485c-80a7-4e2c8ef2b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:34.757251 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1304/2574] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:34.837338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ca8ca-8fba-4f0b-afa3-f0b9d3195c8d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:34.874816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:34.930686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ca8ca-8fba-4f0b-afa3-f0b9d3195c8d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:34.934499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:34.935449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:34.936002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:34.936517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:34.950740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:34.952775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:34.977239 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1271/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:35.001931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b175965-c314-4e9f-8f2f-72deada0a804 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:35.002304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b175965-c314-4e9f-8f2f-72deada0a804 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:35.002609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b175965-c314-4e9f-8f2f-72deada0a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:35.047932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6b175965-c314-4e9f-8f2f-72deada0a804 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:35.049271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6b175965-c314-4e9f-8f2f-72deada0a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:35.069151 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1305/2576] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:35.096326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:35.108150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f01d78-9e3e-437a-aceb-11e6f59e3266 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:35.114999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:35.116764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:35.117413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:35.118015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:35.128568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:35.130388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:35.145301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1272/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:35.680924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:35.684209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:35.684392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:35.725840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] MFA Rules not processed for user `dc53aee23f114c189811e3abb323a204`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:35.727281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:35.884705 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1306/2578] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:35.896128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:35.897572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:36.084866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0aaf3-0ecf-49ce-be36-9f9407c1e4c5 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:36.091042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:36.092130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:36.092855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:36.095323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:36.119365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:36.121285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17de0cf-cf54-4569-a225-799d28c235c7 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:36.137217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1273/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:39.067402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:39.103476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc67b-9229-4bf7-8eb7-169695ae6542 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:39.144146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:39.145183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:39.145507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:39.145832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:39.186989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:39.408492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:39.412983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:39.454829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1307/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:41.306571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339cdb-dd49-46b2-9fe4-fab8689b62ff None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:41.307108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339cdb-dd49-46b2-9fe4-fab8689b62ff None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:41.307108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339cdb-dd49-46b2-9fe4-fab8689b62ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:41.343804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-00339cdb-dd49-46b2-9fe4-fab8689b62ff None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:41.345442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-00339cdb-dd49-46b2-9fe4-fab8689b62ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:41.413045 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1274/2581] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:45.210300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:45.213638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:45.572758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce1cc1-9c37-4d9a-948e-1fd5409566b2 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:45.584994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:45.586084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:45.589373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:45.590037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] PATH_INFO: `/v3/users/05553baaba2b4467abbb9ca58afcebd9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:45.593413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05553baaba2b4467abbb9ca58afcebd9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:45.597998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:45.743577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05553baaba2b4467abbb9ca58afcebd9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:45.765832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05553baaba2b4467abbb9ca58afcebd9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:45.768007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05553baaba2b4467abbb9ca58afcebd9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:45.770382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05553baaba2b4467abbb9ca58afcebd9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:45.824251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05553baaba2b4467abbb9ca58afcebd9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:45.858556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1308/2582] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:45 2022] DELETE /identity/v3/users/05553baaba2b4467abbb9ca58afcebd9 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:45.864191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:45.864794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:45.864794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:45.913650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:45.915363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:45.993134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:46.040472 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1275/2583] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:46.086440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:46.089332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:46.192291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:46.300099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016697c-61f7-49a2-99be-0e56e63915e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:46.305066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:46.305859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:46.306241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:46.306613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:46.317861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:46.319718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:46.336686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1309/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:47.857442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:47.857442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:47.885323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2a0e-bd93-4e0d-aed1-00264864ddf8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:47.894221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:47.896528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:47.897716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:47.898673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] PATH_INFO: `/v3/projects/3ef34a6d89d0462d8643be6625b114d9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:47.901723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef34a6d89d0462d8643be6625b114d9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:47.904344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:48.012567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef34a6d89d0462d8643be6625b114d9', 'request_id': 'req-4d224938-a9ad-41dd-b80d-44c4aa54d139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.055782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef34a6d89d0462d8643be6625b114d9', 'request_id': 'req-4d224938-a9ad-41dd-b80d-44c4aa54d139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.071622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef34a6d89d0462d8643be6625b114d9', 'request_id': 'req-4d224938-a9ad-41dd-b80d-44c4aa54d139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.110185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] The token cache is being invalidate because project 3ef34a6d89d0462d8643be6625b114d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:48.110750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.111752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d224938-a9ad-41dd-b80d-44c4aa54d139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.117823 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1276/2585] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:47 2022] DELETE /identity/v3/projects/3ef34a6d89d0462d8643be6625b114d9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:48.122281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:48.142126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d95c52-406c-403a-8d59-22d0df22523d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:48.382653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:48.384381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:48.385053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:48.385502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] PATH_INFO: `/v3/users/aea29c7af6ba4ebda8b491e0ba2ae9f6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:48.386962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea29c7af6ba4ebda8b491e0ba2ae9f6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:48.390445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:48.514590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea29c7af6ba4ebda8b491e0ba2ae9f6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.544871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea29c7af6ba4ebda8b491e0ba2ae9f6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.550071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea29c7af6ba4ebda8b491e0ba2ae9f6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.552896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea29c7af6ba4ebda8b491e0ba2ae9f6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.604641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea29c7af6ba4ebda8b491e0ba2ae9f6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:48.637368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1310/2586] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:48 2022] DELETE /identity/v3/users/aea29c7af6ba4ebda8b491e0ba2ae9f6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:48.887699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:48.888304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:48.890073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:48.926268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:48.930028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:49.006503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1277/2587] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:49.024797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:49.026611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:49.137527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:49.213322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f144d8b-6f6c-41ff-8521-d40bf1eba637 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:49.228664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:49.229847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:49.230321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:49.230825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:49.250149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:49.252721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b2c0-c720-41df-9bd5-eb56961dc512 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:49.284395 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1311/2588] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:49.598749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:49.601381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:49.752310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c886f-688d-4505-b49d-d1f4e131479e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:49.774965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:49.776057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:49.776344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:49.776616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] PATH_INFO: `/v3/projects/88c4fc51e48a41f7901df21322139226` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:49.778497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c4fc51e48a41f7901df21322139226)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:49.780623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:49.795699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:49.858585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c4fc51e48a41f7901df21322139226', 'request_id': 'req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:49.866666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c4fc51e48a41f7901df21322139226', 'request_id': 'req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:49.876235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c4fc51e48a41f7901df21322139226', 'request_id': 'req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:49.896514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] The token cache is being invalidate because project 88c4fc51e48a41f7901df21322139226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:49.897263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:49.897540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4de39b1-ee38-44c3-beb7-774f7b5a9dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:49.906014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:49.906267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1278/2589] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:49 2022] DELETE /identity/v3/projects/88c4fc51e48a41f7901df21322139226 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:49.906533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:49.906873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:49.939181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:49.943539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:50.033122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1312/2590] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:50.035458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.035986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.036463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.066411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:50.068013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:50.085655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.098431 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1279/2591] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:50.099592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755079b-05d2-45f2-b7a3-8772708d74d4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.109257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.110198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.110627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.110997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.111890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:54:50.112296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.114343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.130725 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1313/2592] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:54:50.134471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.145159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca35897-613d-4b70-83b6-a317fc345070 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.150554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.164223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.166087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.166493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.168397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.173843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.229361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.248270 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1280/2593] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:50 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:50.250643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc262b9-8952-44b6-918a-4bbd52fc1927 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.331253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.333323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.333915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.333915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.334962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.337982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.388922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.403374 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1314/2594] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:50 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:50.403676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b86528-8ade-4f35-8b1c-e73f26a23685 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.410309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.411000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.411374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.411761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.412597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.414451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.432337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.435679 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1281/2595] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:54:50.443847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80049d-f3e6-4688-b53a-d09f5d41f3ea admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.453543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.455094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.455476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.455870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.457297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.459008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26240549-7686-4ca9-8503-2f9fc1645108 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.484311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1315/2596] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:50.485276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.508329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aef0e8-d0ca-4dd2-9217-dbbff74573d7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.524255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.525456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.526046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.526499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] PATH_INFO: `/v3/projects/909ca001b6524880a206dfe2ccfe7c43/users/05e7dbe556db4492ae035998db29fdab/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.568473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909ca001b6524880a206dfe2ccfe7c43, user_id=05e7dbe556db4492ae035998db29fdab, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.572127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:50.603335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1282/2597] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:50 2022] PUT /identity/v3/projects/909ca001b6524880a206dfe2ccfe7c43/users/05e7dbe556db4492ae035998db29fdab/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:54:50.615559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.615856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.616132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.680672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] MFA Rules not processed for user `05e7dbe556db4492ae035998db29fdab`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:50.681937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:50.784305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:50.862620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:50.864136 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1316/2598] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:50.957588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca145c-9bbe-4b05-8e5f-4b81ffc2cf94 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:50.963259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:50.964126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:50.964467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:50.964749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:50.965447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:50.968357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.013183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:51.025215 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1283/2599] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:50 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:54:51.029751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36f390-b3cc-425d-bf40-813e3827f72f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:51.178368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:51.180961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.180961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.180961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.181931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:51.187491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.239936 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1317/2600] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:51 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:51.244620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:51.256302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d2-da32-4095-8155-d52fa2084137 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:51.273033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:51.277273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.277693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.277985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.278766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:51.281511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.309012 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1284/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:51.314197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:51.325100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a03c0-8dd4-4554-bbdf-95204eccf039 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:51.340599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:51.341486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.341925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.342318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] PATH_INFO: `/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7/users/8614c60c652a40ab930cb1f5ebcba0d5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.383716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=52629a4e1ca2403098b9fd8e5e8821e7, user_id=8614c60c652a40ab930cb1f5ebcba0d5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:51.386750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.417945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1318/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:51 2022] PUT /identity/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7/users/8614c60c652a40ab930cb1f5ebcba0d5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:51.422085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:51.436154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd431e-3558-41c6-a5d2-d7ac68154429 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:51.449073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:51.580832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:51.581603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.581910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.582173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.585515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:51.588450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938c1a0-fed9-4b10-99ac-08a420429aff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.614468 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1285/2603] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:51.619211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:51.635272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbe5eb-d300-4de6-8171-af7319ffd3ce admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:51.641724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:51.643355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.643737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.644093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] PATH_INFO: `/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7/users/8614c60c652a40ab930cb1f5ebcba0d5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.646546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52629a4e1ca2403098b9fd8e5e8821e7, user_id=8614c60c652a40ab930cb1f5ebcba0d5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:51.650333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:51.664523 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1319/2604] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:51 2022] PUT /identity/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7/users/8614c60c652a40ab930cb1f5ebcba0d5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:51.676363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444123-521d-4d2d-9243-28050f560847 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:51.676981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444123-521d-4d2d-9243-28050f560847 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:51.677658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444123-521d-4d2d-9243-28050f560847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:51.714026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a7444123-521d-4d2d-9243-28050f560847 None None] MFA Rules not processed for user `8614c60c652a40ab930cb1f5ebcba0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:51.715890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a7444123-521d-4d2d-9243-28050f560847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:51.843208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1286/2605] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:52.460736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:52.467116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:52.585617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0cf19-da2b-4112-a9aa-456c6509822f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:52.593511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:52.594191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:52.594474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:52.594750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:52.605971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:52.608898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:52.623768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1320/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:54:54.039904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444123-521d-4d2d-9243-28050f560847 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:54.041906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a7444123-521d-4d2d-9243-28050f560847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:54.060707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444123-521d-4d2d-9243-28050f560847 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:54.069259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:54.069933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:54.084079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:54.084458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:54.248943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:54.252026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3c505-bf2e-470e-84d3-4de4ad27dddf service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:54.283664 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1287/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:54.294230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:54.314185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:54.494609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0accd-b973-43b5-965e-e833e8de0880 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:54.510360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:54.512623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:54.513186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:54.513752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] PATH_INFO: `/v3/users/05e7dbe556db4492ae035998db29fdab` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:54.518188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e7dbe556db4492ae035998db29fdab)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:54.524074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:54.632092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e7dbe556db4492ae035998db29fdab'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:54.641190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e7dbe556db4492ae035998db29fdab'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:54.641920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e7dbe556db4492ae035998db29fdab'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:54.642520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e7dbe556db4492ae035998db29fdab'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:54.663303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e7dbe556db4492ae035998db29fdab'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:54.685600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1321/2608] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:54 2022] DELETE /identity/v3/users/05e7dbe556db4492ae035998db29fdab => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:54.690584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:54.690874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:54.691778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:54.711096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:54.712399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:54.737899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:54.796499 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1288/2609] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:54.805914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:54.807370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:54.873531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dec10-8fcb-4c78-aeeb-ebeef704f36d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:54.878201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:54.878942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:54.879239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:54.879503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:54.892284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:54.894744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:54.919747 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1322/2610] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:55.304914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:55.306486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:55.332638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f308b-1211-4564-a061-9c5fd6c56e10 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:55.338380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:55.339455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:55.339921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:55.340362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] PATH_INFO: `/v3/projects/909ca001b6524880a206dfe2ccfe7c43` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:55.341899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909ca001b6524880a206dfe2ccfe7c43)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:55.344305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:55.420987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909ca001b6524880a206dfe2ccfe7c43', 'request_id': 'req-2527cb5e-c17d-497e-8d48-57d7b0100a16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.428378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909ca001b6524880a206dfe2ccfe7c43', 'request_id': 'req-2527cb5e-c17d-497e-8d48-57d7b0100a16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.435434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909ca001b6524880a206dfe2ccfe7c43', 'request_id': 'req-2527cb5e-c17d-497e-8d48-57d7b0100a16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.455832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] The token cache is being invalidate because project 909ca001b6524880a206dfe2ccfe7c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:55.456227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.456942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.458740 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1289/2611] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:55 2022] DELETE /identity/v3/projects/909ca001b6524880a206dfe2ccfe7c43 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:55.463926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:55.482588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c04984-dd46-4626-82a8-e8530746a766 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:55.577674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:55.641208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:55.642044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:55.642474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:55.647823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] PATH_INFO: `/v3/users/8614c60c652a40ab930cb1f5ebcba0d5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:55.649652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8614c60c652a40ab930cb1f5ebcba0d5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:55.651797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:55.764621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8614c60c652a40ab930cb1f5ebcba0d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.801628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8614c60c652a40ab930cb1f5ebcba0d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.806187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8614c60c652a40ab930cb1f5ebcba0d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.809449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8614c60c652a40ab930cb1f5ebcba0d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.845426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-908e786a-bf94-48c3-a27f-56260f13e919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8614c60c652a40ab930cb1f5ebcba0d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:55.875350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1323/2612] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:55 2022] DELETE /identity/v3/users/8614c60c652a40ab930cb1f5ebcba0d5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:56.684380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:56.686113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:56.711134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cb5e-c17d-497e-8d48-57d7b0100a16 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:56.827544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:56.828414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:56.828696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:56.828970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] PATH_INFO: `/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:56.830353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52629a4e1ca2403098b9fd8e5e8821e7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:56.832299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:56.945038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a3d7-08e2-436d-a277-1d6730e14cce None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:56.945497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a3d7-08e2-436d-a277-1d6730e14cce None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:56.945619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3a3d7-08e2-436d-a277-1d6730e14cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:56.964814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52629a4e1ca2403098b9fd8e5e8821e7', 'request_id': 'req-bd42659b-c870-4220-a6e8-13aad200e920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:56.968099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:56.976643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52629a4e1ca2403098b9fd8e5e8821e7', 'request_id': 'req-bd42659b-c870-4220-a6e8-13aad200e920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:56.980157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bed3a3d7-08e2-436d-a277-1d6730e14cce None None] MFA Rules not processed for user `ac8ef83fa94e4c9db70a0115cc867dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:56.984626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bed3a3d7-08e2-436d-a277-1d6730e14cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:56.990229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52629a4e1ca2403098b9fd8e5e8821e7', 'request_id': 'req-bd42659b-c870-4220-a6e8-13aad200e920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.019753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] The token cache is being invalidate because project 52629a4e1ca2403098b9fd8e5e8821e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:57.019979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.022304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.024430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1290/2613] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:56 2022] DELETE /identity/v3/projects/52629a4e1ca2403098b9fd8e5e8821e7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:57.025234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.029753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.113173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1324/2614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:54:57.114943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096cfd-99d2-4b92-8eb5-e07bd250f108 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.115344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096cfd-99d2-4b92-8eb5-e07bd250f108 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.115743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096cfd-99d2-4b92-8eb5-e07bd250f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.140492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fb096cfd-99d2-4b92-8eb5-e07bd250f108 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:57.142210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fb096cfd-99d2-4b92-8eb5-e07bd250f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.153461 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1325/2615] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:57.163026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.163313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.163636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.183862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42659b-c870-4220-a6e8-13aad200e920 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.190298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.191361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.191699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.191980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] PATH_INFO: `/v3/users/859de04797504bcbb5134dba5c8183a5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.193798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859de04797504bcbb5134dba5c8183a5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.196069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.196781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:57.198017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.208304 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1326/2616] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:57.212525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.222816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e0c7-f018-454b-9ea8-3a065a50db8b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.227713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.228392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.228743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.228953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.229811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:54:57.230125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.232108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.251912 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1327/2617] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:54:57.255036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.268601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397d32d-000d-45bc-8658-83e66784d1a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.275225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.276211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.276519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.276973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.277686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.280079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.284262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859de04797504bcbb5134dba5c8183a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.285464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859de04797504bcbb5134dba5c8183a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.295935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859de04797504bcbb5134dba5c8183a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.297315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859de04797504bcbb5134dba5c8183a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.325574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-945e2f7b-c3f9-46b2-87ca-9917a930f280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859de04797504bcbb5134dba5c8183a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:57.330311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1328/2618] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:57.331944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.334082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.348536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:57.377548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1291/2619] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:57 2022] DELETE /identity/v3/users/859de04797504bcbb5134dba5c8183a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:57.379133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.379423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.379728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.418506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:57.420348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.482307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782328de-26bb-490d-a2cf-788092b95495 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.550941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:57.573204 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1292/2620] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:57.586904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.589940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.594133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.594897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.595924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.596279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.597058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.599310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.630803 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1329/2621] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/users => generated 292 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:54:57.634930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.659368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bf94-d321-4689-8c2e-eeb5768e5a60 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.674248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.675592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.675592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.675592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.676624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.678623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.686019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a618b9-e9fc-456b-ab4e-bbd9a2c07cef None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.693310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.694133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.694291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.694519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.704804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1330/2622] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:57.707838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.712059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.714002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.728187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccac116-932a-441e-abc1-ebcacf020c7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.733256 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1293/2623] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:57.748431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.749422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.749803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.750189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.751042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.753912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158b21c-b0e9-402d-812d-b4e3f62320bd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.799946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:57.804950 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1331/2624] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:54:57.812657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa197c9-559e-48e2-8a63-4e737b3b4c7c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:57.828840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:57.829772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.830058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.830331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] PATH_INFO: `/v3/projects/a23b90f117684cff9d0ffccf630d8307/users/71d29871def3409f89efcda0e82a4ad3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.859634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23b90f117684cff9d0ffccf630d8307, user_id=71d29871def3409f89efcda0e82a4ad3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:57.862508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:57.894023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1294/2625] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:54:57 2022] PUT /identity/v3/projects/a23b90f117684cff9d0ffccf630d8307/users/71d29871def3409f89efcda0e82a4ad3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:57.899328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:57.899735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:57.900403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:57.918624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:57.920031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:57.993901 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1332/2626] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:54:58.013471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:58.016019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:58.122682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:58.125002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:58.152099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122af8d-d8c8-4823-a3fa-b35567a42da3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:58.176113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959108d-e23f-4f84-aaf8-234c986ef2ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:58.176390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:58.177180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:58.177480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:58.177748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] PATH_INFO: `/v3/projects/55d1f67de5f9427bae166a10a5edff26` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:58.187106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d1f67de5f9427bae166a10a5edff26)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:58.188148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:58.189014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:58.189153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:58.189671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:58.190112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:58.231393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:58.233964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:58.257180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1295/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:58.276538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:58.403661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d1f67de5f9427bae166a10a5edff26', 'request_id': 'req-e5a829fc-74d4-42f1-a236-bf167309aeb7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.428013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d1f67de5f9427bae166a10a5edff26', 'request_id': 'req-e5a829fc-74d4-42f1-a236-bf167309aeb7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.453510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d1f67de5f9427bae166a10a5edff26', 'request_id': 'req-e5a829fc-74d4-42f1-a236-bf167309aeb7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.500650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] The token cache is being invalidate because project 55d1f67de5f9427bae166a10a5edff26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:58.500777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.504404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.513639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1333/2628] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:58 2022] DELETE /identity/v3/projects/55d1f67de5f9427bae166a10a5edff26 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:58.518498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:58.531485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899677-cb73-42f3-a1f6-51789ab3b6a1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:58.640064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:58.641216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:58.641542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:58.641882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] PATH_INFO: `/v3/users/09b153e10d99483cbd0a5d0cba215739` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:58.643272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b153e10d99483cbd0a5d0cba215739)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:58.646125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:58.689795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:58.766595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b153e10d99483cbd0a5d0cba215739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.771161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b153e10d99483cbd0a5d0cba215739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.790609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b153e10d99483cbd0a5d0cba215739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.790929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b153e10d99483cbd0a5d0cba215739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.818554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1fef17bd-98f2-4a9c-bfba-77151689de86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b153e10d99483cbd0a5d0cba215739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:58.855341 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1296/2629] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:54:58 2022] DELETE /identity/v3/users/09b153e10d99483cbd0a5d0cba215739 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:59.622495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:54:59.624141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:54:59.645831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a829fc-74d4-42f1-a236-bf167309aeb7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:54:59.780466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:54:59.781478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:59.781814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:59.782336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] PATH_INFO: `/v3/projects/00850f9935c54861ac162b84570e1213` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:59.784030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00850f9935c54861ac162b84570e1213)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:54:59.788133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:54:59.879051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00850f9935c54861ac162b84570e1213', 'request_id': 'req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:59.887398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00850f9935c54861ac162b84570e1213', 'request_id': 'req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:59.898108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00850f9935c54861ac162b84570e1213', 'request_id': 'req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:59.918012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] The token cache is being invalidate because project 00850f9935c54861ac162b84570e1213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:54:59.918473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:59.920995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1d0d971b-b85d-4376-9a07-ef7dd1f389f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:54:59.924579 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1334/2630] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:54:59 2022] DELETE /identity/v3/projects/00850f9935c54861ac162b84570e1213 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:54:59.931152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:54:59.931726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:54:59.933449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:54:59.957226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:54:59.963477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:00.042975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1297/2631] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:00.055608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.055896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.056178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.082758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:00.084094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:00.095745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1335/2632] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:00.100118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.115931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914c14d-f3da-4096-9582-1abd680c42ec None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.130827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.131815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.132202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.132592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.133470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:00.133924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.138635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.214928 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1298/2633] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:00.219541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.236691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3742b36-eadd-44d3-bd54-40a4e915bd7b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.262047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.264106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.265894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.267964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.269000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.272975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.352453 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1336/2634] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:00 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:00.356830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.375446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59536c-c87f-4f88-94d8-f975777dc947 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.518866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.520046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.520401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.520752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.521681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.524597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.578210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1299/2635] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:00 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:00.579863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.599638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585632d-2fc0-4cf4-8ce4-bdf3c6782e7e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.617205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.618105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.618491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.619015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.620201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.626098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.628082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:00.653225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1337/2636] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:00.659596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.676775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849427d-7082-4a95-9531-8b2c6af1af3d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.692999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.694083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.694502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.694922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.696201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.698033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b1b3-a1ae-48e7-9bf7-098edfaf281f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.717529 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1300/2637] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:00.721647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:00.739160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a6b25-d885-4620-9731-0b092aeb085f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:00.754812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:00.756524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.756996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.757564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9/users/93b40b6501c74eb4b6d873d61ca3c9d8/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.779374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a9cb105a3e4e85808453fb1b3fafe9, user_id=93b40b6501c74eb4b6d873d61ca3c9d8, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:00.783834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:00.811725 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1338/2638] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:00 2022] PUT /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9/users/93b40b6501c74eb4b6d873d61ca3c9d8/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:00.822615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:00.823185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:00.823811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:00.872484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:00.906813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] MFA Rules not processed for user `93b40b6501c74eb4b6d873d61ca3c9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:00.908223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:01.122491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1301/2639] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:55:01.124640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:01.275626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c5b61-9517-41a0-bc34-d6fe39271806 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:01.293061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:01.296823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:01.298181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:01.300513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:01.305524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:01.309248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:01.379326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:01.380297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1339/2640] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:01 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:01.400088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8c670-9b8d-45ae-a0ad-f24b474a9475 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:01.516468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:01.517207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:01.517499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:01.517785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:01.518502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:01.538727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:01.636939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:01.647407 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1302/2641] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:01 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:55:01.658120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fe972-a477-487c-b824-473bac2e41b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:01.674845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:01.677658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:01.679808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:01.680352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:01.681341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:01.686533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:01.729818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:01.737450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1340/2642] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:01.746824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415224-85c8-43fc-b82c-6f86cb745d5c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:01.764379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:01.765956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:01.766623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:01.767124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] PATH_INFO: `/v3/projects/f48aac5f282e4b47a8b06f1a780561fa/users/a624d48fcd1b43078ab1abdf3d1e972f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:01.834230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48aac5f282e4b47a8b06f1a780561fa, user_id=a624d48fcd1b43078ab1abdf3d1e972f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:01.837095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:01.900319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1303/2643] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:01 2022] PUT /identity/v3/projects/f48aac5f282e4b47a8b06f1a780561fa/users/a624d48fcd1b43078ab1abdf3d1e972f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:01.901971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:01.921225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d059f-01ca-41ae-9ab4-fd70e367cb11 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:02.214430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:02.215582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:02.215834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:02.216117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:02.227097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:02.233093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b753f-284e-49e6-8e9a-b3a6f4180557 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:02.311601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1341/2644] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:02.312476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:02.328355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6f22-028d-4815-8fdb-6bd0a578584f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:02.350503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:02.351432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:02.365686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:02.366028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] PATH_INFO: `/v3/projects/f48aac5f282e4b47a8b06f1a780561fa/users/a624d48fcd1b43078ab1abdf3d1e972f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:02.381857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48aac5f282e4b47a8b06f1a780561fa, user_id=a624d48fcd1b43078ab1abdf3d1e972f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:02.394971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:02.450175 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1304/2645] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:02 2022] PUT /identity/v3/projects/f48aac5f282e4b47a8b06f1a780561fa/users/a624d48fcd1b43078ab1abdf3d1e972f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:55:02.460738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:02.460934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:02.461795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:02.550615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] MFA Rules not processed for user `a624d48fcd1b43078ab1abdf3d1e972f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:02.558240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:02.684021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:02.783169 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1342/2646] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:02.788521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:02.802603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf6eff-b0ab-418f-95a1-50f7d23c7259 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:02.818355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:02.819050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:02.819332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:02.819637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:02.820379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:02.820687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:02.822303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:02.854491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1305/2647] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:02.859292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:02.871365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f242-53f4-4085-9494-f44ac6b8824f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:02.879941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:02.884396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:02.884396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:02.884597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:02.885403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:02.889543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:02.951737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1343/2648] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:02 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:02.952852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:02.992238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca22b68-3650-4e26-84d2-5cb51e8d17ca tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:03.098089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:03.166821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:03.167540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:03.167824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:03.168644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:03.168833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:03.169142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:03.170824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cbe22-873a-4c0a-947e-f0e320e5c26b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:03.220555 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1306/2649] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:03.230956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:03.235112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:03.450026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e99e9-938a-4752-9fe4-31f6d981301f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:03.465788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:03.466546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:03.467918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:03.468215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:03.486645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:03.490764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:03.507002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1344/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:03.531467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee948d-61eb-4af9-bfd6-bf920968034e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:03.532013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee948d-61eb-4af9-bfd6-bf920968034e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:03.532308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee948d-61eb-4af9-bfd6-bf920968034e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:03.534077 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1307/2651] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:03.544194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:03.566080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:03.585491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ff00-c600-4dba-b49a-e52bb82e8eeb service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:03.612972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:03.615813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:03.620700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:03.621134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:03.625196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=894bd8a0cf73482db6cdae64dfd34cfd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:03.628316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:03.634529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1345/2652] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:03 2022] GET /identity/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd => generated 371 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:04.001133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd863-b2c4-4c23-b8f7-8f518d8966cd None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.001688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd863-b2c4-4c23-b8f7-8f518d8966cd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.002145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd863-b2c4-4c23-b8f7-8f518d8966cd None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.004043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1308/2653] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:04.009434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:04.012020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:04.030290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:04.041808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed027a-06b9-491a-940e-385da7dfa8bb tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:04.050535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:04.051918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.052375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.052808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.054207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=894bd8a0cf73482db6cdae64dfd34cfd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:04.057613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:04.073910 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1346/2654] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:04 2022] GET /identity/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:04.274815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d04ee-ccb9-4a0f-bf04-ec37392041f2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.275409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d04ee-ccb9-4a0f-bf04-ec37392041f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.275875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d04ee-ccb9-4a0f-bf04-ec37392041f2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.277610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1309/2655] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:04.283093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:04.305174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:04.332756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6602-928f-41b0-a3e8-0468e99ec63f tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:04.343952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:04.345013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.345397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.345775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.351774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=894bd8a0cf73482db6cdae64dfd34cfd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:04.354039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c31ba5-9270-4903-a8ed-e5622e36b543 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:04.375399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1347/2656] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:04 2022] GET /identity/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd => generated 371 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:04.402564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d04ee-ccb9-4a0f-bf04-ec37392041f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:04.434910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d04ee-ccb9-4a0f-bf04-ec37392041f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:04.453377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:04.454550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.455037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.455790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.457638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=894bd8a0cf73482db6cdae64dfd34cfd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:04.460190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:04.580036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894bd8a0cf73482db6cdae64dfd34cfd', 'request_id': 'req-ece46eac-a9df-4880-8b5b-f2d58beebf2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:04.589774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894bd8a0cf73482db6cdae64dfd34cfd', 'request_id': 'req-ece46eac-a9df-4880-8b5b-f2d58beebf2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:04.601550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894bd8a0cf73482db6cdae64dfd34cfd', 'request_id': 'req-ece46eac-a9df-4880-8b5b-f2d58beebf2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:04.638067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] The token cache is being invalidate because project 894bd8a0cf73482db6cdae64dfd34cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:04.640032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:04.640792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:04.647998 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1310/2657] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:04 2022] DELETE /identity/v3/projects/894bd8a0cf73482db6cdae64dfd34cfd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:04.662388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b457f-8056-4ec3-b349-e2bcafcb6651 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:04.662785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b457f-8056-4ec3-b349-e2bcafcb6651 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:04.663171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b457f-8056-4ec3-b349-e2bcafcb6651 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:04.664888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1348/2658] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:04.682666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:04.684817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:04.899630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:04.900936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:04.981060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:05.026375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46eac-a9df-4880-8b5b-f2d58beebf2c tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:05.035874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:05.037683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:05.038128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:05.039483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:05.040997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=26a9cb105a3e4e85808453fb1b3fafe9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:05.057311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:05.064014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1311/2659] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:04 2022] GET /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9 => generated 375 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:05.085845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b457f-8056-4ec3-b349-e2bcafcb6651 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:05.109606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b457f-8056-4ec3-b349-e2bcafcb6651 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:05.130992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:05.132052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:05.132558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:05.133028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:05.133991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:05.134540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:05.136472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:05.191295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1349/2660] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:05.197235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:05.221037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b07d7-c600-464e-9a3b-acca67044f76 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:05.241128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:05.242223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:05.242800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:05.243250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:05.244452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:05.253632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43884a5-3937-4b53-815a-cf15ca92ea33 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:05.356182 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1312/2661] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:05 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:05.358194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:05.458586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02a2c0-8d38-4086-bbff-9445733f4cce tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:05.683719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:05.730556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:05.731268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:05.731575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:05.731868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:05.732984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:05.733110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:05.734698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:05.795596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1350/2662] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:06.203787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f163-5bb8-4aaa-a281-52fedfa36148 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.204380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f163-5bb8-4aaa-a281-52fedfa36148 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.204380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f163-5bb8-4aaa-a281-52fedfa36148 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.206180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1313/2663] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:06.214658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:06.446158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:06.477790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ca7b-b315-4d40-93a7-36114212a5ae tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:06.496242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:06.497267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.498231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.504849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/68d2272d91c64140a7a56db928dd0d7a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.506503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=68d2272d91c64140a7a56db928dd0d7a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:06.508955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:06.521061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1351/2664] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:06 2022] GET /identity/v3/projects/68d2272d91c64140a7a56db928dd0d7a => generated 369 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:06.633712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cd79f-57ec-4d1a-baa2-2a50b4ab9a37 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.635371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cd79f-57ec-4d1a-baa2-2a50b4ab9a37 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.637242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cd79f-57ec-4d1a-baa2-2a50b4ab9a37 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.639415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1314/2665] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:06.645431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:06.676986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:06.700067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f3f5-f487-41db-ad0a-82fad68cc7f6 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:06.709007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:06.710498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.711301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.711821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/68d2272d91c64140a7a56db928dd0d7a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.713642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=68d2272d91c64140a7a56db928dd0d7a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:06.718064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:06.721802 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1352/2666] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:06 2022] GET /identity/v3/projects/68d2272d91c64140a7a56db928dd0d7a => generated 369 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:06.784870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cd79f-57ec-4d1a-baa2-2a50b4ab9a37 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:06.807627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cd79f-57ec-4d1a-baa2-2a50b4ab9a37 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:06.817571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:06.819585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.820089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.820596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.822377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:06.823071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:06.825702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:06.848909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:06.859299 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1315/2667] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:06.875939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176c106-7ca8-45cd-98de-4b81e24cf4cd tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:06.890082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:06.891229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.891758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.892236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.893262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:06.896514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51d489-edcd-4e0d-b802-c646c709d2e5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:06.952928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:06.965973 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1353/2668] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:06 2022] POST /identity/v3/users => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:06.967796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde81d-3793-45cb-8f54-879daf748091 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:06.975126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:06.976137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:06.976137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:06.976800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:06.977726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:06.978479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:06.989436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:07.044119 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1316/2669] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:07.047598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3959f-7d88-4af5-b258-e124e7ffb299 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.047905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3959f-7d88-4af5-b258-e124e7ffb299 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.048199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3959f-7d88-4af5-b258-e124e7ffb299 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.049618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1354/2670] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:55:07.063932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:07.085619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:07.096646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea4162-889f-487b-8e69-25d5e837132b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:07.108289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:07.110617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.111453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.112193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/68d2272d91c64140a7a56db928dd0d7a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.116463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=68d2272d91c64140a7a56db928dd0d7a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:07.118896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbdb61-b120-4ed8-b277-3d582cd888d9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:07.121431 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1317/2671] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:07 2022] GET /identity/v3/projects/68d2272d91c64140a7a56db928dd0d7a => generated 369 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:07.412014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.412575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.413051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.414902 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1355/2672] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:07.417084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f38c-2126-4195-b5c4-69d065af0168 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.417568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f38c-2126-4195-b5c4-69d065af0168 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.418228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7f38c-2126-4195-b5c4-69d065af0168 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.420125 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1318/2673] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:07.427202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:07.429714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:07.463959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:07.477533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a08a3a-62e0-4844-b4ac-369d03ecab1b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:07.491031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:07.491962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.492250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.492533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/68d2272d91c64140a7a56db928dd0d7a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.497760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=68d2272d91c64140a7a56db928dd0d7a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:07.500336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:07.502432 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1356/2674] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:07 2022] GET /identity/v3/projects/68d2272d91c64140a7a56db928dd0d7a => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:07.524415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.525025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.525486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.561718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:07.563051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:07.567895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:07.586271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82858cf-0410-4e57-a699-bf1647fd5673 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:07.600202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:07.603559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:07.604558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:07.606057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/users/730cbc268edc49cdbc30059cb27f3dc8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:07.650854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=730cbc268edc49cdbc30059cb27f3dc8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:07.655244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:07.726535 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1319/2675] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:07.727639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:07.729773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:07.783155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730cbc268edc49cdbc30059cb27f3dc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:07.802730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730cbc268edc49cdbc30059cb27f3dc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:07.803387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730cbc268edc49cdbc30059cb27f3dc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:07.804727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730cbc268edc49cdbc30059cb27f3dc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:07.853970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730cbc268edc49cdbc30059cb27f3dc8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:07.878114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:07.901718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1357/2676] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:55:07 2022] DELETE /identity/v3/users/730cbc268edc49cdbc30059cb27f3dc8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:55:07.922891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:07.933969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:08.026331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb646e-aff0-4c2d-870a-f51532888e6a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:08.115664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:08.168730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef931d-509e-43dc-8032-b9436bcd5649 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:08.182174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:08.184005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:08.184294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:08.184573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:08.186141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:08.187373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:08.188213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:08.188516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] PATH_INFO: `/v3/users/24b464a991224d9c80b8fd9f07afcf16` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:08.190001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b464a991224d9c80b8fd9f07afcf16)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:08.192831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:08.197670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:08.222719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:08.224864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ec51-55e3-476c-bebc-01137faaa068 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:08.254150 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1358/2677] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:08.259969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:08.260543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:08.262008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:08.307906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:08.310987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:08.414665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b464a991224d9c80b8fd9f07afcf16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:08.415680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b464a991224d9c80b8fd9f07afcf16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:08.424642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b464a991224d9c80b8fd9f07afcf16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:08.425347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1359/2678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:08.426590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b464a991224d9c80b8fd9f07afcf16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:08.428368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:08.430867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:08.465398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b464a991224d9c80b8fd9f07afcf16'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:08.491639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1320/2679] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:55:07 2022] DELETE /identity/v3/users/24b464a991224d9c80b8fd9f07afcf16 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:08.653416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f84a4b-7f63-419d-8ce3-6a00574d82c6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:08.796547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:08.835864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:08.837092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:08.837414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:08.838344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/68d2272d91c64140a7a56db928dd0d7a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:08.842166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68d2272d91c64140a7a56db928dd0d7a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:08.847345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:08.884166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:08.886033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:08.991243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d2272d91c64140a7a56db928dd0d7a', 'request_id': 'req-cfc8eb77-b09b-4af0-9314-4f2493310518'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.022197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d2272d91c64140a7a56db928dd0d7a', 'request_id': 'req-cfc8eb77-b09b-4af0-9314-4f2493310518'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.063493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d2272d91c64140a7a56db928dd0d7a', 'request_id': 'req-cfc8eb77-b09b-4af0-9314-4f2493310518'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.070921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6f620-68bd-4566-98e9-52cd6be640a4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:09.092471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] The token cache is being invalidate because project 68d2272d91c64140a7a56db928dd0d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:09.093369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.094123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.102791 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1360/2680] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:08 2022] DELETE /identity/v3/projects/68d2272d91c64140a7a56db928dd0d7a => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:09.268180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:09.288418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:09.289431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:09.289784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:09.295924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:09.299090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:09.334207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:09.336771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17820d4-5b6e-414d-84f4-9f32383ef056 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:09.366060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1321/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:55:09.608670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:09.610306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:09.667070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:09.667587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:09.667676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:09.669274 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1322/2682] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:09.681230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:09.683358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:09.760270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8eb77-b09b-4af0-9314-4f2493310518 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:09.777371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:09.778539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:09.778883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:09.779155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] PATH_INFO: `/v3/projects/c30f7e8904fe4a91a6f20bf28cd1e492` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:09.780432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30f7e8904fe4a91a6f20bf28cd1e492)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:09.782391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:09.881859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30f7e8904fe4a91a6f20bf28cd1e492', 'request_id': 'req-3e247b79-1017-4239-8645-c38db015305d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.891780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30f7e8904fe4a91a6f20bf28cd1e492', 'request_id': 'req-3e247b79-1017-4239-8645-c38db015305d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.908301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:09.908539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30f7e8904fe4a91a6f20bf28cd1e492', 'request_id': 'req-3e247b79-1017-4239-8645-c38db015305d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.916416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:09.932134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] The token cache is being invalidate because project c30f7e8904fe4a91a6f20bf28cd1e492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:09.932668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.935150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e247b79-1017-4239-8645-c38db015305d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:09.943825 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1361/2683] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:09 2022] DELETE /identity/v3/projects/c30f7e8904fe4a91a6f20bf28cd1e492 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:09.948089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2906a-d2d2-4325-a465-cdd40a3763d9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:09.948531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2906a-d2d2-4325-a465-cdd40a3763d9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:09.949413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2906a-d2d2-4325-a465-cdd40a3763d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:09.968202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:10.026344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-80b2906a-d2d2-4325-a465-cdd40a3763d9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:10.032462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80b2906a-d2d2-4325-a465-cdd40a3763d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:10.159644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9e52b-fc5a-4560-aefc-971f4304930e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.220458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1362/2684] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:10.231821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af214-550e-46e1-a182-971d1b792462 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.232786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af214-550e-46e1-a182-971d1b792462 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.233075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af214-550e-46e1-a182-971d1b792462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.273120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e97af214-550e-46e1-a182-971d1b792462 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:10.276692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e97af214-550e-46e1-a182-971d1b792462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:10.322076 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1363/2685] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:10.356407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97af214-550e-46e1-a182-971d1b792462 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.356691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.357830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.358139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.358411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.360107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=26a9cb105a3e4e85808453fb1b3fafe9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.363814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24409-0f1d-4c67-b743-39a770cfd558 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.369940 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1323/2686] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:09 2022] GET /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9 => generated 375 bytes in 689 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:55:10.385668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97af214-550e-46e1-a182-971d1b792462 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.391982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.394888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.394888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.394888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.395092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:10.395327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.397436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.413085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437a6df-9c03-45a6-9cf8-b30657f7c0de None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.413467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437a6df-9c03-45a6-9cf8-b30657f7c0de None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.413751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437a6df-9c03-45a6-9cf8-b30657f7c0de None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.415189 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1324/2687] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:10.421503 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1364/2688] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:55:10.425518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437a6df-9c03-45a6-9cf8-b30657f7c0de None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.431092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:10.438910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:10.457745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437a6df-9c03-45a6-9cf8-b30657f7c0de None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.535465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.537673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.539392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.540747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.551869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.561863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.616547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.621722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:10.635040 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1325/2689] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:10 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:55:10.639526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.656402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e05f0e-abf0-43fa-bdd3-00698ae2e400 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.662619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:10.786767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7d44c-7b23-492a-a5c0-5191974e11e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.792020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.792830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.793184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.793533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.794314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.798272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.844912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1326/2690] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:10 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:10.847890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.848800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.849089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.849459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.850659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.854802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=26a9cb105a3e4e85808453fb1b3fafe9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.858509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.864404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1365/2691] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:10 2022] GET /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9 => generated 375 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:10.869868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d39cb-ce21-49e0-8169-52458fcf6e9c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.886521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.886946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.887344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.887817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.888964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.891033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.906693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1327/2692] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:55:10.908709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:10.924823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b037c15-a828-480c-98fb-d299294e390d tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:10.944636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:10.945443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:10.945797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:10.946135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:10.946941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:10.948670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289ddd2-811e-45c3-9c39-734863d1942e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:10.983649 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1366/2693] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:10.987960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.003566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c0dd3-ac16-453b-965a-5d4b0d1d04ba admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:11.029984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:11.031056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.031552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.031895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] PATH_INFO: `/v3/projects/84c448aaa2a549c8a333b029ea89b104/users/598884c9d0964ad6992f79eaf770507d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.088610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c448aaa2a549c8a333b029ea89b104, user_id=598884c9d0964ad6992f79eaf770507d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:11.095939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:11.139014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1328/2694] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:10 2022] PUT /identity/v3/projects/84c448aaa2a549c8a333b029ea89b104/users/598884c9d0964ad6992f79eaf770507d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:11.140431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.140924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.141405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.177992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:11.183833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.201692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:11.210810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.213965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.304608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1367/2695] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:11.321086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.327484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.466940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0f4b-f96c-4f5a-8691-49470eb86dee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:11.481457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:11.482161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.482503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.482788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.484783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.486127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37199b-b09d-40b9-a004-16447cf365ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:11.500076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:11.501080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.501538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.502081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.531113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:11.533224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91100d-083b-4a8e-b25b-bf16257ef294 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:11.546640 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1368/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:11.548554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.549002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.549544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.570614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:11.572582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5d40-3cc6-4a4b-8e91-10fbbc33c34d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:11.580465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:11.604593 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1329/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:11.605873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.606163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.609013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.612232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1330/2698] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:55:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:11.617720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 20:55:11.619828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] MFA Rules not processed for user `71d29871def3409f89efcda0e82a4ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:11.621097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.653162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.785786 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1369/2699] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:11.792122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.795793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:11.827136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543323dd-5e61-4556-bd2d-b45849ebd5a7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:11.852234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:11.853096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.853235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.862383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.873904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389716-a404-4a1b-9564-dac3973a9acc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:11.874398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:11.877511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:11.892460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a624d48fcd1b43078ab1abdf3d1e972f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f48aac5f282e4b47a8b06f1a780561fa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:11.893370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:11.893652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:11.893931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:11.900407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorizing `identity:get_project(project_id=26a9cb105a3e4e85808453fb1b3fafe9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:11.906127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:11.913897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1331/2700] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 20:55:11 2022] GET /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9 => generated 375 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:11.944315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1370/2701] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:11 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:11.948322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:11.989583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b198d-df9c-42b0-a894-5c41f2ab13f8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.119016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.126327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.126934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.127441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.128562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.133359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:12.177614 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1332/2702] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:11 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:12.179644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:12.254473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604006d-0add-4ea3-a35e-cf3434ffcb75 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.266138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.269802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.269802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.272303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.273017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.277452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:12.328355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1371/2703] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:12.330734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:12.347017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9c144-28d1-43b6-a061-2d5d45f05a4f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.359991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.361547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.362472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.363218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] PATH_INFO: `/v3/projects/7df2a8ee35b644258b36388d425322ab/users/858dec3e74964fd290e3bc622cd0dab2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.389739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df2a8ee35b644258b36388d425322ab, user_id=858dec3e74964fd290e3bc622cd0dab2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.394028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:12.430727 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1333/2704] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:12 2022] PUT /identity/v3/projects/7df2a8ee35b644258b36388d425322ab/users/858dec3e74964fd290e3bc622cd0dab2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:12.435990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:12.461510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f45f85-7fdf-4afe-b41f-0b07c0e878c0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.476976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:12.595564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.596676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.597070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.597439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.598437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.601521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:12.614728 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1372/2705] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:12.619127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:12.634935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68b4b-798c-4d65-b8e0-9509b4933c71 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.643354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.645180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.645477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.645750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] PATH_INFO: `/v3/projects/7df2a8ee35b644258b36388d425322ab/users/858dec3e74964fd290e3bc622cd0dab2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.648217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df2a8ee35b644258b36388d425322ab, user_id=858dec3e74964fd290e3bc622cd0dab2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.656662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa41c3-0dd6-4ecb-8398-f302d68e8afa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:12.679319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1334/2706] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:12 2022] PUT /identity/v3/projects/7df2a8ee35b644258b36388d425322ab/users/858dec3e74964fd290e3bc622cd0dab2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:12.725877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:12.733626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:12.766620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04087aba-4f05-4568-9b04-136537c50457 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:12.929337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:12.930593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:12.931030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:12.931451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] PATH_INFO: `/v3/users/93b40b6501c74eb4b6d873d61ca3c9d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:12.938732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b40b6501c74eb4b6d873d61ca3c9d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:12.940877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:13.051712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b40b6501c74eb4b6d873d61ca3c9d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:13.074062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b40b6501c74eb4b6d873d61ca3c9d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:13.075647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b40b6501c74eb4b6d873d61ca3c9d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:13.078390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b40b6501c74eb4b6d873d61ca3c9d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:13.112289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b40b6501c74eb4b6d873d61ca3c9d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:13.146172 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1373/2707] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:55:12 2022] DELETE /identity/v3/users/93b40b6501c74eb4b6d873d61ca3c9d8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:13.153268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138570f-4425-4abb-8cd9-e9b11b58d96c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:13.154370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138570f-4425-4abb-8cd9-e9b11b58d96c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:13.154370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138570f-4425-4abb-8cd9-e9b11b58d96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:13.187890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b138570f-4425-4abb-8cd9-e9b11b58d96c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:13.191109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b138570f-4425-4abb-8cd9-e9b11b58d96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:13.323790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:13.367841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1335/2708] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:55:13.395097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:13.398259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:13.446201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:13.492940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94dcca-4c4a-4d0a-bdea-9c3ffbe26dab admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:13.498706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:13.499777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:13.500208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:13.500661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:13.515249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:13.517725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb322a8-a9bf-4b3b-ae70-b069f3cb5ad7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:13.534114 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1374/2709] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:13.586717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:13.587006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:13.587309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:13.642726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] MFA Rules not processed for user `598884c9d0964ad6992f79eaf770507d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:13.644378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:13.772205 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1336/2710] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:13.788503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:13.789106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:13.789106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:13.816775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] MFA Rules not processed for user `598884c9d0964ad6992f79eaf770507d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:13.818023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:13.827170 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1375/2711] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:13.972798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:13.974479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:14.100585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c6dbb-96bd-4f87-a333-796aa459f792 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:14.106776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:14.107919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:14.108501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:14.108883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:14.120303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:14.122526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:14.138178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1337/2712] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:14.746495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:14.748314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:14.775443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b65c-a908-4b36-a53c-2cd965be92e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:14.789002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:14.790724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:14.791328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:14.791826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] PATH_INFO: `/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:14.796261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a9cb105a3e4e85808453fb1b3fafe9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:14.798651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:14.987330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a9cb105a3e4e85808453fb1b3fafe9', 'request_id': 'req-119310ef-84cf-46a1-8a8f-47b579b9695a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.017618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a9cb105a3e4e85808453fb1b3fafe9', 'request_id': 'req-119310ef-84cf-46a1-8a8f-47b579b9695a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.043550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a9cb105a3e4e85808453fb1b3fafe9', 'request_id': 'req-119310ef-84cf-46a1-8a8f-47b579b9695a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.082440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] The token cache is being invalidate because project 26a9cb105a3e4e85808453fb1b3fafe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:15.082775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.090944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-119310ef-84cf-46a1-8a8f-47b579b9695a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.100709 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1376/2713] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:14 2022] DELETE /identity/v3/projects/26a9cb105a3e4e85808453fb1b3fafe9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:15.105122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:15.136888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9a588-27be-4049-9087-75b3335beb57 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:15.335741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:15.336665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:15.336952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:15.337235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] PATH_INFO: `/v3/users/a624d48fcd1b43078ab1abdf3d1e972f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:15.339471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a624d48fcd1b43078ab1abdf3d1e972f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:15.341755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:15.366566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:15.454970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a624d48fcd1b43078ab1abdf3d1e972f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.455982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a624d48fcd1b43078ab1abdf3d1e972f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.474635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a624d48fcd1b43078ab1abdf3d1e972f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.476345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a624d48fcd1b43078ab1abdf3d1e972f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.511218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a624d48fcd1b43078ab1abdf3d1e972f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:15.547754 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1338/2714] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:55:15 2022] DELETE /identity/v3/users/a624d48fcd1b43078ab1abdf3d1e972f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:55:18.047812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b937f8-0a6a-4570-a829-4a1edcd261da None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.048394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b937f8-0a6a-4570-a829-4a1edcd261da None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.048695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b937f8-0a6a-4570-a829-4a1edcd261da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.082878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d8b937f8-0a6a-4570-a829-4a1edcd261da None None] MFA Rules not processed for user `39e45a1e351c47bc8d9c9f317a7d915e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:18.086949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d8b937f8-0a6a-4570-a829-4a1edcd261da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:18.094804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:18.096275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:18.317933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bd34-fcbc-4600-a6db-8270511d63eb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:18.322888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1377/2715] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:18.328294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:18.330797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.331652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.332223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] PATH_INFO: `/v3/projects/f48aac5f282e4b47a8b06f1a780561fa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.341484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48aac5f282e4b47a8b06f1a780561fa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:18.344232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:18.474083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48aac5f282e4b47a8b06f1a780561fa', 'request_id': 'req-60bdb232-c511-4cc0-b141-39db45691aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:18.494262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48aac5f282e4b47a8b06f1a780561fa', 'request_id': 'req-60bdb232-c511-4cc0-b141-39db45691aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:18.528497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48aac5f282e4b47a8b06f1a780561fa', 'request_id': 'req-60bdb232-c511-4cc0-b141-39db45691aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:18.557467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] The token cache is being invalidate because project f48aac5f282e4b47a8b06f1a780561fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:18.557467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:18.558072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60bdb232-c511-4cc0-b141-39db45691aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:18.560411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1339/2716] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:18 2022] DELETE /identity/v3/projects/f48aac5f282e4b47a8b06f1a780561fa => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:18.566390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.566678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.567380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.612898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:18.619433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:18.703078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:18.728098 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1378/2717] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:18.737614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.738912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.739148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.772818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:18.774150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:18.793318 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1340/2718] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:18.798436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:18.810950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d272df-e719-49a4-8992-eb19d75e35cf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:18.816293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:18.816973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.818259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.818563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.819325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:18.819665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:18.821529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:18.846673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1379/2719] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:18.848145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:18.862349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a1aba-f195-41e6-8326-6fbaa2732cbc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:18.879939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:18.881940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:18.883647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:18.884055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:18.888448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:18.890920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:18.912748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:18.952585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1341/2720] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:18 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:18.956794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:18.973645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7962b-3d6f-419b-adb9-bccba5aa8127 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:19.089735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:19.091121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.091666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.092304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.093098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:19.096514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:19.143233 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1380/2721] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:18 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:19.144958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:19.161881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016771fd-81aa-4917-a6e3-44d8dac48282 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:19.188964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:19.189809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.190216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.190590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.191441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:19.193529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:19.220221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1342/2722] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:19.224662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:19.256710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f3c9-3d64-41b9-954f-6c97a034a297 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:19.262221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:19.263307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.263668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.264010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.264883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:19.267502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a331f-20c6-4582-8202-079b66b8948d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:19.289387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1381/2723] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:19.292957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:19.324603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339414a-b1dc-4e0f-a8af-b0ec42a34b7a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:19.353109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:19.356579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.367403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.368260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] PATH_INFO: `/v3/projects/9fa1452a653049abab26a782a7d36583/users/246c32bb6dfc4692beeac1675dd13293/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.417775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa1452a653049abab26a782a7d36583, user_id=246c32bb6dfc4692beeac1675dd13293, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:19.423687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:19.464783 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1343/2724] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:19 2022] PUT /identity/v3/projects/9fa1452a653049abab26a782a7d36583/users/246c32bb6dfc4692beeac1675dd13293/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:55:19.468767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.469069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.469337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.529805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] MFA Rules not processed for user `246c32bb6dfc4692beeac1675dd13293`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:19.531990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:19.762002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1382/2725] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:19.768085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:19.907891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ffae-f19b-49e3-a2d4-4989b0e25fa9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:19.915201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:19.916485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:19.916994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:19.917448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:19.918328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:19.921233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:19.979175 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1344/2726] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:19 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:19.985017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:20.020372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f39b7-60ce-4b1a-8596-b395fc6327de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:20.115113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:20.162552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:20.163286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.163657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.164561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:20.165580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:20.169776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:20.207005 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1383/2727] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:19 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:20.211356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:20.224439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ac8dc-804b-42af-9525-c8a6e884469a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:20.230999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:20.231734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.232088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.232378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:20.233534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:20.235734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:20.253111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1345/2728] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:20.257810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:20.275261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc5425-8aef-48a1-a2ba-6a393d0a6900 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:20.288639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:20.295810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.296676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.297591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] PATH_INFO: `/v3/projects/348fba13f0894035849ca231b5ed317e/users/fd9a33040bf54d3b81c7d41c51e3b58e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:20.421475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=348fba13f0894035849ca231b5ed317e, user_id=fd9a33040bf54d3b81c7d41c51e3b58e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:20.428257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:20.488005 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1384/2729] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:20 2022] PUT /identity/v3/projects/348fba13f0894035849ca231b5ed317e/users/fd9a33040bf54d3b81c7d41c51e3b58e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:55:20.492930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:20.511442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c783cd-abd0-4f7d-84db-e12a51139ceb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:20.745797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:20.747991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.748502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.749154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:20.750738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:20.777740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ae6d-bf3a-4150-947c-31c768e86dcb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:20.835992 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1346/2730] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:20.842616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:20.862625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa93e2-6628-4062-bad4-76684185e13d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:20.876515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:20.877459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.877743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.878060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] PATH_INFO: `/v3/projects/348fba13f0894035849ca231b5ed317e/users/fd9a33040bf54d3b81c7d41c51e3b58e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:20.880344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=348fba13f0894035849ca231b5ed317e, user_id=fd9a33040bf54d3b81c7d41c51e3b58e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:20.886490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23eacb-bea9-4c8c-9819-23240e40e77e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:20.905021 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1385/2731] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:20 2022] PUT /identity/v3/projects/348fba13f0894035849ca231b5ed317e/users/fd9a33040bf54d3b81c7d41c51e3b58e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:20.926031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:20.926368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:20.926583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:21.001680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] MFA Rules not processed for user `fd9a33040bf54d3b81c7d41c51e3b58e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:21.010113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:21.042256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:21.211556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1347/2732] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:21.332906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df0b3-a05f-4316-b4dc-9d3af1f438c9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:21.334544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df0b3-a05f-4316-b4dc-9d3af1f438c9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:21.335395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df0b3-a05f-4316-b4dc-9d3af1f438c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:21.368485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-430df0b3-a05f-4316-b4dc-9d3af1f438c9 None None] MFA Rules not processed for user `246c32bb6dfc4692beeac1675dd13293`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:21.370590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-430df0b3-a05f-4316-b4dc-9d3af1f438c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:21.556027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1386/2733] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:22.475555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:22.477335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:22.699468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70636b-d968-4e22-bc1d-da92a6c456af None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:22.717622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:22.718542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:22.719914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:22.720507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:22.734555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:22.736586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce39a7-be9e-4763-81d5-e15f292524b7 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:22.765571 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1348/2734] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:24.294154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:24.295058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:24.295781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:24.367954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] MFA Rules not processed for user `246c32bb6dfc4692beeac1675dd13293`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:24.386283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:24.437549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1387/2735] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:24.853242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:24.853796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:24.857103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:24.897903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:24.901789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:25.005148 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1349/2736] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:25.018816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:25.022240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:25.124501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ac89-d2be-4f82-a633-5ee7e068d1ff None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:25.131224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:25.132170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:25.132445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:25.132716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:25.142658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:25.144318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a8af3-edbb-46a4-98bf-81d93ab40b0a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:25.156249 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1388/2737] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:25.505904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:25.507375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:25.627029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:25.724627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc24508-31b8-4dcf-9b2d-f93836a08db3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:25.745348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:25.746159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:25.746455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:25.746827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:25.757253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:25.800324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:25.802405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca007ed2-59a9-4805-8d35-72a97f0a08ac service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:25.828986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1350/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:28.741724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec19aa-fc36-459a-9322-ff80397b5a5d None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:28.743329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec19aa-fc36-459a-9322-ff80397b5a5d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:28.743995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec19aa-fc36-459a-9322-ff80397b5a5d None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:28.746471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1389/2739] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:55:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:55:28.753533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaad-4ba4-440e-b2cd-421dd49f947d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:28.754547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaad-4ba4-440e-b2cd-421dd49f947d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:28.754999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaad-4ba4-440e-b2cd-421dd49f947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:28.793556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9dbbfaad-4ba4-440e-b2cd-421dd49f947d None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:28.795026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dbbfaad-4ba4-440e-b2cd-421dd49f947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:28.815148 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1351/2740] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:28.849543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec19aa-fc36-459a-9322-ff80397b5a5d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:28.875125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec19aa-fc36-459a-9322-ff80397b5a5d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:28.891474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:28.892386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:28.892686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:28.892962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:28.923183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:28.924915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:28.943886 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1390/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:33.076321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeb23d-6180-4a23-96e1-d9d3feba374f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:33.077111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeb23d-6180-4a23-96e1-d9d3feba374f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:33.080350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeeb23d-6180-4a23-96e1-d9d3feba374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:33.128569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cbeeb23d-6180-4a23-96e1-d9d3feba374f None None] MFA Rules not processed for user `858dec3e74964fd290e3bc622cd0dab2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:33.132144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cbeeb23d-6180-4a23-96e1-d9d3feba374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:33.355871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1352/2742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:35.441099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:35.442720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:35.512569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79efc04-a6bc-4591-bfbf-ae6177b094a6 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:35.555239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:35.558161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:35.558828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:35.559000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:35.569465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:35.675978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:35.847211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:35.849344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51534073-4250-4511-82ef-dca5ed8082f8 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:35.864297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1391/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:41.221808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb7cb-5b02-47d3-ab77-da245d3f8c4a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:41.222725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb7cb-5b02-47d3-ab77-da245d3f8c4a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:41.223186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb7cb-5b02-47d3-ab77-da245d3f8c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:41.273922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-29fdb7cb-5b02-47d3-ab77-da245d3f8c4a None None] MFA Rules not processed for user `71d29871def3409f89efcda0e82a4ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:41.275327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-29fdb7cb-5b02-47d3-ab77-da245d3f8c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:41.296469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1353/2744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:42.201408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:42.201932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:42.203167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:42.237988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:42.250443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:42.345118 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1392/2745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:51.251132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=55 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:52.335962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=48 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:53.255761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:53.256328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:53.256328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:53.294503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] MFA Rules not processed for user `ac8ef83fa94e4c9db70a0115cc867dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:53.295792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:53.429766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1354/2746] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:54.390827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:54.392363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:54.515062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea23fc-d2fd-4725-bfb5-854f786eee15 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:54.523427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:54.525390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:54.526072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:54.526569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] PATH_INFO: `/v3/users/6b0c4b5dd6f0478e81580d12594528aa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:54.528543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0c4b5dd6f0478e81580d12594528aa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:54.532227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:54.609638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0c4b5dd6f0478e81580d12594528aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:54.632583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0c4b5dd6f0478e81580d12594528aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:54.633103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0c4b5dd6f0478e81580d12594528aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:54.635159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0c4b5dd6f0478e81580d12594528aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:54.652450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5efcf279-61b4-429d-be3f-485b9db322e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0c4b5dd6f0478e81580d12594528aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:54.674596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1393/2747] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:55:54 2022] DELETE /identity/v3/users/6b0c4b5dd6f0478e81580d12594528aa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:55.160700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:55.181576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b68d8-1bf8-44a8-b821-1db96b3fa383 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:55.329897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:55.330905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.331192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.331570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] PATH_INFO: `/v3/projects/f8585f618d5f4203af8209f5483e2eca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.332767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8585f618d5f4203af8209f5483e2eca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:55.335586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:55.448325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8585f618d5f4203af8209f5483e2eca', 'request_id': 'req-13c1d773-4025-454e-bffe-efc79804e9fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:55.460949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8585f618d5f4203af8209f5483e2eca', 'request_id': 'req-13c1d773-4025-454e-bffe-efc79804e9fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:55.472798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8585f618d5f4203af8209f5483e2eca', 'request_id': 'req-13c1d773-4025-454e-bffe-efc79804e9fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:55.512666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faaae8-a042-45d4-b2bc-ff6d3521d955 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.514675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faaae8-a042-45d4-b2bc-ff6d3521d955 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.514675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faaae8-a042-45d4-b2bc-ff6d3521d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.539041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] The token cache is being invalidate because project f8585f618d5f4203af8209f5483e2eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:55:55.539440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:55.542720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13c1d773-4025-454e-bffe-efc79804e9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:55:55.545724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-54faaae8-a042-45d4-b2bc-ff6d3521d955 None None] MFA Rules not processed for user `246c32bb6dfc4692beeac1675dd13293`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:55.547449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-54faaae8-a042-45d4-b2bc-ff6d3521d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:55.549090 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1355/2748] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:55:55 2022] DELETE /identity/v3/projects/f8585f618d5f4203af8209f5483e2eca => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:55.558052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.558848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.559672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.592945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:55.597508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:55.653992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:55.672066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1394/2749] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:55.698856 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1356/2750] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:55.795639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.795881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.796205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.848553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:55.850118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:55.877265 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1395/2751] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:55.878930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:55.895719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f877e9-e75f-41fa-bfc0-ac73c710f69d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:55.908580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:55.909679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.909967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.910241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.911059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:55:55.911473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:55.913221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:55.960074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1357/2752] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:55:55.963188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:55.977182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ab918-5fea-44d9-9af7-c9dfd1b8a29f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:55.990420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:55.991114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:55.991391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:55.991709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:55.992413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:55.994337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.048121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:56.078010 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1396/2753] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:55:55 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:56.081752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:56.097383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9f4e1-f9ff-43c3-8b92-762d6537c4b8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:56.228622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:56.231162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.232180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.232744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.233624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:56.245974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.282697 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1358/2754] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:55:56 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:55:56.286949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:56.305755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5e39-61d6-4b01-863a-36c3cced847c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:56.313682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:56.318162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.318162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.319771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.324944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:56.327461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.351855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:56.352524 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1397/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:56.369966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185894-f5a3-4b15-af1a-d12ad36d2b7b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:56.393475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:56.394185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.394468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.394748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.407160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:56.413903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b3b2-432b-4fc1-89ea-adfe42410cb6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.439840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1359/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:55:56.441204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:56.458827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d5e39-bf01-4247-a7e4-959fef677281 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:56.473531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:56.474468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.474752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.475028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] PATH_INFO: `/v3/projects/d7e3eb86f0f143ff9186ebfd23f098d8/users/c42a1a43a21342fd9cbdd5a48b828485/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.510278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e3eb86f0f143ff9186ebfd23f098d8, user_id=c42a1a43a21342fd9cbdd5a48b828485, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:56.515759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.545320 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1398/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:55:56 2022] PUT /identity/v3/projects/d7e3eb86f0f143ff9186ebfd23f098d8/users/c42a1a43a21342fd9cbdd5a48b828485/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:55:56.552638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc060-fe3c-4818-8ba6-5aab57037af8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.553528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc060-fe3c-4818-8ba6-5aab57037af8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.554203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc060-fe3c-4818-8ba6-5aab57037af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.579300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9a4bc060-fe3c-4818-8ba6-5aab57037af8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:56.581175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9a4bc060-fe3c-4818-8ba6-5aab57037af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:56.674794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1360/2758] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:55:56.687592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:56.689497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:56.762276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4edbfd-32a1-4095-afd4-18b349c0d254 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:56.769364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:56.770847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:56.771749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:56.772011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:56.788276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:56.790055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d8941-b21a-4384-b263-fb46b82a91cc service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:56.806752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1399/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:58.853671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:58.854121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:58.854121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:58.940279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] MFA Rules not processed for user `c42a1a43a21342fd9cbdd5a48b828485`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:58.955347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:59.045949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:59.143880 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1361/2760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:59.145881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:59.146368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:59.146481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:59.204755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] MFA Rules not processed for user `c42a1a43a21342fd9cbdd5a48b828485`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:59.206469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:59.216560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1400/2761] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:59.477536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:59.478994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:59.642030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5acf49-55a6-46f3-a041-cc1dcffa4ae1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:59.662233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:59.663084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:59.663776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:59.663776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:59.681725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:59.683608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:59.739913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1362/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:02.473935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:02.475607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:02.517548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6e6e5-9d0b-404c-96f5-47f80e0c9777 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:02.536125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:02.536125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:02.536580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:02.536740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] PATH_INFO: `/v3/users/90a9faf4a615437ca499c0ccbc1e7563` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:02.540001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a9faf4a615437ca499c0ccbc1e7563)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:02.542354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:02.659656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a9faf4a615437ca499c0ccbc1e7563'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:02.677025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a9faf4a615437ca499c0ccbc1e7563'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:02.678136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a9faf4a615437ca499c0ccbc1e7563'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:02.678949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a9faf4a615437ca499c0ccbc1e7563'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:02.710343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a9faf4a615437ca499c0ccbc1e7563'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:02.742563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1401/2763] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:02 2022] DELETE /identity/v3/users/90a9faf4a615437ca499c0ccbc1e7563 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:03.609151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:03.622599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60659998-ff09-4466-94ee-aad2af20ff7b service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:03.723864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:03.724861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:03.725287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:03.726032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] PATH_INFO: `/v3/projects/afaae81a01be4c73acb908aae5be8312` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:03.727115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afaae81a01be4c73acb908aae5be8312)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:03.729157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:03.800622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afaae81a01be4c73acb908aae5be8312', 'request_id': 'req-e3c7a557-bee3-47ef-8cc4-e86d1c339028'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:03.808914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afaae81a01be4c73acb908aae5be8312', 'request_id': 'req-e3c7a557-bee3-47ef-8cc4-e86d1c339028'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:03.814146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:03.817080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afaae81a01be4c73acb908aae5be8312', 'request_id': 'req-e3c7a557-bee3-47ef-8cc4-e86d1c339028'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:03.841937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] The token cache is being invalidate because project afaae81a01be4c73acb908aae5be8312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:03.842713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:03.843432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:03.850259 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1363/2764] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:03 2022] DELETE /identity/v3/projects/afaae81a01be4c73acb908aae5be8312 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:03.855019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:03.857292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:03.882416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8698811-fa61-40dd-8c7c-4a9377460ad1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:03.922311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:03.961416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:03.962342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:03.962689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:03.963039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] PATH_INFO: `/v3/users/23217a2f30944c4eb4de3164e8f35416` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:03.965258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23217a2f30944c4eb4de3164e8f35416)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:03.968131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:04.047788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23217a2f30944c4eb4de3164e8f35416'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:04.060473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23217a2f30944c4eb4de3164e8f35416'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:04.062025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23217a2f30944c4eb4de3164e8f35416'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:04.063737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23217a2f30944c4eb4de3164e8f35416'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:04.088457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-547c4349-ab9d-4ed7-a96c-a21dcf0ccdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23217a2f30944c4eb4de3164e8f35416'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:04.108302 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1402/2765] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:03 2022] DELETE /identity/v3/users/23217a2f30944c4eb4de3164e8f35416 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:04.848184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:04.851441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:04.882989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7a557-bee3-47ef-8cc4-e86d1c339028 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:04.972909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:04.974113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:04.974408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:04.974726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] PATH_INFO: `/v3/projects/3836f24b696946f8be16f8415389655b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:04.976944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3836f24b696946f8be16f8415389655b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:04.979204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.064499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3836f24b696946f8be16f8415389655b', 'request_id': 'req-ca6e3e23-70af-4336-b404-0a0a79ddc408'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:05.081392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3836f24b696946f8be16f8415389655b', 'request_id': 'req-ca6e3e23-70af-4336-b404-0a0a79ddc408'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:05.092894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3836f24b696946f8be16f8415389655b', 'request_id': 'req-ca6e3e23-70af-4336-b404-0a0a79ddc408'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:05.111172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] The token cache is being invalidate because project 3836f24b696946f8be16f8415389655b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:05.112176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:05.112692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca6e3e23-70af-4336-b404-0a0a79ddc408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:05.114550 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1364/2766] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:04 2022] DELETE /identity/v3/projects/3836f24b696946f8be16f8415389655b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:05.120126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.121324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.121768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.142188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:05.143467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:05.251002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.251349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.251599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.254161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1403/2767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:05.275146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:05.276699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:05.288696 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1365/2768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:05.290379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.306565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d864f7-21aa-4def-93a0-d34b01e8c0fc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.312707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.313557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.313812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.314337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.315609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:05.316151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.318268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.334804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1404/2769] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:05.340203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.354811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98de2c4-e9e6-4e40-953b-e21eac782979 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.391846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.391846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.391846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.391846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.392424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.392424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.431023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1366/2770] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:05 2022] POST /identity/v3/projects => generated 403 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:05.431873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.445709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e52136-5088-456b-b8a1-0540ddd561e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.508280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:05.576992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.579372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.579868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.582117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.583643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.586346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.629228 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1405/2771] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:05 2022] POST /identity/v3/users => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:05.633441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.652997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459606b-a4d9-4d40-84cb-d3ad7da9888a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.669879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.670577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.671239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.671239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.671923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.678582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.707431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.708838 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1367/2772] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:05.730239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6b7e7-b906-49ff-a0a7-019f00cd82e7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.744501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294981ee-0793-405f-bf10-597874594148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.745784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294981ee-0793-405f-bf10-597874594148 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.747442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294981ee-0793-405f-bf10-597874594148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.750307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294981ee-0793-405f-bf10-597874594148 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.753861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294981ee-0793-405f-bf10-597874594148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.758635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294981ee-0793-405f-bf10-597874594148 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.790650 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1406/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:05.794594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:05.807185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a862-7eb2-4b89-a60b-83b28da07dfe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:05.816802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:05.817736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.818076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.818364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] PATH_INFO: `/v3/projects/81e5ba47d66148bab8b148fc01bee663/users/cf10808b90884cdbaa2c0a3270aa3c30/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.838676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e5ba47d66148bab8b148fc01bee663, user_id=cf10808b90884cdbaa2c0a3270aa3c30, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:05.842893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:05.872049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1368/2774] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:05 2022] PUT /identity/v3/projects/81e5ba47d66148bab8b148fc01bee663/users/cf10808b90884cdbaa2c0a3270aa3c30/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:05.887038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:05.888981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:05.889465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:05.921900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] MFA Rules not processed for user `cf10808b90884cdbaa2c0a3270aa3c30`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:05.923240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:06.008389 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1407/2775] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:06.010161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.042883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:06.198200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2431e-c272-4d3b-a542-bb6e9d2f3dfb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.225383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.228521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.228822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.229107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.229987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.232704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.288700 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1369/2776] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:06 2022] POST /identity/v3/projects => generated 401 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:06.292614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.307313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d6d9-bec9-4d82-9030-c2a833b54cbc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.483581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.485311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.486995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.487393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.488205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.490888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.527248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1408/2777] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:06 2022] POST /identity/v3/users => generated 307 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:06.528626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.546634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f129-13a3-4e3a-9905-5e890b8d6df6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.554452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.555486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.555880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.556213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.556964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.558820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.577911 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1370/2778] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:06.581427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.595051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb8fb-a449-459e-a549-77a94e751b4c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.600529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.601589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.601879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.602158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] PATH_INFO: `/v3/projects/89d716f2995a43ce834489ceee1da263/users/39ad1af628324c22a7e0233d6bc2652c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.624774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d716f2995a43ce834489ceee1da263, user_id=39ad1af628324c22a7e0233d6bc2652c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.628346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.666067 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1409/2779] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:06 2022] PUT /identity/v3/projects/89d716f2995a43ce834489ceee1da263/users/39ad1af628324c22a7e0233d6bc2652c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:06.670113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.687672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64943b6-9ec4-4c82-a6f9-2518e0212ccc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.811952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.813428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.814136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.814371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.815429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.817745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b48a8-6d42-4f3b-949f-a5f995d91b68 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.848094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1371/2780] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:06.848941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:06.866139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d40427-1cb8-4bef-b88a-ff0a8f6116f5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:06.886393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:06.887814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.888316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.888763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] PATH_INFO: `/v3/projects/89d716f2995a43ce834489ceee1da263/users/39ad1af628324c22a7e0233d6bc2652c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.894973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d716f2995a43ce834489ceee1da263, user_id=39ad1af628324c22a7e0233d6bc2652c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:06.899222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a0b0b-2a8b-42d9-bae1-7cab4f40ce1c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:06.903720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:06.919847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1410/2781] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:06 2022] PUT /identity/v3/projects/89d716f2995a43ce834489ceee1da263/users/39ad1af628324c22a7e0233d6bc2652c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:56:06.926390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:06.926951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:06.926951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:06.969599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] MFA Rules not processed for user `39ad1af628324c22a7e0233d6bc2652c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:06.971010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:07.087254 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1372/2782] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:07.096607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:07.096903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:07.097179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:07.102716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:07.112876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:07.137945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:07.139418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:07.161174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:07.236691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1411/2783] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:07.317487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87141e-bf36-4180-a26c-2ddcec909ac7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:07.324131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:07.325715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:07.326027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:07.326307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:07.337451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:07.339454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fbc46-d328-4f05-a531-187698b782fe service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:07.354350 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1373/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:07.878463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:07.898970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e197ec-6507-4c9b-94dd-a36bc62f66b6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:07.907430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:07.909255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:07.909637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:07.910462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:07.963122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee6247-2be7-43f5-b8df-692732a1b207 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:07.964368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee6247-2be7-43f5-b8df-692732a1b207 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:07.964657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee6247-2be7-43f5-b8df-692732a1b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:07.989575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6dee6247-2be7-43f5-b8df-692732a1b207 None None] MFA Rules not processed for user `598884c9d0964ad6992f79eaf770507d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:07.991223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6dee6247-2be7-43f5-b8df-692732a1b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:08.006156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:08.009072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:08.022748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1412/2785] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:08.084292 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1374/2786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:09.299373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:09.404999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f15436-50a2-47ef-ae40-06c292349870 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:09.412495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:09.413507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:09.413789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:09.414107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] PATH_INFO: `/v3/users/cf10808b90884cdbaa2c0a3270aa3c30` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:09.415326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf10808b90884cdbaa2c0a3270aa3c30)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:09.417351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:09.481599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:09.491846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf10808b90884cdbaa2c0a3270aa3c30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:09.503448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf10808b90884cdbaa2c0a3270aa3c30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:09.504420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf10808b90884cdbaa2c0a3270aa3c30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:09.505094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf10808b90884cdbaa2c0a3270aa3c30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:09.532115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf10808b90884cdbaa2c0a3270aa3c30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:09.561852 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1413/2787] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:09 2022] DELETE /identity/v3/users/cf10808b90884cdbaa2c0a3270aa3c30 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:09.567210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:09.570031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:09.570031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:09.595602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:09.597689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:09.764119 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1375/2788] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:09.774565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:09.776835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:09.915556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba8b7-d8e7-4069-9a7e-9f5ea350d376 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:09.920249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:09.921462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:09.921750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:09.922030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:09.948528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:09.951961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:09.983343 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1414/2789] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:11.398814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:11.401866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:11.422264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097939b6-f88f-4da7-909b-2e53a27a13bc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:11.440445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:11.442200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:11.442492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:11.442775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] PATH_INFO: `/v3/projects/81e5ba47d66148bab8b148fc01bee663` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:11.444347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e5ba47d66148bab8b148fc01bee663)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:11.447188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:11.518975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:11.540724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e5ba47d66148bab8b148fc01bee663', 'request_id': 'req-57d974ed-5a70-4cc1-aead-3ad580eea7d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.550764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e5ba47d66148bab8b148fc01bee663', 'request_id': 'req-57d974ed-5a70-4cc1-aead-3ad580eea7d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.558874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e5ba47d66148bab8b148fc01bee663', 'request_id': 'req-57d974ed-5a70-4cc1-aead-3ad580eea7d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.579273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] The token cache is being invalidate because project 81e5ba47d66148bab8b148fc01bee663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:11.580250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.581134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.583637 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1376/2790] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:11 2022] DELETE /identity/v3/projects/81e5ba47d66148bab8b148fc01bee663 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:11.588159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:11.599909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280c0ab-ffb7-4c98-88f8-382830fc378b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:11.677392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:11.678608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:11.678889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:11.679167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] PATH_INFO: `/v3/users/39ad1af628324c22a7e0233d6bc2652c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:11.680744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ad1af628324c22a7e0233d6bc2652c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:11.682701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:11.768931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ad1af628324c22a7e0233d6bc2652c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.780568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ad1af628324c22a7e0233d6bc2652c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.782388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ad1af628324c22a7e0233d6bc2652c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.782669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ad1af628324c22a7e0233d6bc2652c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.791029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:11.801126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5fbd195a-28ea-4544-a91f-a689beeab6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ad1af628324c22a7e0233d6bc2652c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:11.820790 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1415/2791] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:11 2022] DELETE /identity/v3/users/39ad1af628324c22a7e0233d6bc2652c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:12.429586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:12.431871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:12.453200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d974ed-5a70-4cc1-aead-3ad580eea7d0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:12.549276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:12.550016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:12.550294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:12.551723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] PATH_INFO: `/v3/projects/89d716f2995a43ce834489ceee1da263` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:12.553709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d716f2995a43ce834489ceee1da263)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:12.555729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:12.642507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d716f2995a43ce834489ceee1da263', 'request_id': 'req-c8b8043e-3c02-4949-8ddc-8f37be99fa01'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:12.652191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d716f2995a43ce834489ceee1da263', 'request_id': 'req-c8b8043e-3c02-4949-8ddc-8f37be99fa01'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:12.661427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d716f2995a43ce834489ceee1da263', 'request_id': 'req-c8b8043e-3c02-4949-8ddc-8f37be99fa01'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:12.677054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] The token cache is being invalidate because project 89d716f2995a43ce834489ceee1da263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:12.677325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:12.678042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c8b8043e-3c02-4949-8ddc-8f37be99fa01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:12.679809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1377/2792] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:12 2022] DELETE /identity/v3/projects/89d716f2995a43ce834489ceee1da263 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:12.685312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:12.685872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:12.686629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:12.723892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:12.725126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:12.877867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1416/2793] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:12.887677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:12.888626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:12.889149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:12.923853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:12.925147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:12.955220 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1378/2794] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:12.959488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:12.973368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3977-ebe1-46e2-8219-342a237dcab2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:12.989690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:12.991952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:12.992453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:12.995023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.000621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:13.000999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.002767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.038820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.054470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ea9e-f8e7-4327-b3b4-f9958554718c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.058871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1417/2795] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:13.080988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.081808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.082184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.082640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.083595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.086276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.139979 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1379/2796] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:13 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:13.141265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.161246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366bf8-6ca9-4495-8392-6211dde23c7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.491860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.492862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.493249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.493702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.494662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.497594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.527492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1418/2797] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:13 2022] POST /identity/v3/users => generated 297 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:13.532417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.544891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d044-ef87-414f-8786-56833a984567 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.550853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.551738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.552119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.552507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.553455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.555454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.568887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1380/2798] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:13.573529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.584215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5900c-7620-4cfa-8d27-0f4ec1ef74da admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.589058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.589733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.590018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.590295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.591259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.592987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980592c-2f3a-4e6a-898b-96fe2cb4f72a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.606869 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1419/2799] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:13.611404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.625061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fcd56-88bb-4ae0-acb1-767227996c06 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.630904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.632147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.632550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.632808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] PATH_INFO: `/v3/projects/c323eb2f3aa044c99cf0383ec0e0c54e/users/ff9a175069af427384810401c05fafb0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.651176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:13.657995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c323eb2f3aa044c99cf0383ec0e0c54e, user_id=ff9a175069af427384810401c05fafb0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.661233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.687814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1381/2800] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:13 2022] PUT /identity/v3/projects/c323eb2f3aa044c99cf0383ec0e0c54e/users/ff9a175069af427384810401c05fafb0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:13.698665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.699664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.700128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.741188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] MFA Rules not processed for user `ff9a175069af427384810401c05fafb0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:13.742496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:13.786368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:13.834501 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1420/2801] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:13.843959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.921560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e09eab-21d1-4df9-bcae-e332a366f41d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:13.927771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:13.928483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:13.928773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:13.929059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:13.929775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:13.932284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:13.968734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1382/2802] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:13 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:13.970754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:13.983954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073efe6-43e9-42f3-9a79-8e4070c20344 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.060504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.061321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.061646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.061927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.062758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.065196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.089256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1421/2803] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:13 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:14.094493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.110345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f663-f9af-4be7-9971-68ed4cd28682 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.117562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.118742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.120035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.120035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.120499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.122344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.155083 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1383/2804] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:14.156560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.168837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f09ea2-a54c-4e26-bc91-55a08fc4f4ac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.175043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.177950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.178488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.178760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] PATH_INFO: `/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac/users/ea2b9e807338476a927718c10a579e04/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.196781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3cafd6499f475ab48a7d25aa96f0ac, user_id=ea2b9e807338476a927718c10a579e04, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.200411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.216266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1422/2805] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:14 2022] PUT /identity/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac/users/ea2b9e807338476a927718c10a579e04/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:56:14.221643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.240686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4971bd2-c049-4383-a9c4-755d0034b404 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.313747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.314410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.314692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.314965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.315804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.317553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ac39d-461b-476a-af6a-3f3be9bf725a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.330372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1384/2806] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:14.335073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.346788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589f06-d1cb-466a-84cd-cb800fda5ad7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.351705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.352680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.352967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.353270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] PATH_INFO: `/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac/users/ea2b9e807338476a927718c10a579e04/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.355265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3cafd6499f475ab48a7d25aa96f0ac, user_id=ea2b9e807338476a927718c10a579e04, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.359573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.374294 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1423/2807] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:14 2022] PUT /identity/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac/users/ea2b9e807338476a927718c10a579e04/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:14.384878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf414-fb4f-4b36-ac44-18da938d89ef None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.385188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf414-fb4f-4b36-ac44-18da938d89ef None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.385515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adf414-fb4f-4b36-ac44-18da938d89ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.418090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c9adf414-fb4f-4b36-ac44-18da938d89ef None None] MFA Rules not processed for user `ea2b9e807338476a927718c10a579e04`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:14.419501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c9adf414-fb4f-4b36-ac44-18da938d89ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:14.501819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:14.532208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1385/2808] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:14.554287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.635319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a75e-6d9c-435e-9dc0-8256480be2d8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.640820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.641880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.642166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.642527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] PATH_INFO: `/v3/users/ff9a175069af427384810401c05fafb0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.643788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9a175069af427384810401c05fafb0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.646137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.688764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:14.707642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9a175069af427384810401c05fafb0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:14.715204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9a175069af427384810401c05fafb0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:14.716383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9a175069af427384810401c05fafb0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:14.717086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9a175069af427384810401c05fafb0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:14.732897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9a175069af427384810401c05fafb0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:14.751223 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1424/2809] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:14 2022] DELETE /identity/v3/users/ff9a175069af427384810401c05fafb0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:14.756611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.757153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.757549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.778235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:14.779536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:14.854332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1386/2810] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:14.865704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:14.867931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:14.952893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38365232-01a4-44bc-808b-182364ffabe6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:14.958114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:14.959014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:14.959370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:14.959749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:14.976211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:14.978853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:14.991534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1425/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:15.483164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:15.484696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:15.519442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa03cd-52ab-4532-aa54-51a6281a9dc5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:15.526934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:15.527669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:15.528109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:15.529679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] PATH_INFO: `/v3/projects/c323eb2f3aa044c99cf0383ec0e0c54e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:15.529927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c323eb2f3aa044c99cf0383ec0e0c54e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:15.532185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:15.591629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c323eb2f3aa044c99cf0383ec0e0c54e', 'request_id': 'req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.598856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c323eb2f3aa044c99cf0383ec0e0c54e', 'request_id': 'req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.607709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c323eb2f3aa044c99cf0383ec0e0c54e', 'request_id': 'req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.627405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] The token cache is being invalidate because project c323eb2f3aa044c99cf0383ec0e0c54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:15.627844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.628900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.631914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1387/2812] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:15 2022] DELETE /identity/v3/projects/c323eb2f3aa044c99cf0383ec0e0c54e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:15.635834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:15.648123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061cf1-8ede-4f4b-8bc2-6b11dc0d8b8d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:15.749625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:15.750924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:15.751278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:15.751660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] PATH_INFO: `/v3/users/ea2b9e807338476a927718c10a579e04` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:15.755685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2b9e807338476a927718c10a579e04)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:15.758183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:15.859895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2b9e807338476a927718c10a579e04'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.866999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:15.881434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2b9e807338476a927718c10a579e04'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.882907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2b9e807338476a927718c10a579e04'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.883741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2b9e807338476a927718c10a579e04'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.909246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f44ae9a2-2a30-435c-959b-bc16e396ce24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2b9e807338476a927718c10a579e04'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:15.933477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1426/2813] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:15 2022] DELETE /identity/v3/users/ea2b9e807338476a927718c10a579e04 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:16.533602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:16.537567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:16.588426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5b6b2-ad01-4797-af5d-aef9d526f1fb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:16.681020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:16.682323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:16.683126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:16.683655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] PATH_INFO: `/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:16.686735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3cafd6499f475ab48a7d25aa96f0ac)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:16.692144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:16.712065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:16.773141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3cafd6499f475ab48a7d25aa96f0ac', 'request_id': 'req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:16.784541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3cafd6499f475ab48a7d25aa96f0ac', 'request_id': 'req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:16.794716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3cafd6499f475ab48a7d25aa96f0ac', 'request_id': 'req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:16.818928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] The token cache is being invalidate because project ce3cafd6499f475ab48a7d25aa96f0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:16.820028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:16.820891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d25f7f46-70a5-4a00-9c7d-d1bcfe901540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:16.823289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1388/2814] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:16 2022] DELETE /identity/v3/projects/ce3cafd6499f475ab48a7d25aa96f0ac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:16.830016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:16.830573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:16.830658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:16.852888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:16.854282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:16.951479 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1427/2815] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:16.961384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:16.961738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:16.961945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:16.989504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:16.990946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:17.018579 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1389/2816] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:17.025527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.047628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ca64d-d6d4-4173-a634-dfad7ffa0d8e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.054353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.055410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.056111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.056501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.057738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:17.058077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.061435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.079775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1428/2817] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:17.088224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.105416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ab26d-b7b3-429b-9d00-c22af6e05227 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.129709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.129709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.129709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.129709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.130063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.130063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.168775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1390/2818] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:17 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:17.172807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.184039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aed2a-f8fd-4ca2-8e53-942e60088a26 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.282399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.282993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.283301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.283611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.284322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.286465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.315545 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1429/2819] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:17 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:17.318102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.334671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af06cad-2ab8-4863-ba24-c0042189430b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.342425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.343021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.344320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.344320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.344689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.346650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.360128 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1391/2820] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:17.363873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.383049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629414c0-71fb-4104-a5bb-9171791ddb32 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.390420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.391395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.391718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.392112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.393000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.394918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f349c-cefd-4281-8e53-9acfdf0f80cf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.412499 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1430/2821] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:17.417556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.428927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08198d-4894-4a1c-b7d3-c8018a9d42f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.434389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.435353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.435672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.435909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] PATH_INFO: `/v3/projects/75a17bfba0e649e8a1fbc03ee3cba528/users/5f8d5265d37541b1bbbaf8af1ab37db9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.456277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a17bfba0e649e8a1fbc03ee3cba528, user_id=5f8d5265d37541b1bbbaf8af1ab37db9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.459039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.476874 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1392/2822] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:17 2022] PUT /identity/v3/projects/75a17bfba0e649e8a1fbc03ee3cba528/users/5f8d5265d37541b1bbbaf8af1ab37db9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:17.488645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.488945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.489194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.532926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] MFA Rules not processed for user `5f8d5265d37541b1bbbaf8af1ab37db9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:17.535436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:17.585325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:17.648301 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1431/2823] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:17.654077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.771358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.774703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:17.791806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a07ba8-2c3a-4080-9303-159cdb431dc6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.800312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.800991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.801274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.801553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.802252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.804814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:17.853237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1393/2824] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:17 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:17.858525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:17.894022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:17.897255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f67aa-da76-440e-a2cb-457deaf87de1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.964750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808ec7-2e4b-4691-b675-18b630fbab20 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:17.971134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:17.972277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:17.972749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:17.973728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:17.974634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:17.976881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.009296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.010159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.011003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.011003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.016591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:18.016860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1394/2825] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:17 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:18.018871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:18.032400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628436-c93d-4668-81a7-b89f63eb72e4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:18.039031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.040119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.040349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.040718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.041741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.043648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.055989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1395/2826] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:18.060819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:18.082626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf6171-3d6a-4461-a809-dfed40f23fb4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:18.085095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.086639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.087129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.087569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] PATH_INFO: `/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc/users/0ac52c40888141c09673f23ce6ce4fbe/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.115082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:18.118706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.122000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.126546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f692b4d85b9c42c2925a25ba1eee01bc, user_id=0ac52c40888141c09673f23ce6ce4fbe, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.133545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.138662 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1432/2827] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:18.166547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1396/2828] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:18 2022] PUT /identity/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc/users/0ac52c40888141c09673f23ce6ce4fbe/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:56:18.172653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:18.192088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af8a6-c65e-4c4a-8b87-e4cbb6f15ddc service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:18.305836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.306749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.307295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.307855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.309933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.311711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f974-7191-4125-9ee6-a1e78a10de92 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.327762 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1433/2829] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:18.329831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:18.355878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97072f-a245-431b-a7c7-e4a032f8b199 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:18.376870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.377909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.378200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.378483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] PATH_INFO: `/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc/users/0ac52c40888141c09673f23ce6ce4fbe/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.392609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f692b4d85b9c42c2925a25ba1eee01bc, user_id=0ac52c40888141c09673f23ce6ce4fbe, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.396677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.416238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1397/2830] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:18 2022] PUT /identity/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc/users/0ac52c40888141c09673f23ce6ce4fbe/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:18.427938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.428275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.428574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.508917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] MFA Rules not processed for user `0ac52c40888141c09673f23ce6ce4fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:18.510327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:18.625367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1434/2831] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:18.713880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:18.716083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:18.838892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb491da-ea93-4246-9481-9dd8a2040d24 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:18.845481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:18.846631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:18.847053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:18.847406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:18.859383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:18.861423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd27a98-38d1-4971-b3b5-ba04e3f84a5c service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:18.892438 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1398/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:19.954113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:20.054931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa276a67-188e-4ea4-88e0-d0b93c34e5c4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:20.062434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:20.063482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:20.064011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:20.064388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] PATH_INFO: `/v3/users/5f8d5265d37541b1bbbaf8af1ab37db9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:20.065882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8d5265d37541b1bbbaf8af1ab37db9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:20.068484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:20.096099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:20.142269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8d5265d37541b1bbbaf8af1ab37db9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:20.151582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8d5265d37541b1bbbaf8af1ab37db9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:20.152600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8d5265d37541b1bbbaf8af1ab37db9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:20.153910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8d5265d37541b1bbbaf8af1ab37db9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:20.172662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8d5265d37541b1bbbaf8af1ab37db9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:20.194238 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1435/2833] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:19 2022] DELETE /identity/v3/users/5f8d5265d37541b1bbbaf8af1ab37db9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:20.199325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:20.199964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:20.200223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:20.224165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:20.225764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:20.368881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:20.433401 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1399/2834] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:20.479416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:20.482916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:20.585660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab74cce-efc1-4191-ab6a-546679c26ffe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:20.589881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:20.590841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:20.591466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:20.591578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:20.606507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:20.608278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:20.621961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1436/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:21.218111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:21.219678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:21.233611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dce7a4-0ec6-4907-b41b-75d926671c17 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:21.239307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:21.240227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:21.240599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:21.240925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] PATH_INFO: `/v3/projects/75a17bfba0e649e8a1fbc03ee3cba528` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:21.242264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a17bfba0e649e8a1fbc03ee3cba528)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:21.244405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:21.295866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a17bfba0e649e8a1fbc03ee3cba528', 'request_id': 'req-901e96af-9966-44b7-9ad0-a0c1cf3627a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.302134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a17bfba0e649e8a1fbc03ee3cba528', 'request_id': 'req-901e96af-9966-44b7-9ad0-a0c1cf3627a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.307859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a17bfba0e649e8a1fbc03ee3cba528', 'request_id': 'req-901e96af-9966-44b7-9ad0-a0c1cf3627a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.323384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] The token cache is being invalidate because project 75a17bfba0e649e8a1fbc03ee3cba528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:21.323721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.324354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.325970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1400/2836] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:21 2022] DELETE /identity/v3/projects/75a17bfba0e649e8a1fbc03ee3cba528 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:21.330170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:21.341083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109079c-c9c9-43a1-b181-e25adf291e24 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:21.444383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:21.445393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:21.445746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:21.446093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] PATH_INFO: `/v3/users/0ac52c40888141c09673f23ce6ce4fbe` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:21.447422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac52c40888141c09673f23ce6ce4fbe)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:21.449772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:21.515469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:21.521858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac52c40888141c09673f23ce6ce4fbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.533343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac52c40888141c09673f23ce6ce4fbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.534113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac52c40888141c09673f23ce6ce4fbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.534827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac52c40888141c09673f23ce6ce4fbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.548356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f5fff8a-9acc-4ef7-b0be-f2053e58fea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac52c40888141c09673f23ce6ce4fbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:21.562906 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1437/2837] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:21 2022] DELETE /identity/v3/users/0ac52c40888141c09673f23ce6ce4fbe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:21.932650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:21.935360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:21.969492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e96af-9966-44b7-9ad0-a0c1cf3627a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.088810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.088810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.089589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.090081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] PATH_INFO: `/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.092579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f692b4d85b9c42c2925a25ba1eee01bc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.096111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.207691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f692b4d85b9c42c2925a25ba1eee01bc', 'request_id': 'req-c3fc34e7-e373-4495-bae5-b37605041b43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:22.216141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f692b4d85b9c42c2925a25ba1eee01bc', 'request_id': 'req-c3fc34e7-e373-4495-bae5-b37605041b43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:22.222428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f692b4d85b9c42c2925a25ba1eee01bc', 'request_id': 'req-c3fc34e7-e373-4495-bae5-b37605041b43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:22.233254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:22.242665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] The token cache is being invalidate because project f692b4d85b9c42c2925a25ba1eee01bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:22.243048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:22.243810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fc34e7-e373-4495-bae5-b37605041b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:22.246053 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1401/2838] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:21 2022] DELETE /identity/v3/projects/f692b4d85b9c42c2925a25ba1eee01bc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:22.269105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.269438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.269693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.293124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:22.295606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:22.373468 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1438/2839] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:22.381722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.381938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.382315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.408006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:22.409272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:22.418623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1402/2840] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:22.423473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.433670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e2df8-a393-4926-9b4a-990548ffd3f2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.439030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.439737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.440023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.440302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.441043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:22.441357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.443012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.456913 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1439/2841] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:22.461893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.473532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b09b-a0d0-424d-b617-be29e05294f1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.479963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.479963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.479963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.480399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.480773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.483110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.524541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1403/2842] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:22 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:22.526224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.538702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737efb7-cd0c-46c1-a8df-d29d29986c78 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.617438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.618662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.619140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.619667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.620991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.624241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.651363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1440/2843] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:22 2022] POST /identity/v3/users => generated 304 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:22.652603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.663634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685050-6c35-4205-8a69-1b3c9c3e6736 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.668345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.669462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.669752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.670040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.670774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.672426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.684612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1404/2844] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:22.688807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.699199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb14a7-002c-455a-b0ad-5d5601a73bdc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.705060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.705793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.706095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.706385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.707146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.708930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd836-3d7c-4e50-b5f1-0bd68d0cd721 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.721406 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1441/2845] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:22.726274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:22.738058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a7433-10b2-4680-96ad-2652df0efc78 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:22.743303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:22.744320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.744602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.744876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] PATH_INFO: `/v3/projects/2459671dcd194f3f8400703776836775/users/d5244c98165049c3a24e59ddc5b6a48b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.762035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2459671dcd194f3f8400703776836775, user_id=d5244c98165049c3a24e59ddc5b6a48b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:22.765054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:22.781241 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1405/2846] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:22 2022] PUT /identity/v3/projects/2459671dcd194f3f8400703776836775/users/d5244c98165049c3a24e59ddc5b6a48b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:22.793562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:22.793668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:22.794062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:22.864558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] MFA Rules not processed for user `d5244c98165049c3a24e59ddc5b6a48b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:22.866500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:22.884523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:23.010455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1442/2847] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:23.015918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.155725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4b9ad-4027-4fb5-b9fe-614d1fe985ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.161305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.162298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.162914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.163444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.163928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.166021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.202208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1406/2848] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:23 2022] POST /identity/v3/projects => generated 409 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:23.206395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.221252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d1043-4c84-4da8-9309-2e84d3902612 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.296422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.297485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.297485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.297897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.298733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.301416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.324375 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1443/2849] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:23 2022] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:23.328731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.340252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea5039-9237-41cc-bc48-905d1cbb8beb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.345493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.346410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.346898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.347233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.348187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.349793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.362153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1407/2850] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:23.366562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.378677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15bf46-4c53-4346-afac-518d25ae9307 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.386386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.387537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.388139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.388566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] PATH_INFO: `/v3/projects/225197a0bf7546bf99003d78b50bd8d8/users/987b847386a34a68862603b720c7fd9c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.409796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225197a0bf7546bf99003d78b50bd8d8, user_id=987b847386a34a68862603b720c7fd9c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.412173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.460355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1444/2851] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:23 2022] PUT /identity/v3/projects/225197a0bf7546bf99003d78b50bd8d8/users/987b847386a34a68862603b720c7fd9c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:23.464288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.475210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb99729-2264-4d13-b367-f11cdcea789d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.559307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.560745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.561342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.561861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.565843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.568753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48018-9591-4061-8b18-3ba2f5a31f5e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.594084 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1408/2852] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:23.597990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.614203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c657c-1e7e-4ac1-9c43-03e4be652db0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.624382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.625498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.625752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.626026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] PATH_INFO: `/v3/projects/225197a0bf7546bf99003d78b50bd8d8/users/987b847386a34a68862603b720c7fd9c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.629101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=225197a0bf7546bf99003d78b50bd8d8, user_id=987b847386a34a68862603b720c7fd9c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.632953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.660161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1445/2853] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:23 2022] PUT /identity/v3/projects/225197a0bf7546bf99003d78b50bd8d8/users/987b847386a34a68862603b720c7fd9c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:56:23.675042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.675379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.675754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.690380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.694387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:23.694634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:23.721523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] MFA Rules not processed for user `987b847386a34a68862603b720c7fd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:23.722761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:23.778997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b131a2-586b-494e-89b7-53a8c7036ede admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:23.783906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:23.784904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:23.785189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:23.785464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] PATH_INFO: `/v3/users/c42a1a43a21342fd9cbdd5a48b828485` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:23.787291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42a1a43a21342fd9cbdd5a48b828485)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:23.791976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:23.799948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:23.842799 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1409/2854] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:23.849896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:23.851692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:23.873294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42a1a43a21342fd9cbdd5a48b828485'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:23.881679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42a1a43a21342fd9cbdd5a48b828485'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:23.882706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42a1a43a21342fd9cbdd5a48b828485'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:23.883415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42a1a43a21342fd9cbdd5a48b828485'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:23.915948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42a1a43a21342fd9cbdd5a48b828485'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:23.935656 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1446/2855] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:23 2022] DELETE /identity/v3/users/c42a1a43a21342fd9cbdd5a48b828485 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:23.950565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ded06c-d75a-432e-af7d-d32e80153d27 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.026925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.027578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.027914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.028160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.030111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.068308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:24.112239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.114202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1104902-bd03-4599-9fb5-6ad6c4455ae4 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.128846 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1410/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:24.135542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.137457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.179703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f4d57-028f-402e-aba9-96fde51248c7 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.180283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f4d57-028f-402e-aba9-96fde51248c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.180726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f4d57-028f-402e-aba9-96fde51248c7 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.182404 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1411/2857] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:56:24.190447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.190908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.191394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.216440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:24.218662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.242715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10e7d8-1677-4146-9fa9-ab9a1d771f7d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.248540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.249408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.249686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.249960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] PATH_INFO: `/v3/projects/d7e3eb86f0f143ff9186ebfd23f098d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.251170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e3eb86f0f143ff9186ebfd23f098d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.253140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.297683 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1412/2858] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:24.299444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.300868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.305065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'request_id': 'req-d2cfcf81-1e65-408a-a48c-5905e975c026'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:24.312685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'request_id': 'req-d2cfcf81-1e65-408a-a48c-5905e975c026'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:24.323367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'request_id': 'req-d2cfcf81-1e65-408a-a48c-5905e975c026'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:24.326160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d607962-9e71-43e9-b918-dcc51d00e192 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.339844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] The token cache is being invalidate because project d7e3eb86f0f143ff9186ebfd23f098d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:24.340265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:24.341308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:24.342812 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1447/2859] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:24 2022] DELETE /identity/v3/projects/d7e3eb86f0f143ff9186ebfd23f098d8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:24.347326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.348820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.370491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:24.403419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.404203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.404533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.404820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.407177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.425833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfcf81-1e65-408a-a48c-5905e975c026 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.430876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.431555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.431840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.432118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.433916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.447434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.449142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a02237-f09a-454d-8ae1-367208668d9b service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.461586 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1448/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:24.463368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.463931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.464210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.470774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:24.473600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.476460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7550-fb86-444e-b870-acd54a8456af service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.487103 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1413/2861] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:24.490438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:24.491675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.580239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1449/2862] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:24.593551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.594113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.594684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.621909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:24.623941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:24.635910 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1414/2863] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:24.640522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.655861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44971082-3640-4a90-b893-dbcf4d2a1df4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.664183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.665648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.665942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.666297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.667679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:24.668262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.671418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.695360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1450/2864] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:56:24.700492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.727586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80a3bd-4eb3-4faa-9e21-6bc681a0d93f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.745432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.746505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.747003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.747473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.748782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.752193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.792069 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1415/2865] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:24 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:56:24.796207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.815402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8589fe-5dd7-4ba4-85d4-344c80ed7ebe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.916969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.918624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.919125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.919467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.920302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.922741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:24.965103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1451/2866] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:24 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:24.969967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:24.982030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051fc2-c6c6-480a-b93e-fb46b8097796 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:24.987532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:24.988288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:24.988588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:24.988853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:24.989591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:24.991207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.004186 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1416/2867] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:25.008555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.019899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb97b1-6de4-47e0-92f4-59b2c5d323a1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.025643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.026325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.026609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.026885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.028036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.030108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428940f-775a-4253-ac7d-425daecceed5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.042256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1452/2868] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:25.045963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.061620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef27d3f-2e2d-4121-b7c5-6a28a0ebc6ba admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.073216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.074300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.074582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.074899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] PATH_INFO: `/v3/projects/6332536fbe7047baa8b71c64fc9a5c3b/users/52294b4889cc4fd389b166c4150942c0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.093052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6332536fbe7047baa8b71c64fc9a5c3b, user_id=52294b4889cc4fd389b166c4150942c0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.095773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1acd9-7754-46c0-8ce3-7b9fc69d0de4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.113589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1417/2869] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:25 2022] PUT /identity/v3/projects/6332536fbe7047baa8b71c64fc9a5c3b/users/52294b4889cc4fd389b166c4150942c0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:56:25.119026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.119309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.119851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.147300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:25.148572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.155128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:25.177343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593af2a-56eb-4e92-9491-5128b2372320 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.177640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593af2a-56eb-4e92-9491-5128b2372320 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.177922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593af2a-56eb-4e92-9491-5128b2372320 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.179309 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1418/2870] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:56:25.187397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.187812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.188000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.208044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:25.209279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.235551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1453/2871] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:25.244394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.246059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.296012 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1419/2872] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:25.310148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.311647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f246c-1d6c-4bfc-a787-55cfe742477c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.316500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.317249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.317537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.317817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.319976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb6454-1be6-4ad8-8ef6-52d370357307 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.324644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.325772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.325772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.326113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.328446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.329897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d872faf-9ef5-411e-988d-7aaea8ce244e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.338659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.341460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f081c02-3b1e-4008-a4f4-0e14756c5977 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.343763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1454/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:25.357186 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1420/2874] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:25.384420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.384711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.385034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.391281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.391842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.392409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.411365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] MFA Rules not processed for user `3eef1a5b965a4d26adaed7af3344e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:25.412827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.421073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:25.422619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.431577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1421/2875] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:25.432384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.433801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.449060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d495c-302c-4b5d-a041-d4f7f9d56789 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.454628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.455665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.456558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.456558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] PATH_INFO: `/v3/users/d5244c98165049c3a24e59ddc5b6a48b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.457708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5244c98165049c3a24e59ddc5b6a48b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.460416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.490611 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1455/2876] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:25.492589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.504884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453f07f-7c8b-4172-baa4-b25d1e73cef3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.510742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.511701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.512639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.512866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.523829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.528062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af220a2-6338-4bd8-b282-10f6d76e270d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.538899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1456/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:25.550482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5244c98165049c3a24e59ddc5b6a48b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:25.551180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5244c98165049c3a24e59ddc5b6a48b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:25.566169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5244c98165049c3a24e59ddc5b6a48b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:25.567208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5244c98165049c3a24e59ddc5b6a48b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:25.570769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:25.585549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5244c98165049c3a24e59ddc5b6a48b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:25.604766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1422/2878] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:25 2022] DELETE /identity/v3/users/d5244c98165049c3a24e59ddc5b6a48b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:25.609730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.610021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.610297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.629590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:25.630806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.683145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:25.722998 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1457/2879] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:25.738927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:25.741246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:25.834823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e34773-bc39-4dac-8616-e897e4b450bd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:25.846735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:25.847427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:25.847745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:25.848045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:25.868129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:25.878232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:25.902829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1423/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:26.456201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:26.463347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:26.509690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572dd2d-99d6-4c9b-8d6b-ca304d4ea388 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:26.524401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:26.527880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:26.529997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:26.530371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] PATH_INFO: `/v3/projects/2459671dcd194f3f8400703776836775` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:26.538074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2459671dcd194f3f8400703776836775)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:26.540519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:26.687003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2459671dcd194f3f8400703776836775', 'request_id': 'req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:26.705672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2459671dcd194f3f8400703776836775', 'request_id': 'req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:26.724655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2459671dcd194f3f8400703776836775', 'request_id': 'req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:26.756913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] The token cache is being invalidate because project 2459671dcd194f3f8400703776836775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:26.757566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:26.758726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e51cdf6-9f96-4a4a-8034-183bbe00c69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:26.760855 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1458/2881] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:26 2022] DELETE /identity/v3/projects/2459671dcd194f3f8400703776836775 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:26.765024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:26.777315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f7ecf-0079-480f-9623-11cc4b7834af service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:26.890738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003823-1e77-4ef1-affa-5562915720eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:26.891124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003823-1e77-4ef1-affa-5562915720eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:26.891225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68003823-1e77-4ef1-affa-5562915720eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:26.927073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:26.929157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:26.929740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:26.930025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] PATH_INFO: `/v3/users/987b847386a34a68862603b720c7fd9c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:26.933747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=987b847386a34a68862603b720c7fd9c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:26.939977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:26.946241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-68003823-1e77-4ef1-affa-5562915720eb None None] MFA Rules not processed for user `52294b4889cc4fd389b166c4150942c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:26.947898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68003823-1e77-4ef1-affa-5562915720eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:27.040843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987b847386a34a68862603b720c7fd9c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.041576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987b847386a34a68862603b720c7fd9c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.069817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987b847386a34a68862603b720c7fd9c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.078306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987b847386a34a68862603b720c7fd9c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.098860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987b847386a34a68862603b720c7fd9c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.104094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1459/2882] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:27.117517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:27.117891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:27.118323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:27.126592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:27.144319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1424/2883] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:26 2022] DELETE /identity/v3/users/987b847386a34a68862603b720c7fd9c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:27.155206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] MFA Rules not processed for user `52294b4889cc4fd389b166c4150942c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:27.157510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:27.230799 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1460/2884] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:27.243103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:27.244669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:27.352264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061d3f3-5342-49bd-8bb7-cfd2277fe90f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:27.359784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:27.360848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:27.361199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:27.361484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:27.373190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:27.375082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1c73-eb05-4320-8394-5e48ec33564b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:27.387326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1425/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:27.607552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:27.609221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:27.618767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:27.737788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0628a1-1825-4272-9f74-d8853e414bd0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:27.743911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:27.745157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:27.745456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:27.747988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] PATH_INFO: `/v3/projects/225197a0bf7546bf99003d78b50bd8d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:27.747988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225197a0bf7546bf99003d78b50bd8d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:27.749471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:27.817275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225197a0bf7546bf99003d78b50bd8d8', 'request_id': 'req-e5c562fd-c389-4087-bc3e-519adf0a17b0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.828562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225197a0bf7546bf99003d78b50bd8d8', 'request_id': 'req-e5c562fd-c389-4087-bc3e-519adf0a17b0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.837239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225197a0bf7546bf99003d78b50bd8d8', 'request_id': 'req-e5c562fd-c389-4087-bc3e-519adf0a17b0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.864372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] The token cache is being invalidate because project 225197a0bf7546bf99003d78b50bd8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:27.866968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.868528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e5c562fd-c389-4087-bc3e-519adf0a17b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:27.873333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1461/2886] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:27 2022] DELETE /identity/v3/projects/225197a0bf7546bf99003d78b50bd8d8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:27.878482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:27.879066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:27.879066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:27.906868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:27.908157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:27.991544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1426/2887] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:27.993204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:27.993662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:27.994079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.024084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:28.026168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:28.037490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1462/2888] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:28.043476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.061831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b547cc-eb1e-491c-97ed-544ce256029a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.070846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.071788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.072052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.072329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.074342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:28.074828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.077527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.100414 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1427/2889] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:28.102478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.123618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86b118-bea0-4ccd-849f-aacc592ecf45 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.130239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.132007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.133206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.133782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.134835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.137987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.181236 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1463/2890] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:28 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:28.185977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.200921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176978-e0a7-425c-b492-73714e479609 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.392803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.393512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.393797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.394098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.394845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.397384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.417794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:28.425210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1428/2891] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:28 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:28.429460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.441732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3129-d767-45af-a0a0-2fb15bfbeb91 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.447074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.447798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.448116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.448396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.449138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.451500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.464389 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1464/2892] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:28.469315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.482884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9233a-393d-4bf6-9445-a7c21e30aeb3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.488964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.489702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.489985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.490365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.492752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.494230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776cf0f-5e88-43b5-9dc1-01724e367449 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.529962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.538608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1429/2893] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:28.545978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760bb82-cf0d-4aa7-92dc-5a80d044cdec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.551534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.553095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.553438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.553836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] PATH_INFO: `/v3/projects/6e3b1988e4cf4239bd15858c033f4717/users/544fec03e8964fa0becc1fafe72a9cef/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.574359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3b1988e4cf4239bd15858c033f4717, user_id=544fec03e8964fa0becc1fafe72a9cef, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.577823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.609729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.610020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.610295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.611774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1465/2894] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:28 2022] PUT /identity/v3/projects/6e3b1988e4cf4239bd15858c033f4717/users/544fec03e8964fa0becc1fafe72a9cef/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:28.654601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] MFA Rules not processed for user `544fec03e8964fa0becc1fafe72a9cef`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:28.655946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:28.773720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:28.776212 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1430/2895] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:28.827741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:28.913543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2567cf-86d9-4f2a-9142-43d3750e3662 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:28.926035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:28.926721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:28.927019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:28.927271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:28.928032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:28.930006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:28.992932 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1466/2896] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:28 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:28.997270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.011927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f69f5-5c0d-4e36-bcdc-935af20b9d52 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.135782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.136514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.136796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.137073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.137846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.142554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.167781 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1431/2897] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:28 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:29.174541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.189169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c0922-d4b8-4167-b5c3-1066cd84bef6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.195320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.196285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.196779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.197061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.197820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.199613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.220152 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1467/2898] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:29.228858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.246185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1376-a99f-4207-9422-e128e834e91a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.255917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.257847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.258529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.258962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] PATH_INFO: `/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae/users/97364a47c3af4ccdb51474ebc159a989/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.281102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afafb8dc0014c4aa6f7e836e8423fae, user_id=97364a47c3af4ccdb51474ebc159a989, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.284040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.304124 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1432/2899] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:29 2022] PUT /identity/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae/users/97364a47c3af4ccdb51474ebc159a989/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:29.308124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.326130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b8276-70db-4e18-b40f-1f7a958cc4f4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.402440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.403844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.404384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.404550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.405356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.407763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ab343-e2b1-4fa3-a571-986ce5ecd390 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.424376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1468/2900] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:56:29.429525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.444030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2d0be-fa68-4495-998e-25d02f828659 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.462480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.463662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.464278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.464418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] PATH_INFO: `/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae/users/97364a47c3af4ccdb51474ebc159a989/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.467086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afafb8dc0014c4aa6f7e836e8423fae, user_id=97364a47c3af4ccdb51474ebc159a989, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.469805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.482980 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1433/2901] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:29 2022] PUT /identity/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae/users/97364a47c3af4ccdb51474ebc159a989/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:29.495565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3063-1700-4302-866e-4957caa79c6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.496156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3063-1700-4302-866e-4957caa79c6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.496705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e3063-1700-4302-866e-4957caa79c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.554172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-434e3063-1700-4302-866e-4957caa79c6b None None] MFA Rules not processed for user `97364a47c3af4ccdb51474ebc159a989`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:29.556547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-434e3063-1700-4302-866e-4957caa79c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:29.691624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1469/2902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:29.708003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:29.711862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:29.769558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:29.821099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bf5a-f848-442f-9c3f-1498c5905d48 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:29.831443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:29.833830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:29.834487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:29.834701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:29.847789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:29.849607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b34b4c-bd86-4540-8592-df80bafec7c8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:29.861765 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1434/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:30.256530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3063-1700-4302-866e-4957caa79c6b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:30.307226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:30.370432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e3063-1700-4302-866e-4957caa79c6b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:30.386037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:30.387109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:30.387733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:30.387826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] PATH_INFO: `/v3/users/544fec03e8964fa0becc1fafe72a9cef` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:30.391376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544fec03e8964fa0becc1fafe72a9cef)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:30.393384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:30.546359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544fec03e8964fa0becc1fafe72a9cef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:30.558015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544fec03e8964fa0becc1fafe72a9cef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:30.558775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544fec03e8964fa0becc1fafe72a9cef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:30.560820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544fec03e8964fa0becc1fafe72a9cef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:30.591299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544fec03e8964fa0becc1fafe72a9cef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:30.624189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:30.625744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:30.626192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:30.628451 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1470/2904] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:30 2022] DELETE /identity/v3/users/544fec03e8964fa0becc1fafe72a9cef => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:30.656260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:30.657736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:30.759499 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1435/2905] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:30.831040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:30.835219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:30.913635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f7c9-d973-4a79-be45-e11361d37c38 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:30.928836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:30.929623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:30.929905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:30.930179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:30.944330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:30.945895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:30.961428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1471/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:32.058886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:32.067094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:32.098454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db7fa-5397-4743-bdf4-90af96e41706 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:32.105652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:32.107295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:32.107636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:32.108062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] PATH_INFO: `/v3/projects/6e3b1988e4cf4239bd15858c033f4717` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:32.109777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3b1988e4cf4239bd15858c033f4717)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:32.112315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:32.213649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3b1988e4cf4239bd15858c033f4717', 'request_id': 'req-5051f00a-839a-42ad-80a3-f85f91af7d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.233639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3b1988e4cf4239bd15858c033f4717', 'request_id': 'req-5051f00a-839a-42ad-80a3-f85f91af7d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.244125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3b1988e4cf4239bd15858c033f4717', 'request_id': 'req-5051f00a-839a-42ad-80a3-f85f91af7d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.290949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] The token cache is being invalidate because project 6e3b1988e4cf4239bd15858c033f4717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:32.291346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.293484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.300176 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1436/2907] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:32 2022] DELETE /identity/v3/projects/6e3b1988e4cf4239bd15858c033f4717 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:32.304223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:32.320790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8eb8-5b77-45b6-be6b-f25dc5b9f987 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:32.427974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:32.452302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:32.453545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:32.454222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:32.454595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] PATH_INFO: `/v3/users/97364a47c3af4ccdb51474ebc159a989` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:32.456173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97364a47c3af4ccdb51474ebc159a989)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:32.458849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:32.542713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97364a47c3af4ccdb51474ebc159a989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.552915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97364a47c3af4ccdb51474ebc159a989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.553680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97364a47c3af4ccdb51474ebc159a989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.554310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97364a47c3af4ccdb51474ebc159a989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.570934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e6c559c-5909-4fed-b359-2debbf6be85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97364a47c3af4ccdb51474ebc159a989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:32.587984 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1472/2908] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:32 2022] DELETE /identity/v3/users/97364a47c3af4ccdb51474ebc159a989 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:33.103304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.105720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:33.126029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051f00a-839a-42ad-80a3-f85f91af7d67 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.210016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:33.249997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.251053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.251931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.252495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] PATH_INFO: `/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.255253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afafb8dc0014c4aa6f7e836e8423fae)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.258757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.348304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afafb8dc0014c4aa6f7e836e8423fae', 'request_id': 'req-388dc478-7d27-42e5-994b-ee355d4cf047'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:33.355453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afafb8dc0014c4aa6f7e836e8423fae', 'request_id': 'req-388dc478-7d27-42e5-994b-ee355d4cf047'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:33.372911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afafb8dc0014c4aa6f7e836e8423fae', 'request_id': 'req-388dc478-7d27-42e5-994b-ee355d4cf047'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:33.400985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] The token cache is being invalidate because project 9afafb8dc0014c4aa6f7e836e8423fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:33.401738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:33.403910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388dc478-7d27-42e5-994b-ee355d4cf047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:33.408601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1437/2909] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:33 2022] DELETE /identity/v3/projects/9afafb8dc0014c4aa6f7e836e8423fae => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:33.417565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.418101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.418101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.441108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:33.443923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:33.526974 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1473/2910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:33.536950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.537261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.537511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.558626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:33.559943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:33.569496 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1438/2911] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:33.574109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.586560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a9660-e328-4bf5-8a11-434957ee434e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.593069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.593878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.594155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.594422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.595343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:33.595728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.597600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.612082 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1474/2912] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:56:33.616876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.627059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4e40-a4d4-4adc-98e3-ac2e8e793693 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.632348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.633061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.633339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.633591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.634304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.636273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.675166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1439/2913] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:33 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:33.676496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.688276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6968d3-5d37-4d18-b97a-7619615c4e4f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.774752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:33.786238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.787260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.787645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.788164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.789668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.791387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.814839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1475/2914] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:33 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:33.819614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.831713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde733-5928-4fda-a0b0-cbf77127c3a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.838024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.838773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.839043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.839396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.842051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.842560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.854274 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1440/2915] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:33.859540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.883264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04ca8-df3f-453d-a110-09069d482c0c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.893543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.895011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.896097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.897336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.898094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.899985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c00b-0746-4675-b853-894039cc451f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.912821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1476/2916] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:33.917666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:33.935784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87482ae9-5f52-43b0-ab12-190ba716039e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:33.941521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:33.942648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.943098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.943451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] PATH_INFO: `/v3/projects/af5ccb3a1d6f4f9e9eaad08d25ce57fd/users/e25328c90d26437a85d8d5509437ed99/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:33.962037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5ccb3a1d6f4f9e9eaad08d25ce57fd, user_id=e25328c90d26437a85d8d5509437ed99, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:33.964847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:33.981282 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1441/2917] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:33 2022] PUT /identity/v3/projects/af5ccb3a1d6f4f9e9eaad08d25ce57fd/users/e25328c90d26437a85d8d5509437ed99/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:33.987113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e1af-7902-4e2d-8089-cfcac18a5dc4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:33.987767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e1af-7902-4e2d-8089-cfcac18a5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:33.988271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455e1af-7902-4e2d-8089-cfcac18a5dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:34.009177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e455e1af-7902-4e2d-8089-cfcac18a5dc4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:34.010387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e455e1af-7902-4e2d-8089-cfcac18a5dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:34.072099 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1477/2918] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:34.084530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:34.086554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:34.185169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5d6ab-241a-4e6c-99da-27335f1823f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:34.191567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:34.192718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:34.193229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:34.193703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:34.210060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:34.212425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6261a-a0c3-4634-b291-331e5cf7f193 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:34.226043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1442/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:34.479887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:34.481259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:34.481601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:34.501501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] MFA Rules not processed for user `598884c9d0964ad6992f79eaf770507d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:34.504220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:34.573704 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1478/2920] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:35.705368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:35.705982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:35.705982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:35.726637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:35.737608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] MFA Rules not processed for user `e25328c90d26437a85d8d5509437ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:35.739835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:35.826409 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1443/2921] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:35.830562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:35.846119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da5fbd-fb7c-46f4-9848-344b2818edae None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:35.853350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:35.855311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:35.855939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:35.856438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:35.857558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:35.860412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:35.897200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1479/2922] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:35 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:35.901525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:35.914696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec514c22-5cd4-4500-b40c-3b531107b601 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:36.072314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:36.073014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:36.073298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:36.073573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:36.074270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:36.076470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:36.109922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1444/2923] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:35 2022] POST /identity/v3/users => generated 304 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:36.114279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:36.127770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170bd4a-c906-4906-9dde-6cdca4b35464 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:36.133979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:36.134828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:36.134952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:36.135195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:36.135999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:36.138004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:36.150449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1480/2924] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:36.156568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:36.167686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632efa-7fb8-45f3-bd26-95932e008ee6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:36.173818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:36.174503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:36.174791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:36.175123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] PATH_INFO: `/v3/projects/750e978f5ee641678fe8a459dcb1b5bb/users/759145aa1b1b49aa89e3fd53b03639db/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:36.194205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=750e978f5ee641678fe8a459dcb1b5bb, user_id=759145aa1b1b49aa89e3fd53b03639db, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:36.197121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:36.214012 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1445/2925] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:36 2022] PUT /identity/v3/projects/750e978f5ee641678fe8a459dcb1b5bb/users/759145aa1b1b49aa89e3fd53b03639db/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:36.219034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:36.229130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f485c0-77f0-43f2-8477-28a1fda51c7e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:36.277644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:36.294834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:36.295657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:36.296015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:36.296318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:36.297354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:36.299381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50f95-4106-49ed-b18e-7b96dc9b687e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:36.312162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1481/2926] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:36.316217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:36.326942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee75a2-f4de-4a85-9ccf-f3ecea7832ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:36.331843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:36.332746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:36.333024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:36.333296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] PATH_INFO: `/v3/projects/750e978f5ee641678fe8a459dcb1b5bb/users/759145aa1b1b49aa89e3fd53b03639db/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:36.335285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=750e978f5ee641678fe8a459dcb1b5bb, user_id=759145aa1b1b49aa89e3fd53b03639db, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:36.338062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851b649-625f-419d-8cec-8ba472a0e01c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:36.349070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1446/2927] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:36 2022] PUT /identity/v3/projects/750e978f5ee641678fe8a459dcb1b5bb/users/759145aa1b1b49aa89e3fd53b03639db/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:37.242764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:37.243382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:37.243382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:37.310962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] MFA Rules not processed for user `759145aa1b1b49aa89e3fd53b03639db`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:37.312546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:37.453644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554d79-812e-4045-ab40-b2f0a25595a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:37.455877 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1482/2928] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:37.456199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554d79-812e-4045-ab40-b2f0a25595a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:37.456690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554d79-812e-4045-ab40-b2f0a25595a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:37.481272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bf554d79-812e-4045-ab40-b2f0a25595a8 None None] MFA Rules not processed for user `e25328c90d26437a85d8d5509437ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:37.482924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf554d79-812e-4045-ab40-b2f0a25595a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:37.548549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:37.566046 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1447/2929] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:56:37.577170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:37.579136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:37.658169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0123d-1a36-4a1d-92e5-1330354be5a9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:37.663803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:37.664575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:37.664862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:37.665136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:37.673802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:37.675547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:37.686207 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1483/2930] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:47.561302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:47.681785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=76 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:55.295448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:55.296011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:55.296011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:55.333918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] MFA Rules not processed for user `ac8ef83fa94e4c9db70a0115cc867dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:55.337807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:55.473725 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1448/2931] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:55.914804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:55.916394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:56.041694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5aa76-9ee3-4b7c-b55d-07804ec736eb service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:56.060608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:56.061752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:56.062850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:56.063284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] PATH_INFO: `/v3/users/52294b4889cc4fd389b166c4150942c0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:56.067928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52294b4889cc4fd389b166c4150942c0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:56.069983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:56.180360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52294b4889cc4fd389b166c4150942c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.193934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52294b4889cc4fd389b166c4150942c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.194849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52294b4889cc4fd389b166c4150942c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.195584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52294b4889cc4fd389b166c4150942c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.210518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac5beb80-70a7-48cf-8626-0bebe6d1758c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52294b4889cc4fd389b166c4150942c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.239104 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1484/2932] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:56:55 2022] DELETE /identity/v3/users/52294b4889cc4fd389b166c4150942c0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:56.490874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:56.541429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899929-19d1-489e-b99f-8de30ba51f81 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:56.643087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:56.645103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:56.646167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:56.646956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] PATH_INFO: `/v3/projects/6332536fbe7047baa8b71c64fc9a5c3b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:56.649233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6332536fbe7047baa8b71c64fc9a5c3b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:56.652372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:56.767324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6332536fbe7047baa8b71c64fc9a5c3b', 'request_id': 'req-f9f564e4-706c-4956-b0d9-a42835ed5121'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.780173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6332536fbe7047baa8b71c64fc9a5c3b', 'request_id': 'req-f9f564e4-706c-4956-b0d9-a42835ed5121'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.795271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6332536fbe7047baa8b71c64fc9a5c3b', 'request_id': 'req-f9f564e4-706c-4956-b0d9-a42835ed5121'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.818586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] The token cache is being invalidate because project 6332536fbe7047baa8b71c64fc9a5c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:56:56.819710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.823589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9f564e4-706c-4956-b0d9-a42835ed5121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:56:56.827791 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1449/2933] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:56 2022] DELETE /identity/v3/projects/6332536fbe7047baa8b71c64fc9a5c3b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:56.833270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:56.833647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:56.833850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:56.906145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:56.912062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:57.005762 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1485/2934] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:57.014234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.014525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.014803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.069258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:57.070759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:57.097463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.098843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1450/2935] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:57.109880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2416832-0720-42b3-8518-7bbe4c8cb509 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.128944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.130729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.132365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.132923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.133869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:56:57.137581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.151944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.182898 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1486/2936] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:56:57.187614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.200732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942760e8-5158-4481-b6e6-ab6cc8bb7b5e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.206148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.206886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.207244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.210069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.210069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.215881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.263901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:57.279322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.295725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cecef7-a8aa-415a-a0f8-8634aee1f557 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.296283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1451/2937] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:56:57 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:57.320002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:57.461747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.463010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.463988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.464467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.465467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.469053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.514599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.525792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1487/2938] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:56:57 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:56:57.528374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f30671-ab38-4a75-8c03-b15a44fc740b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.535799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.537195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.537670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.538234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.539413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.541617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.557304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1452/2939] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:57.563088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.576504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b809f34-10c2-4839-b2b1-dc9a95185370 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.581991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.583187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.583700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.600216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.601385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.604653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393d2f8-71c0-453b-b4ac-296ebfee98d4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.643335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.659151 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1488/2940] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:56:57.662228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967708d3-ef93-48a3-992f-9989b18bf873 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:57.675177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:57.676250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.676529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.679811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] PATH_INFO: `/v3/projects/acfa17945c2047fb99c3ad72a4854343/users/7cd8c77ab6374489bcddb296fffcecb7/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.713069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfa17945c2047fb99c3ad72a4854343, user_id=7cd8c77ab6374489bcddb296fffcecb7, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:57.716473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:57.745915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:57.747714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:57.748463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:57.760772 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1453/2941] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:56:57 2022] PUT /identity/v3/projects/acfa17945c2047fb99c3ad72a4854343/users/7cd8c77ab6374489bcddb296fffcecb7/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:56:57.777607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:57.780415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:57.897268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1489/2942] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:57.903903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:57.905786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:58.002016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0702f6-b435-4648-a701-95e03baa4cc7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:58.006902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:58.008803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:58.009196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:58.009570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:58.022469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:58.024825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a8434-ebfe-49d3-97b2-01909c913ce2 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:58.053695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1454/2943] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:58.624121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:58.629834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:58.787611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442f82-2827-4e16-9fbe-c9827b6369dd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:58.794898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:58.795881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:58.796231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:58.796712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:58.799704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:58.858786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:58.967648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:58.971203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:58.989360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1490/2944] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:56:59.157555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:59.158074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:59.158074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:59.205957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] MFA Rules not processed for user `7cd8c77ab6374489bcddb296fffcecb7`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:56:59.207197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:59.318886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1455/2945] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:56:59.329232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:56:59.331115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:56:59.356915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b968a-574a-4149-80f9-0130a5aa00c5 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:56:59.371850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:56:59.373844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:56:59.373844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:56:59.374073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:56:59.403337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:56:59.406999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60334c-bbc0-44ca-9466-9a461903406c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:56:59.427647 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1491/2946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:56:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:00.661488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:00.663141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:00.690949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c021f2-0dda-46d3-a07c-9825a79ef4b6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:00.707974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:00.710009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:00.711805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:00.712632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] PATH_INFO: `/v3/users/598884c9d0964ad6992f79eaf770507d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:00.715319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=598884c9d0964ad6992f79eaf770507d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:00.721319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:00.876732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598884c9d0964ad6992f79eaf770507d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:00.877889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598884c9d0964ad6992f79eaf770507d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:00.885204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:00.905584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598884c9d0964ad6992f79eaf770507d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:00.909729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598884c9d0964ad6992f79eaf770507d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:00.954897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c6a1d76c-f3c6-4145-8087-1fb3cdee6afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598884c9d0964ad6992f79eaf770507d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:00.989390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1456/2947] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:00 2022] DELETE /identity/v3/users/598884c9d0964ad6992f79eaf770507d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:01.072997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.073973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.074319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.089112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e40a-02de-4f73-a4b0-8621e2228077 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.089439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e40a-02de-4f73-a4b0-8621e2228077 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.090566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e40a-02de-4f73-a4b0-8621e2228077 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.092358 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1457/2948] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:57:01.101023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.101320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.102672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.115210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:01.116498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.146538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:01.152853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.207367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1492/2949] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:01.278386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:01.280407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.371314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1458/2950] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:01.402720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:01.404484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.425355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7582cf-2c5f-477b-9f4f-ccee128575b9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:01.428265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b2ae-ac90-4c00-bf50-c84bdf17361d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:01.435800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:01.436823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.437299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.438184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.442520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:01.443661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.444036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.444409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.451864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:01.453848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:01.471058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:01.473401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:01.478513 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1493/2951] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 20:57:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:01.509581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1459/2952] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:57:01.735929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:01.746602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.751276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:01.754070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:01.891515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:01.943029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd7f4-84ef-4795-8c22-3c1095213c4d service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:01.954348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:01.955636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.956668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.957050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] PATH_INFO: `/v3/projects/84c448aaa2a549c8a333b029ea89b104` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.959399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c448aaa2a549c8a333b029ea89b104)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:01.961955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:01.974865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe67d0-3613-43e2-8948-b2995bc4d4ed service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:01.980895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:01.982349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:01.982875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:01.983360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] PATH_INFO: `/v3/users/7cd8c77ab6374489bcddb296fffcecb7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:01.988630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd8c77ab6374489bcddb296fffcecb7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:01.991139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.094603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c448aaa2a549c8a333b029ea89b104', 'request_id': 'req-4868da55-fcc6-412d-9915-54fc911fcaea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.112704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c448aaa2a549c8a333b029ea89b104', 'request_id': 'req-4868da55-fcc6-412d-9915-54fc911fcaea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.120551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c448aaa2a549c8a333b029ea89b104', 'request_id': 'req-4868da55-fcc6-412d-9915-54fc911fcaea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.140686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] The token cache is being invalidate because project 84c448aaa2a549c8a333b029ea89b104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:02.141122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.142280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4868da55-fcc6-412d-9915-54fc911fcaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.148802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd8c77ab6374489bcddb296fffcecb7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.150394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1494/2953] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:01 2022] DELETE /identity/v3/projects/84c448aaa2a549c8a333b029ea89b104 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:02.153135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd8c77ab6374489bcddb296fffcecb7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.156040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.156438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.156838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.167549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:02.176538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd8c77ab6374489bcddb296fffcecb7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.177965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd8c77ab6374489bcddb296fffcecb7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.189248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:02.190873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.208403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b5fcbf-433d-421b-81ba-349aa444f16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd8c77ab6374489bcddb296fffcecb7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.242951 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1460/2954] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:01 2022] DELETE /identity/v3/users/7cd8c77ab6374489bcddb296fffcecb7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:02.427878 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1495/2955] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:02.429827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.430595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.430704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.456478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:02.458104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.556774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1461/2956] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:02.561885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.566282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.567817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.576247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90f5c-0aa8-428d-ad63-620b27fa59de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.581628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d4689-8d22-4465-ae2d-3f1bd12859c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.583481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.584578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.584964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.585357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.586233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:02.586513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.586647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:02.587396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.587782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.588071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] PATH_INFO: `/v3/projects/acfa17945c2047fb99c3ad72a4854343` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.588707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.589292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acfa17945c2047fb99c3ad72a4854343)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:02.591284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.608617 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1496/2957] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:02.610421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.623836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b43d02-2a90-45c7-b1f9-f809d0338e09 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.633635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.634345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.634612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.634871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.635880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:02.640030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.679610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acfa17945c2047fb99c3ad72a4854343', 'request_id': 'req-d2af6336-117c-46da-be30-cda4971c1727'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.689471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acfa17945c2047fb99c3ad72a4854343', 'request_id': 'req-d2af6336-117c-46da-be30-cda4971c1727'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.691911 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1497/2958] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:57:02.696585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acfa17945c2047fb99c3ad72a4854343', 'request_id': 'req-d2af6336-117c-46da-be30-cda4971c1727'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.697215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.722993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] The token cache is being invalidate because project acfa17945c2047fb99c3ad72a4854343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:02.723361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.724237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d2af6336-117c-46da-be30-cda4971c1727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:02.727668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1462/2959] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:02 2022] DELETE /identity/v3/projects/acfa17945c2047fb99c3ad72a4854343 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:02.732177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd6b1-df90-446e-8ebe-ee2a4ca9c3bb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.732466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd6b1-df90-446e-8ebe-ee2a4ca9c3bb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.732745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fd6b1-df90-446e-8ebe-ee2a4ca9c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.757514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:02.758420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1e4fd6b1-df90-446e-8ebe-ee2a4ca9c3bb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:02.759880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e4fd6b1-df90-446e-8ebe-ee2a4ca9c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.796201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d7044-6f42-49f7-9d77-416e2ca071b4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.801471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.802720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.803033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.803655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.804200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:02.806238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.834926 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1498/2960] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:02.836392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.839427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.845449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:02.872163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f16f-1a91-4362-b1dd-4ee54443c524 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.872738 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1463/2961] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:02.881183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.881426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.881622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.907239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.909714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:02.911854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:02.913698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:02.915974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:02.918063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:02.919764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:02.921545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:02.931152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1464/2962] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:02.935118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.947122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1499/2963] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:02.949317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84474-f1a0-4957-9b78-a6558ff388e2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.959847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:02.987296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed667-4243-463b-86ce-b1f3daf0569c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:02.992960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:02.996821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.000039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.000644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.001121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.002232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:03.003097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.003615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.004173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.004314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.008022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.008220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.011244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.044676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1465/2964] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:57:03.049639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1500/2965] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:03.050768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.051816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.070235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c314cff-a50a-4d14-9131-3cb5f141ae20 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.072879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de378-5674-4e89-b02b-c379cb1cd809 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.078263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.079299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.079588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.080476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] PATH_INFO: `/v3/projects/ca038463eed94fa3aea2cf4eaa374e39/users/17e02e3197f64817820be68827a61f89/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.093837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.094964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.094964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.095487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.096268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.098304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.123561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca038463eed94fa3aea2cf4eaa374e39, user_id=17e02e3197f64817820be68827a61f89, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.130684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab9a94-5fb8-4e81-9265-b1403ef8ffc3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.155098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1466/2966] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:03 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:03.159444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.166388 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1501/2967] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:03 2022] PUT /identity/v3/projects/ca038463eed94fa3aea2cf4eaa374e39/users/17e02e3197f64817820be68827a61f89/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:03.178448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805676-97a8-4013-a481-4050fc498dae None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.179004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805676-97a8-4013-a481-4050fc498dae None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.179595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805676-97a8-4013-a481-4050fc498dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.260798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-03805676-97a8-4013-a481-4050fc498dae None None] MFA Rules not processed for user `17e02e3197f64817820be68827a61f89`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:03.262121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-03805676-97a8-4013-a481-4050fc498dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:03.312906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0645-862f-4a8f-8210-0def3e4a9274 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.327730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.329154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.329439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.330516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.334398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.338333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.396575 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1467/2968] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:03 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:03.399933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.411970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e35f-03de-4c61-a759-aa86dc2d53fa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.421427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.423767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.424123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.425607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.429892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.434360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.478254 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1468/2969] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:03.481059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.505325 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1502/2970] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:03.507580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f43d1d-a26e-4471-b19b-fe07feaf7a76 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.540944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.545763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.546879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.548079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.549377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.554511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5500ea-70d4-446a-ba94-001374156a85 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.602115 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1469/2971] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:03.610206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805676-97a8-4013-a481-4050fc498dae None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:03.648331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805676-97a8-4013-a481-4050fc498dae None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:03.656930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:03.657847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.658277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.658559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] PATH_INFO: `/v3/projects/f75f1e8eef91443294369c0972b330eb/users/99c2a174b33c40f9a419cf7eacf01796/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.695468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75f1e8eef91443294369c0972b330eb, user_id=99c2a174b33c40f9a419cf7eacf01796, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:03.701862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:03.733336 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1503/2972] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:03 2022] PUT /identity/v3/projects/f75f1e8eef91443294369c0972b330eb/users/99c2a174b33c40f9a419cf7eacf01796/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:03.747685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:03.749182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:03.760496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:03.852583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:03.859157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:04.119725 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1470/2973] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:04.187558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:04.190001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:04.314574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:04.331377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95b4f-b621-4bac-94e8-ffa5f2536278 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:04.349444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:04.350153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:04.350441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:04.351778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:04.373046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:04.375382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e870aa1-99c1-434b-998d-52e8d8a6f80b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:04.398636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:04.399300 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1504/2974] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:04.400222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:04.505327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:04.661515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f682ee-4720-4589-a18e-44c11d453a8f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:04.692126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:04.695084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:04.695369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:04.695678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:04.821083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:04.822721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c0476-e72c-46d3-96ac-1e6455cab79e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:04.833423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1471/2975] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:06.328064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:06.328064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:06.328064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:06.435459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:06.436854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:06.600458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1505/2976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:06.616352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:06.616894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:06.616894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:06.679193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:06.681783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:06.718591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1472/2977] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:07.226827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:07.229859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:07.254253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a774c-b598-4e08-a4ea-898ec4814404 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:07.262228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:07.263188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:07.263683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:07.264152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:07.277049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:07.280438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98d5d-2d91-4e89-94fc-c328d74fbb3f service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:07.294101 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1506/2978] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:07.821103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:07.852857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469149b-930b-47b1-affa-bc647300eec0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:07.864048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:07.865706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:07.867074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:07.867833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] PATH_INFO: `/v3/users/17e02e3197f64817820be68827a61f89` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:07.869332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e02e3197f64817820be68827a61f89)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:07.876510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:08.000254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e02e3197f64817820be68827a61f89'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:08.001563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e02e3197f64817820be68827a61f89'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:08.038877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e02e3197f64817820be68827a61f89'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:08.040291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e02e3197f64817820be68827a61f89'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:08.060307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e02e3197f64817820be68827a61f89'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:08.094981 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1473/2979] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:07 2022] DELETE /identity/v3/users/17e02e3197f64817820be68827a61f89 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:08.096434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:08.096935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:08.097416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:08.144076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:08.147653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:08.288590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1507/2980] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:08.300565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:08.302172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:08.374526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:08.444417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387ed0-ae80-48ec-8c72-1274bb9a440b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:08.450045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:08.451127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:08.451749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:08.453384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:08.469539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:08.471304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996e86-4a57-4e38-a93d-2edf23742128 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:08.486470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1474/2981] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:09.018854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.021850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:09.055369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc577a9-7753-4609-a756-a1e54c871cc2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.071445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.073303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.073587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.074338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] PATH_INFO: `/v3/projects/ca038463eed94fa3aea2cf4eaa374e39` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.076389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca038463eed94fa3aea2cf4eaa374e39)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.078813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.163311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca038463eed94fa3aea2cf4eaa374e39', 'request_id': 'req-3c399d3c-cbbd-439e-9d9d-6761d6115047'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:09.173569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca038463eed94fa3aea2cf4eaa374e39', 'request_id': 'req-3c399d3c-cbbd-439e-9d9d-6761d6115047'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:09.179728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:09.185737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca038463eed94fa3aea2cf4eaa374e39', 'request_id': 'req-3c399d3c-cbbd-439e-9d9d-6761d6115047'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:09.206025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] The token cache is being invalidate because project ca038463eed94fa3aea2cf4eaa374e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:09.206613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:09.207694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:09.210678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1508/2982] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:09 2022] DELETE /identity/v3/projects/ca038463eed94fa3aea2cf4eaa374e39 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:09.217751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f188-3f18-4a1f-a2e8-5c69e079a74d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.221729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f188-3f18-4a1f-a2e8-5c69e079a74d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.222263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17f188-3f18-4a1f-a2e8-5c69e079a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.257055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.258859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:09.262178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bb17f188-3f18-4a1f-a2e8-5c69e079a74d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:09.264510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bb17f188-3f18-4a1f-a2e8-5c69e079a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:09.352966 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1475/2983] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:09.372530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.377075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.377672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.402856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:09.404273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:09.410182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c399d3c-cbbd-439e-9d9d-6761d6115047 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.413592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1476/2984] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:09.418086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.425661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.426639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.427928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.428421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.430549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:09.431165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493d153-437d-49aa-b91a-7422bf9284f7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.439191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.441040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.443693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.445977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.447762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:09.448608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.451195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.466209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1477/2985] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:09.472560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.499440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe283e-c5d2-4856-a8ff-16d225dbdbd4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.505741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.506666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.507116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.507596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.508293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.510609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.570310 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1478/2986] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:09 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:09.571583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.577560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.580073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.618514 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1509/2987] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:09.784074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbafadd-1255-49bd-a7b8-b652246c4a5a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.801215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.803694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.804822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.805421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.806978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.810433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.860896 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1479/2988] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:09 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:09.862428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.877485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68670b98-7234-45b0-92ef-fd94c376cfd6 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.888251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.889935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.890224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.890502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.891246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.899115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.936435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:09.951620 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1510/2989] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:09.953392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e5400-b1e1-43b4-9d65-b0543043170a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:09.965654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:09.965654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:09.965654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:09.965654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:09.966067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:09.968022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3df13-2bbe-49f5-9790-5be038f32191 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:09.994667 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1480/2990] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:57:10.000344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:10.017328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d7b5-0c15-4de9-9ecd-dd6804635040 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:10.031580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:10.032773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:10.033059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:10.033331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] PATH_INFO: `/v3/projects/867cd3b05ecb4c93a28ab7a55928789b/users/be44957fa2304f52a8d34bdac9eaca4f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:10.075312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=867cd3b05ecb4c93a28ab7a55928789b, user_id=be44957fa2304f52a8d34bdac9eaca4f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:10.080953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:10.111923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1511/2991] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:09 2022] PUT /identity/v3/projects/867cd3b05ecb4c93a28ab7a55928789b/users/be44957fa2304f52a8d34bdac9eaca4f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:10.117034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7d55-5ffa-4895-9de7-be2e158f3cfb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:10.117658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7d55-5ffa-4895-9de7-be2e158f3cfb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:10.118017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be7d55-5ffa-4895-9de7-be2e158f3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:10.128738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:10.164561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-23be7d55-5ffa-4895-9de7-be2e158f3cfb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:10.167218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-23be7d55-5ffa-4895-9de7-be2e158f3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:10.411555 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1481/2992] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:10.426087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:10.428259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:10.626314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:10.681110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc75d0-5a5f-4df9-a653-3b1d309a2e3f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:10.689698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:10.691220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:10.705284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:10.705580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:10.734613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:10.738077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:10.790683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1512/2993] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:12.777975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f311b-c0bc-4bcd-ac79-40f1672877c2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:12.778867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f311b-c0bc-4bcd-ac79-40f1672877c2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:12.779164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f311b-c0bc-4bcd-ac79-40f1672877c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:12.817201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a32f311b-c0bc-4bcd-ac79-40f1672877c2 None None] MFA Rules not processed for user `71d29871def3409f89efcda0e82a4ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:12.818728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a32f311b-c0bc-4bcd-ac79-40f1672877c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:12.992772 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1482/2994] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:20.765998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:22.456283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:22.459306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:22.499102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdb3c-d765-4045-b813-0715cce54b8b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:22.521060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:22.522275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:22.523264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:22.524278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] PATH_INFO: `/v3/users/3eef1a5b965a4d26adaed7af3344e7c9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:22.529273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eef1a5b965a4d26adaed7af3344e7c9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:22.532698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:22.634208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eef1a5b965a4d26adaed7af3344e7c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:22.658326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eef1a5b965a4d26adaed7af3344e7c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:22.659090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eef1a5b965a4d26adaed7af3344e7c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:22.661643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eef1a5b965a4d26adaed7af3344e7c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:22.688150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eef1a5b965a4d26adaed7af3344e7c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:22.721148 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1513/2995] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:22 2022] DELETE /identity/v3/users/3eef1a5b965a4d26adaed7af3344e7c9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:22.726493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687e50-72ae-4405-a186-e9add7cb56d3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:22.727353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687e50-72ae-4405-a186-e9add7cb56d3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:22.727811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687e50-72ae-4405-a186-e9add7cb56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:22.780426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d9687e50-72ae-4405-a186-e9add7cb56d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:22.781681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9687e50-72ae-4405-a186-e9add7cb56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:22.983232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1483/2996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:23.077722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:23.079247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:23.257371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7650-50b2-407d-b32a-b5cccc113173 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:23.257911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7650-50b2-407d-b32a-b5cccc113173 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:23.258277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7650-50b2-407d-b32a-b5cccc113173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:23.295891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afae08-999f-4548-8976-02c316b3d916 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:23.321161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:23.322155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:23.322641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:23.323079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:23.362479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:23.364570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04feaa-d2c5-4109-9005-7d9aa315a54e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:23.374179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0d1a7650-50b2-407d-b32a-b5cccc113173 None None] MFA Rules not processed for user `be44957fa2304f52a8d34bdac9eaca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:23.377561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d1a7650-50b2-407d-b32a-b5cccc113173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:23.399788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1514/2997] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:23.494115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:23.582016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:23.583085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:23.583589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:23.590111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1484/2998] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:23.623401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] MFA Rules not processed for user `be44957fa2304f52a8d34bdac9eaca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:23.624986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:23.644703 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1515/2999] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:23.878810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:23.880320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:23.880816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:23.904674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] MFA Rules not processed for user `e25328c90d26437a85d8d5509437ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:23.906359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:23.950072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:23.953472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:24.096099 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1485/3000] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:24.193958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460002d9-f6b4-4c66-8dd5-575ab2ac4f04 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:24.202216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:24.203569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:24.204100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:24.205252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:24.211763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:24.238493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:24.240740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:24.281409 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1516/3001] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:57:25.082105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:25.083869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:25.117634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbc88-87a5-4555-8598-e3f68c1992d7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:25.125320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:25.126964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:25.127479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:25.128497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] PATH_INFO: `/v3/projects/007f08ee799d431fb8d18c31dd5991e0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:25.131215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] RBAC: Authorizing `identity:delete_project(project_id=007f08ee799d431fb8d18c31dd5991e0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:25.135164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:25.267658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007f08ee799d431fb8d18c31dd5991e0', 'request_id': 'req-e17c5727-fcd1-4cf7-bc6a-82b28704409d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.290646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007f08ee799d431fb8d18c31dd5991e0', 'request_id': 'req-e17c5727-fcd1-4cf7-bc6a-82b28704409d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.302565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007f08ee799d431fb8d18c31dd5991e0', 'request_id': 'req-e17c5727-fcd1-4cf7-bc6a-82b28704409d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.331474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] The token cache is being invalidate because project 007f08ee799d431fb8d18c31dd5991e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:25.331744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.332638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.334308 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1486/3002] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:25 2022] DELETE /identity/v3/projects/007f08ee799d431fb8d18c31dd5991e0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:25.338737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:25.353804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9d5-002d-41c1-a551-96ddc2be5b9c service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:25.510322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:25.513312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:25.533904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:25.534505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] PATH_INFO: `/v3/users/2a730ea1fa8d4f53888df1551d71d391` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:25.537869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a730ea1fa8d4f53888df1551d71d391)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:25.541147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:25.658787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a730ea1fa8d4f53888df1551d71d391'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.681877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a730ea1fa8d4f53888df1551d71d391'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.684025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a730ea1fa8d4f53888df1551d71d391'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.686157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a730ea1fa8d4f53888df1551d71d391'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.725001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-14ce2d3e-57a2-4f1b-af6b-62fdd46f5a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a730ea1fa8d4f53888df1551d71d391'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:25.781797 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1517/3003] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:25 2022] DELETE /identity/v3/users/2a730ea1fa8d4f53888df1551d71d391 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:26.338663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:26.341159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:26.367980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c5727-fcd1-4cf7-bc6a-82b28704409d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:26.520255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:26.521768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:26.522224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:26.522647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] PATH_INFO: `/v3/projects/54c29d5599644defa46fabaaca04860a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:26.524178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c29d5599644defa46fabaaca04860a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:26.526265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:26.548138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:26.652024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c29d5599644defa46fabaaca04860a', 'request_id': 'req-3619e372-c421-4e2f-abf7-4956642aceb4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:26.665653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c29d5599644defa46fabaaca04860a', 'request_id': 'req-3619e372-c421-4e2f-abf7-4956642aceb4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:26.685047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c29d5599644defa46fabaaca04860a', 'request_id': 'req-3619e372-c421-4e2f-abf7-4956642aceb4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:26.723442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] The token cache is being invalidate because project 54c29d5599644defa46fabaaca04860a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:26.725482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:26.727061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3619e372-c421-4e2f-abf7-4956642aceb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:26.732803 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1487/3004] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:26 2022] DELETE /identity/v3/projects/54c29d5599644defa46fabaaca04860a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:26.738044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:26.743292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:26.744028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:26.781010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:26.784488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:26.975625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1518/3005] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:26.987103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:26.988911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:26.989344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.034916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:27.036404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:27.065919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1488/3006] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:27.070438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.084569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a856a-57f9-4894-b03f-14dec0d6b4d1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.098133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.098834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.099117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.099418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.100193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:27.100498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.107892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.131748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:27.141131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.148399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1519/3007] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:27.152554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab50e04-b0b5-4a37-8f1f-e606a14c0df3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.173497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.174323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.175186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.175186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.175804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.189203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.306837 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1489/3008] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:27 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:57:27.312245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.341233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff438-2a24-4858-bb61-5a3ca9bb34e8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.369362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.379034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:27.558822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992ea6-6e08-4a70-9def-7a518849b092 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.559052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.559868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.560100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.560430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.561621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.564114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.567877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.568788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.569277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.569708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] PATH_INFO: `/v3/users/39e45a1e351c47bc8d9c9f317a7d915e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.571772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e45a1e351c47bc8d9c9f317a7d915e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.579179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.602161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1520/3009] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:27 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:27.607337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.628993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e255-ec7a-4e55-88ed-f7a044a5d4ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.643620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.644399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.644753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.645099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.646240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.649367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.650783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e45a1e351c47bc8d9c9f317a7d915e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:27.651642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e45a1e351c47bc8d9c9f317a7d915e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:27.665326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e45a1e351c47bc8d9c9f317a7d915e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:27.666361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e45a1e351c47bc8d9c9f317a7d915e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:27.675644 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1521/3010] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:27.681081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.684166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:27.686442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:27.689729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e45a1e351c47bc8d9c9f317a7d915e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:27.717161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1490/3011] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:27 2022] DELETE /identity/v3/users/39e45a1e351c47bc8d9c9f317a7d915e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:27.739067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021faa1-f78f-4559-9549-b8cea57aebf8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:27.926985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:27.927851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:27.928134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:27.929044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:27.930916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:27.935021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7b015-0d87-4515-b55f-ec016646ea9b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:27.968129 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1522/3012] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:27.968964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:27.984892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee4117-8235-4ff3-b169-ec0790343972 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:28.014159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:28.016454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:28.017794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:28.020498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] PATH_INFO: `/v3/projects/9790cb88d2df4d3da1e37763555785dc/users/9f796be3f93246d3942ed927c3c1db96/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:28.067753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9790cb88d2df4d3da1e37763555785dc, user_id=9f796be3f93246d3942ed927c3c1db96, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:28.071015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:28.099592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1491/3013] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:27 2022] PUT /identity/v3/projects/9790cb88d2df4d3da1e37763555785dc/users/9f796be3f93246d3942ed927c3c1db96/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:28.109929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:28.109929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:28.116397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:28.174936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] MFA Rules not processed for user `9f796be3f93246d3942ed927c3c1db96`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:28.177402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:28.414388 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1523/3014] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:28.419675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:28.619938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7808e-fce4-403c-bbd4-cc95ba6cf3a2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:28.640679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:28.653815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:28.654244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:28.654526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:28.657240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:28.663680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:28.730983 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1492/3015] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:28 2022] POST /identity/v3/projects => generated 379 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:28.737155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:28.755929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:28.772271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677876-8f4d-45ff-9c72-194d80681eff None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:28.883318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:28.885736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:28.886075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:28.886421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:28.889276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:28.893870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:28.954652 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1524/3016] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:28 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:28.959045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:28.978664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7919c-5630-48bb-bc3c-bffadbbaf8bb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:28.994612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:28.997248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:28.998458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:28.998886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.001101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.005052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.039968 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1493/3017] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:29.044705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.062657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff42f49-48d4-42fc-b5f4-2ff500c07710 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:29.072192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:29.072817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.073093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.073334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] PATH_INFO: `/v3/projects/dc82521bba4e482b91903d8641aa6582/users/0527593d087f488da14fa2155f36deee/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.110381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc82521bba4e482b91903d8641aa6582, user_id=0527593d087f488da14fa2155f36deee, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.115295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.138456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.141464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:29.153042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1525/3018] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:29 2022] PUT /identity/v3/projects/dc82521bba4e482b91903d8641aa6582/users/0527593d087f488da14fa2155f36deee/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:29.154090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.183609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde2f8a-18fa-4dc0-8d96-434cdd37a718 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:29.396338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585378-0f0d-4e86-87ba-ab2973501a18 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:29.404398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:29.406153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.406449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.406836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.407824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.410163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03bc0a-72eb-4fa7-b4e0-a07216a7e266 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.425056 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1526/3019] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:29.427763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.429378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.429671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.437688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:29.443762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.444649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.446519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] PATH_INFO: `/v3/projects/6707eb81235a4370a48c97279b7cfd21` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.456057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6707eb81235a4370a48c97279b7cfd21)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.462495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.482503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] MFA Rules not processed for user `be44957fa2304f52a8d34bdac9eaca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:29.484139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:29.585502 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1527/3020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:29.587013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.602690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328ff9a-e6c8-4047-8aa4-67c0bdca29b6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:29.603938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:29.628881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6707eb81235a4370a48c97279b7cfd21', 'request_id': 'req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:29.629287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:29.660677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6707eb81235a4370a48c97279b7cfd21', 'request_id': 'req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:29.682175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6707eb81235a4370a48c97279b7cfd21', 'request_id': 'req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:29.734496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:29.735667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.736129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.736419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] PATH_INFO: `/v3/projects/dc82521bba4e482b91903d8641aa6582/users/0527593d087f488da14fa2155f36deee/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.738729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc82521bba4e482b91903d8641aa6582, user_id=0527593d087f488da14fa2155f36deee, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.741529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.744344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] The token cache is being invalidate because project 6707eb81235a4370a48c97279b7cfd21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:29.744643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:29.750274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:29.759000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1494/3021] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:29 2022] DELETE /identity/v3/projects/6707eb81235a4370a48c97279b7cfd21 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:29.759000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.759000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:29.763241 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1528/3022] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:29 2022] PUT /identity/v3/projects/dc82521bba4e482b91903d8641aa6582/users/0527593d087f488da14fa2155f36deee/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:29.763757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:29.775271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:29.954398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b5a0b-8307-4b88-8f69-8c96fc10c617 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:29.965262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:29.966216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:29.966497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:29.966891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] PATH_INFO: `/v3/users/dc53aee23f114c189811e3abb323a204` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:29.971576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc53aee23f114c189811e3abb323a204)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:29.974781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:29.991917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04bcd6-2fca-4422-ac21-e83e8b1dd222 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:30.098363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc53aee23f114c189811e3abb323a204'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:30.120238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc53aee23f114c189811e3abb323a204'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:30.122699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc53aee23f114c189811e3abb323a204'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:30.125159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc53aee23f114c189811e3abb323a204'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:30.172620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4d79b082-67b4-4c82-8255-41df793aa0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc53aee23f114c189811e3abb323a204'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:30.188843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:30.190550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:30.190890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:30.201871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:30.208360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:30.216048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1529/3023] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:29 2022] DELETE /identity/v3/users/dc53aee23f114c189811e3abb323a204 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:30.218486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:30.218835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:30.220312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:30.289628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] MFA Rules not processed for user `0527593d087f488da14fa2155f36deee`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:30.292147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:30.385398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:30.504523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:30.506119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9df1fe-a19f-4ea0-a568-6946edbe3cf2 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:30.524150 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1530/3024] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:30.546051 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1495/3025] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:31.034743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:31.036984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:31.238294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d83184-6845-4294-b612-a38ce55d25d1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:31.251590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:31.252656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.253673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.253958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] PATH_INFO: `/v3/projects/45fe76ea85564cec9dcd88ffde256b9e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.255598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fe76ea85564cec9dcd88ffde256b9e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:31.257956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:31.354893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fe76ea85564cec9dcd88ffde256b9e', 'request_id': 'req-47d76038-6b47-4be9-ae20-41c8411fa8af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:31.404600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fe76ea85564cec9dcd88ffde256b9e', 'request_id': 'req-47d76038-6b47-4be9-ae20-41c8411fa8af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:31.430369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fe76ea85564cec9dcd88ffde256b9e', 'request_id': 'req-47d76038-6b47-4be9-ae20-41c8411fa8af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:31.455616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] The token cache is being invalidate because project 45fe76ea85564cec9dcd88ffde256b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:31.456027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:31.456985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:31.459914 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1531/3026] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:31 2022] DELETE /identity/v3/projects/45fe76ea85564cec9dcd88ffde256b9e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:31.466305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f28d3-119d-4b27-aa2d-662b1c5b0555 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.466605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f28d3-119d-4b27-aa2d-662b1c5b0555 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.467034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f28d3-119d-4b27-aa2d-662b1c5b0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.508906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1c3f28d3-119d-4b27-aa2d-662b1c5b0555 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:31.510919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c3f28d3-119d-4b27-aa2d-662b1c5b0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:31.534486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:31.540760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:31.544058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:31.625849 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1496/3027] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:31.634748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.635278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.635862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.665913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:31.668735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:31.686442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:31.691807 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1497/3028] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:31.696173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:31.718635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14acebd-fb6d-40f9-908e-173c02963cbe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:31.723049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d76038-6b47-4be9-ae20-41c8411fa8af admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:31.727306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:31.728407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.728894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.729507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.732521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:31.744223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:31.745220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.747217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.747502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.750099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:31.751755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:31.758581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:31.794473 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1498/3029] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:31.799168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:31.826229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013406d8-40ca-4d04-a1b3-a87de3cc863c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:31.840841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:31.841652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:31.846307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:31.846821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:31.848641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:31.849823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:31.896632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:31.898534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:31.910510 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1499/3030] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:31 2022] POST /identity/v3/projects => generated 395 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:57:31.911489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:31.932574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1532/3031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:32.032725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d1760-ccc9-4999-a837-2e208d4dc689 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:32.037955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:32.038790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.039172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.039571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.040535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:32.042739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:32.072138 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1500/3032] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:31 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:32.075865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:32.095914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0afd92-72c8-4fb6-91c8-219bd6074c74 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:32.102845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:32.103548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.103850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.104112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.104848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:32.106632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:32.117883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1533/3033] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:32.122149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:32.133290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b772e-cf5f-445d-b338-b9d3cfbb9a8e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:32.146567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:32.147208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.147492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.147791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.148554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:32.150230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c6bce-e534-4f70-ae76-0509084c8ec7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:32.173659 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1501/3034] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:32.177303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:32.192441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e067828-e8c1-4e86-bc8b-dbbfc92760c7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:32.198461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:32.199292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.209989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.210802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] PATH_INFO: `/v3/projects/5f72194d8a044e81a3a48e7716a1395f/users/c80f5171e36f498cb2601ae92861a94a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.235967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f72194d8a044e81a3a48e7716a1395f, user_id=c80f5171e36f498cb2601ae92861a94a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:32.240097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd8569-cbc3-4848-a604-2d2287e0956c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:32.271249 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1534/3035] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:32 2022] PUT /identity/v3/projects/5f72194d8a044e81a3a48e7716a1395f/users/c80f5171e36f498cb2601ae92861a94a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:32.289805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.290072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.290361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.293554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.293842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.294709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.342570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:32.348085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:32.351953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:32.353161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:32.498339 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1535/3036] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:32.516881 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1502/3037] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:32.534331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:32.535811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:32.620204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2db14-fb7e-4725-86b7-4b43558f787b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:32.628342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:32.628608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:32.628706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:32.629049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:32.640940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:32.647002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:32.649520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:32.663846 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1536/3038] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:32.921427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:32.924402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:32.933345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:33.028093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:33.030030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:33.153444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8ce34-bf17-49ec-b83c-6ba3f568a335 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:33.162207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:33.164155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:33.164444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:33.168869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:33.170827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:33.193976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44316dea-fd09-49b9-89f3-3ed2a5de1202 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:33.206954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:33.211946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:33.213683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:33.214129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:33.219020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:33.265817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:33.269004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d9b36-74f5-47a4-bbf7-5a0622dbb113 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:33.287392 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1537/3039] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:57:33.331844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:33.335590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fb8b8-ec80-4279-bd22-98c9b02088b9 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:33.370761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1503/3040] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:33.958204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:33.959667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:33.961407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:33.992543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:33.994660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:34.015294 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1538/3041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:34.457102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b746-dc30-4360-88d9-e74aeb96dba3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:34.457606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b746-dc30-4360-88d9-e74aeb96dba3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:34.457720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b746-dc30-4360-88d9-e74aeb96dba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:34.540747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b528b746-dc30-4360-88d9-e74aeb96dba3 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:34.542075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b528b746-dc30-4360-88d9-e74aeb96dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:34.552914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:34.554523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:34.575130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1504/3042] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:34.608478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eda97-43b0-47d2-ab4f-6fd6fc05fc88 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:34.629243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:34.633222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:34.633863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:34.634446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] PATH_INFO: `/v3/users/9f796be3f93246d3942ed927c3c1db96` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:34.637955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f796be3f93246d3942ed927c3c1db96)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:34.640710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:34.842640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f796be3f93246d3942ed927c3c1db96'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:34.874924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f796be3f93246d3942ed927c3c1db96'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:34.879958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f796be3f93246d3942ed927c3c1db96'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:34.883107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f796be3f93246d3942ed927c3c1db96'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:34.904369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:34.904369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:34.904369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:34.922294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71f3a558-33d4-4866-b9da-cc80422031c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f796be3f93246d3942ed927c3c1db96'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:34.939665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:34.943695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:34.958424 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1505/3043] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:34.963228 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1539/3044] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:34 2022] DELETE /identity/v3/users/9f796be3f93246d3942ed927c3c1db96 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:34.964320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255fa09-955f-45b3-9c4a-8aa0a5da2c38 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:34.964791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255fa09-955f-45b3-9c4a-8aa0a5da2c38 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:34.965295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255fa09-955f-45b3-9c4a-8aa0a5da2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:35.026143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f255fa09-955f-45b3-9c4a-8aa0a5da2c38 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:35.036611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f255fa09-955f-45b3-9c4a-8aa0a5da2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:35.119205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:35.162172 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1540/3045] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:35.251615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:35.253258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:35.266264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:35.266936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:35.267489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:35.277528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f5b6-8171-4211-a06c-96e1a12db327 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:35.304370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] MFA Rules not processed for user `99c2a174b33c40f9a419cf7eacf01796`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:35.308231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:35.411173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:35.412269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:35.414552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:35.415030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:35.442674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:35.451486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:35.483558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1506/3046] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:35.487597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1541/3047] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:37.293758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:37.303776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:37.354464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a0692-b8d6-4102-818d-74a541bb0109 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:37.378702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:37.379937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:37.385105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:37.385985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] PATH_INFO: `/v3/projects/9790cb88d2df4d3da1e37763555785dc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:37.391091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9790cb88d2df4d3da1e37763555785dc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:37.393541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:37.449728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:37.515952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9790cb88d2df4d3da1e37763555785dc', 'request_id': 'req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:37.540623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9790cb88d2df4d3da1e37763555785dc', 'request_id': 'req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:37.572461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9790cb88d2df4d3da1e37763555785dc', 'request_id': 'req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:37.614066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] The token cache is being invalidate because project 9790cb88d2df4d3da1e37763555785dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:37.614367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:37.618462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:37.620586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1507/3048] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:37 2022] DELETE /identity/v3/projects/9790cb88d2df4d3da1e37763555785dc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:37.627091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:37.642770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3a23f-a941-4615-9d8d-4ec0e9db7684 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:38.020530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:38.021982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:38.022552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:38.023052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] PATH_INFO: `/v3/users/0527593d087f488da14fa2155f36deee` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:38.024791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0527593d087f488da14fa2155f36deee)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:38.028385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:38.296223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0527593d087f488da14fa2155f36deee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:38.342130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0527593d087f488da14fa2155f36deee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:38.343149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0527593d087f488da14fa2155f36deee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:38.343879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0527593d087f488da14fa2155f36deee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:38.392778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0527593d087f488da14fa2155f36deee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:38.453214 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1542/3049] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:37 2022] DELETE /identity/v3/users/0527593d087f488da14fa2155f36deee => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:38.527171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:38.529572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:38.697355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef6707-e9a0-4f8b-8d79-e4dfabca4222 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:38.829411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:38.832147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:38.832887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:38.833539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:38.844916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:38.865609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:38.868397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8655f39-e9ab-4feb-8386-5822aea5f752 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:38.885214 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1508/3050] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:40.153117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:40.154863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:40.196493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:40.353026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908e3f-4d19-4f2b-bfe2-ffaaa848cd33 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:40.365581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:40.367433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:40.368253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:40.368549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] PATH_INFO: `/v3/projects/dc82521bba4e482b91903d8641aa6582` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:40.370227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc82521bba4e482b91903d8641aa6582)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:40.377153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:40.482593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc82521bba4e482b91903d8641aa6582', 'request_id': 'req-09207f6c-f24f-45e4-9657-fa055d8ed57e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:40.508403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc82521bba4e482b91903d8641aa6582', 'request_id': 'req-09207f6c-f24f-45e4-9657-fa055d8ed57e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:40.524642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc82521bba4e482b91903d8641aa6582', 'request_id': 'req-09207f6c-f24f-45e4-9657-fa055d8ed57e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:40.570044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] The token cache is being invalidate because project dc82521bba4e482b91903d8641aa6582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:40.570307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:40.571759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-09207f6c-f24f-45e4-9657-fa055d8ed57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:40.580179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1543/3051] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:40 2022] DELETE /identity/v3/projects/dc82521bba4e482b91903d8641aa6582 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:57:40.588244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:40.590122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:40.590718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:40.622860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:40.624783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:40.763828 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1509/3052] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:40.772029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:40.772320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:40.772647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:40.827106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:40.830636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:40.855494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1544/3053] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:40.858528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:40.883059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99026b-f8e3-4f58-b6dd-a2f114239c07 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:40.897705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:40.898407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:40.898803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:40.899091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:40.902975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:40.903793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:40.907678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:40.930324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:40.964054 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1510/3054] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:40.968643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:40.987836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50c00e-9c23-416d-834b-430772e3ed1d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.011695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.015617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.016025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.016381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.019973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:41.025501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:41.078051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:41.085825 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1545/3055] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:40 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:57:41.094120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1225-b6f4-4284-9149-d394383b9820 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.338953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.340101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.340101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.340297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.343320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:41.345434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:41.418847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1511/3056] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:41 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:41.421323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:41.433675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d87d3-2e80-4b31-a2b4-2aff9527a3ba admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.438887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.439612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.439898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.440413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.441333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:41.443128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:41.460634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1546/3057] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:41.464500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:41.478944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f642db-9bc7-4cfd-a1b4-e3c996f9985f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.488880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.489624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.489922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.490258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.491901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:41.493935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3cac4-1650-4616-9c00-19b6f4e402d9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:41.511114 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1512/3058] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:57:41.513614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:41.530575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7af2-4532-4eb1-89d1-fb922d193e67 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.536587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.537543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.537831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.539792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] PATH_INFO: `/v3/projects/89428fdfbe7748018280e169ceebc0df/users/fb5163967e1f4f14b64ed72ffbf64db8/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.565141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89428fdfbe7748018280e169ceebc0df, user_id=fb5163967e1f4f14b64ed72ffbf64db8, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:41.569436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:41.600965 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1547/3059] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:41 2022] PUT /identity/v3/projects/89428fdfbe7748018280e169ceebc0df/users/fb5163967e1f4f14b64ed72ffbf64db8/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:41.606502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.607045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.607272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:41.631923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:41.633747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:41.789814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1513/3060] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:41.824767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:41.827061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:41.936268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:41.977862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511d55-f8ca-4100-843a-d9a788f65456 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:41.991765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:41.993491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:41.994352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:41.994825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:42.020522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:42.022794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9457ac-98bd-427a-a040-6bec2801d1ef service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:42.055317 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1548/3061] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:42.539117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:42.541746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:42.574940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edea02-0b81-4b85-b13f-2af21fdb5b6a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:42.585412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:42.587231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:42.587534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:42.588286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:42.593332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:42.650846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:42.655561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:42.689746 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1514/3062] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:43.892671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:43.892671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:43.893253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:43.958197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] MFA Rules not processed for user `fb5163967e1f4f14b64ed72ffbf64db8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:43.959850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:44.113742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1549/3063] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:44.450874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:44.456443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:44.680286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:44.728542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1dcdd-1918-45cc-85c0-4302be40e301 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:44.748300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:44.749233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:44.749676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:44.750107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:44.770089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:44.772592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:44.786898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1515/3064] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:46.211297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:46.215463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:46.279471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a290c-c80a-42a1-ac4e-ea2a171e023b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:46.291343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:46.294492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:46.295182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:46.295775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] PATH_INFO: `/v3/users/99c2a174b33c40f9a419cf7eacf01796` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:46.299278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c2a174b33c40f9a419cf7eacf01796)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:46.312487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:46.462083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c2a174b33c40f9a419cf7eacf01796'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:46.477499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c2a174b33c40f9a419cf7eacf01796'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:46.479367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c2a174b33c40f9a419cf7eacf01796'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:46.480897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c2a174b33c40f9a419cf7eacf01796'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:46.496171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-807747fc-2617-432e-a8fa-cf2c5d1ba537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c2a174b33c40f9a419cf7eacf01796'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:46.531467 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1550/3065] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:57:46 2022] DELETE /identity/v3/users/99c2a174b33c40f9a419cf7eacf01796 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:47.121162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:47.151932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d60fb-677a-4ce4-9eb5-db4e8eef3cba service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:47.359928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:47.361376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.361892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.362347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] PATH_INFO: `/v3/projects/f75f1e8eef91443294369c0972b330eb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.368626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75f1e8eef91443294369c0972b330eb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:47.371816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:47.474228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75f1e8eef91443294369c0972b330eb', 'request_id': 'req-e1085b3c-2623-4ca5-8375-43f3e950faea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:47.492088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75f1e8eef91443294369c0972b330eb', 'request_id': 'req-e1085b3c-2623-4ca5-8375-43f3e950faea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:47.504174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75f1e8eef91443294369c0972b330eb', 'request_id': 'req-e1085b3c-2623-4ca5-8375-43f3e950faea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:47.538984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] The token cache is being invalidate because project f75f1e8eef91443294369c0972b330eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:57:47.539376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:47.540121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1085b3c-2623-4ca5-8375-43f3e950faea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:57:47.544358 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1516/3066] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:57:47 2022] DELETE /identity/v3/projects/f75f1e8eef91443294369c0972b330eb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:47.553288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ea9a-70b9-498b-b671-6e995e7ade71 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.554391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ea9a-70b9-498b-b671-6e995e7ade71 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.554921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ea9a-70b9-498b-b671-6e995e7ade71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.588283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-85c1ea9a-70b9-498b-b671-6e995e7ade71 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:47.590970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85c1ea9a-70b9-498b-b671-6e995e7ade71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:47.611110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082feb8-c039-44bc-9f72-2a62a64fbcb2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.611502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082feb8-c039-44bc-9f72-2a62a64fbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.611733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082feb8-c039-44bc-9f72-2a62a64fbcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.684112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5082feb8-c039-44bc-9f72-2a62a64fbcb2 None None] MFA Rules not processed for user `c80f5171e36f498cb2601ae92861a94a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:47.687915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5082feb8-c039-44bc-9f72-2a62a64fbcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:47.688819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:47.754626 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1551/3067] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:47.756383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849cc2-3f3b-4f8f-ad0d-10500b483202 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.756857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849cc2-3f3b-4f8f-ad0d-10500b483202 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.757727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849cc2-3f3b-4f8f-ad0d-10500b483202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.817947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-23849cc2-3f3b-4f8f-ad0d-10500b483202 None None] MFA Rules not processed for user `fb5163967e1f4f14b64ed72ffbf64db8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:47.826497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-23849cc2-3f3b-4f8f-ad0d-10500b483202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:47.915261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1517/3068] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:47.916831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.917120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.917482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.938810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:47.955054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1552/3069] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:47.956824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:47.957556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:47.958005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:47.963143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:47.965614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:47.984509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] MFA Rules not processed for user `c80f5171e36f498cb2601ae92861a94a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:47.987464 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1518/3070] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:47.988375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:47.991750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.010697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1553/3071] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:48.023457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be672af-38c8-41a7-8df7-f13c1b77be82 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.044324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.045064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.052085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.052582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.053654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:57:48.054124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.059728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.094102 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1519/3072] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:57:48.097790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.116350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b8d4-dcc8-451a-be83-2a34caf94897 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.126494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.127220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.127601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.127807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.128699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.139616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.191899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1554/3073] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:57:48 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:48.193179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.207533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126480-5355-49b5-a991-8bc6df488fb3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.229617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.231787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:48.313712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.313712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.314173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.314462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.315381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.317576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.382731 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1520/3074] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:57:48 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:57:48.388143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.401706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542de0e-7b92-4ade-84bb-936edddd1f77 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.408741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.410844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.411409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.411982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.413968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.416522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.424582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b88fbd-6fd0-4fef-b327-360da74d47ec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.440532 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1521/3075] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:48.442656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.448283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.449216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.449500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.449769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.456070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ff1f-c4e7-4254-a01c-9e5ffe733613 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.462491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.463387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.463804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.464300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.465602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.467612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.483917 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1522/3076] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:57:48.488186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:48.502847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e295a-dd10-4458-9b07-64fdefe389a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:48.508254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:48.509490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.509984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.510548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] PATH_INFO: `/v3/projects/cf5eb8af4980464f85c99b9986abf8cb/users/93597ab23b2a41db94d09d78de7659d2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.542731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5eb8af4980464f85c99b9986abf8cb, user_id=93597ab23b2a41db94d09d78de7659d2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.546153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0b35e-4dc9-4194-be47-27604da30f6e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.552083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:48.553756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432a9d7-c3d6-45c9-88a3-9dcb9575d262 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:48.560522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:48.569977 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1555/3077] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:57:48.572305 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1523/3078] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:57:48 2022] PUT /identity/v3/projects/cf5eb8af4980464f85c99b9986abf8cb/users/93597ab23b2a41db94d09d78de7659d2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:57:48.589762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.590182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.590636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.676047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] MFA Rules not processed for user `93597ab23b2a41db94d09d78de7659d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:48.677665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:48.819570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1556/3079] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:57:48.829146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:48.829443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:48.829755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:48.850421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] MFA Rules not processed for user `93597ab23b2a41db94d09d78de7659d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:48.852541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:48.863891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1524/3080] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:49.970373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:49.972059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:50.270134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdba14a-2a0c-4516-a76c-ac7202040095 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:50.304740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:50.306079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:50.310868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:50.312579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:50.372693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:50.378634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec947a-bd99-42f9-a9b1-63cfa4242d4f service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:50.417208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1557/3081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:51.414776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:51.462503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2fa1a-aa4a-4fea-a1f5-31aa714c5f45 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:51.479125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:51.483543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:51.484114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:51.484575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:51.490719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:51.557535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:51.572941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dab14-0b8b-44ae-bf55-79b386afa805 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:51.627291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1525/3082] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:51.757514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f75fc-28dd-440a-9bf3-3c1eb477f2dd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:51.758414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f75fc-28dd-440a-9bf3-3c1eb477f2dd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:51.758845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f75fc-28dd-440a-9bf3-3c1eb477f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:51.804896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d07f75fc-28dd-440a-9bf3-3c1eb477f2dd None None] MFA Rules not processed for user `93597ab23b2a41db94d09d78de7659d2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:51.811452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d07f75fc-28dd-440a-9bf3-3c1eb477f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:51.841412 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1558/3083] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:53.335018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:53.335489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:53.343219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:53.346215 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1526/3084] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:57:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:57:53.352466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:53.352958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:53.353268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:53.427414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:57:53.434347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:53.603924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1559/3085] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:57:53.628151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:53.631038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:53.675029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e0328-a8da-446f-a8f1-e4b297ba384b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:53.688461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:53.690159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:53.690706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:53.691384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:53.718126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:53.732850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:53.755325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1527/3086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:55.793076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:55.799669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:55.807849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e1c1-0361-4eb8-9ab7-1029a6b9ce6e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:55.813579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e88505-72d4-4386-878f-3e458693566f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:55.814359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88505-72d4-4386-878f-3e458693566f service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:55.814701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88505-72d4-4386-878f-3e458693566f service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:55.815037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e88505-72d4-4386-878f-3e458693566f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:55.817065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-28e88505-72d4-4386-878f-3e458693566f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:55.831120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e88505-72d4-4386-878f-3e458693566f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:55.832918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e88505-72d4-4386-878f-3e458693566f service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:55.846670 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1560/3087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:03.606025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:03.607540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:03.678372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:03.685166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b152a1-2c11-485d-9498-96bb021bac50 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:03.691117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:03.692139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:03.692426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:03.692739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] PATH_INFO: `/v3/users/246c32bb6dfc4692beeac1675dd13293` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:03.694043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=246c32bb6dfc4692beeac1675dd13293)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:03.696194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:03.782594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246c32bb6dfc4692beeac1675dd13293'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.783423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246c32bb6dfc4692beeac1675dd13293'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.794332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246c32bb6dfc4692beeac1675dd13293'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.795256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246c32bb6dfc4692beeac1675dd13293'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.815381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246c32bb6dfc4692beeac1675dd13293'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.838570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1528/3088] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:03 2022] DELETE /identity/v3/users/246c32bb6dfc4692beeac1675dd13293 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:03.843565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:03.844495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:03.844931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:03.879007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:03.880624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:03.960840 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1561/3089] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:04.007119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:04.009831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:04.149251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388331ae-7f42-487e-9562-4d4fa248d2cd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:04.157968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:04.158932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:04.160271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:04.160708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:04.181115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:04.183025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:04.200726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1529/3090] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:04.656623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:04.658175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:04.680782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1269-c62b-4ff8-b29e-01d29dea8263 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:04.691585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:04.693031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:04.693572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:04.694297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] PATH_INFO: `/v3/projects/9fa1452a653049abab26a782a7d36583` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:04.695844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa1452a653049abab26a782a7d36583)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:04.698642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:04.772190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa1452a653049abab26a782a7d36583', 'request_id': 'req-a52f4216-7834-4fdb-ac84-19ad200b3327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.780075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa1452a653049abab26a782a7d36583', 'request_id': 'req-a52f4216-7834-4fdb-ac84-19ad200b3327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.785973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa1452a653049abab26a782a7d36583', 'request_id': 'req-a52f4216-7834-4fdb-ac84-19ad200b3327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.803076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] The token cache is being invalidate because project 9fa1452a653049abab26a782a7d36583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:04.803440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.804146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.805732 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1562/3091] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:04 2022] DELETE /identity/v3/projects/9fa1452a653049abab26a782a7d36583 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:04.810154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:04.820717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8a2cf-c6f7-467a-8ac0-9aeb2b4e64f8 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:04.887619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:04.888522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:04.888804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:04.889080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] PATH_INFO: `/v3/users/fd9a33040bf54d3b81c7d41c51e3b58e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:04.890632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9a33040bf54d3b81c7d41c51e3b58e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:04.892612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:04.915764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:04.954325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9a33040bf54d3b81c7d41c51e3b58e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.955429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9a33040bf54d3b81c7d41c51e3b58e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.962853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9a33040bf54d3b81c7d41c51e3b58e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.963574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9a33040bf54d3b81c7d41c51e3b58e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.978631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3ec6b8e8-95e7-4cce-8b28-56a57cc9f318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9a33040bf54d3b81c7d41c51e3b58e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:04.999705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1530/3092] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:04 2022] DELETE /identity/v3/users/fd9a33040bf54d3b81c7d41c51e3b58e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:05.332569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:05.334120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:05.350051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f4216-7834-4fdb-ac84-19ad200b3327 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:05.421613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:05.422631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:05.422985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:05.423325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] PATH_INFO: `/v3/projects/348fba13f0894035849ca231b5ed317e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:05.424677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348fba13f0894035849ca231b5ed317e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:05.426858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:05.448005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:05.487614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348fba13f0894035849ca231b5ed317e', 'request_id': 'req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:05.495657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348fba13f0894035849ca231b5ed317e', 'request_id': 'req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:05.507925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348fba13f0894035849ca231b5ed317e', 'request_id': 'req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:05.528685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] The token cache is being invalidate because project 348fba13f0894035849ca231b5ed317e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:05.529026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:05.529900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e12545a-0351-4c3d-9ef0-0d2b54e41df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:05.531906 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1563/3093] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:05 2022] DELETE /identity/v3/projects/348fba13f0894035849ca231b5ed317e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:05.539033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:05.539323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:05.539631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:05.561375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:05.562725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:05.677166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1531/3094] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:58:05.686097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:05.686433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:05.686818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:05.708323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:05.709564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:05.732398 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1564/3095] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:05.736791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:05.748807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eb98e-f521-4c13-9304-30fe68873801 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:05.755360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:05.756137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:05.756481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:05.757209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:05.757628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:58:05.758001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:05.760183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:05.778699 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1532/3096] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:58:05.783039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:05.795301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e53c2-8646-47e7-92d8-af1cdafdf8ed None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:05.805466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:05.808010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:05.809800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:05.810517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:05.812203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:05.815897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:05.875815 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1565/3097] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:05 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:05.876019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:05.924603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802469-6b72-4d0c-ba3d-b0260942ed8b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.063083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.065403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.065911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.068310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.069937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.076433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.132206 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1533/3098] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:05 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:06.136174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.149113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd300e-05a9-4fbd-8ce8-1310523ab71e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.156626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.157958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.158288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.158546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.159343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.161089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.180202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.187641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1566/3099] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:06.196382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4ca9-433b-4d62-a463-eca5aca4a7ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.202846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.203691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.203894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.204232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.204888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.206597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b653eb1-e87c-4b41-8387-b7de53144786 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.235701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1534/3100] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:06.236781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.250678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cd41f-29e4-418b-a1d8-aa8b2ecfce50 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.274472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.275438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.275808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.276032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] PATH_INFO: `/v3/projects/fbf8c0a57b514a0f9b42a2fcfd3070bf/users/d3508546117f459a9a0b21da6b4a07f1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.304537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf8c0a57b514a0f9b42a2fcfd3070bf, user_id=d3508546117f459a9a0b21da6b4a07f1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.309409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.339522 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1567/3101] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:06 2022] PUT /identity/v3/projects/fbf8c0a57b514a0f9b42a2fcfd3070bf/users/d3508546117f459a9a0b21da6b4a07f1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:06.353783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.354000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.354326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.363447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:06.406376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.408276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:06.417931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] MFA Rules not processed for user `d3508546117f459a9a0b21da6b4a07f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:06.419218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:06.571257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1535/3102] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:06.575203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.584984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b90b9-4946-4433-9880-3ee185ee91cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.592350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.593596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.594510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.595279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.607666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:06.627424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.630114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.650966 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1568/3103] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:06.665366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7007-5e60-42b6-8d75-cd5e67c36d7b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.670312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.671080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.671426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.671796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.673307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.675323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.712270 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1536/3104] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:06 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:06.716745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.727910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95bac0-c663-48d0-95cb-4a969bd7392d service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.760975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:06.825163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.825874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.826324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.826602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.827680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.829804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.863597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1569/3105] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:06 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:06.864860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.877388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e4747-6d04-4dc2-89ff-b16f49996610 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.886317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.887301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.888690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.889368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.890614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.892878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.908689 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1537/3106] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:58:06.913729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.929905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7216ccb-eee5-4eac-93e3-62123644d19a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:06.939951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:06.940877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:06.941208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:06.941531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] PATH_INFO: `/v3/projects/d154ba7a416846888ed6614fa2973739/users/28ff09a1c4fa4fb1abfbc6d1bea970b2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:06.964821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154ba7a416846888ed6614fa2973739, user_id=28ff09a1c4fa4fb1abfbc6d1bea970b2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:06.967458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:06.996400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:06.998737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1570/3107] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:06 2022] PUT /identity/v3/projects/d154ba7a416846888ed6614fa2973739/users/28ff09a1c4fa4fb1abfbc6d1bea970b2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:07.011863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8d70-cae6-4f14-9758-ef45ca3ba9aa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:07.086868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:07.087707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:07.087996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:07.088272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:07.089160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:07.090954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf99b6-5c65-4f91-af37-ca8373cdeac7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:07.102046 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1538/3108] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:07.106124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:07.119782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719e01c-ac49-4d51-b00e-bcf59ec916cc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:07.125615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:07.126541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:07.128380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:07.128827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] PATH_INFO: `/v3/projects/d154ba7a416846888ed6614fa2973739/users/28ff09a1c4fa4fb1abfbc6d1bea970b2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:07.131191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154ba7a416846888ed6614fa2973739, user_id=28ff09a1c4fa4fb1abfbc6d1bea970b2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:07.134221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc827a-71d8-43cd-baa0-41f7dea65135 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:07.146284 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1571/3109] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:07 2022] PUT /identity/v3/projects/d154ba7a416846888ed6614fa2973739/users/28ff09a1c4fa4fb1abfbc6d1bea970b2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:07.157535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:07.157820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:07.158096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:07.164354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:07.190388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] MFA Rules not processed for user `28ff09a1c4fa4fb1abfbc6d1bea970b2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:07.191644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:07.288058 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1539/3110] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:07.289984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89327587-59c0-4f9f-b39f-ad661802911a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:07.290349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89327587-59c0-4f9f-b39f-ad661802911a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:07.290639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89327587-59c0-4f9f-b39f-ad661802911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:07.332102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89327587-59c0-4f9f-b39f-ad661802911a None None] MFA Rules not processed for user `d3508546117f459a9a0b21da6b4a07f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:07.333275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89327587-59c0-4f9f-b39f-ad661802911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:07.435351 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1572/3111] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:07.732349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:07.733792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:07.842020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e881e96-f350-4fdb-8b6e-03b799d30d28 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:07.851098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:07.852260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:07.852643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:07.853053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:07.864332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:07.866457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b253d-01ed-4a85-b186-9df112d92a6e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:07.879958 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1540/3112] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:15.649820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:15.650356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:15.650356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:15.651865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1573/3113] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:58:15.659808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1840fc-f39c-4a5f-828b-8e2192b49961 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:15.660420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1840fc-f39c-4a5f-828b-8e2192b49961 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:15.660420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1840fc-f39c-4a5f-828b-8e2192b49961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:15.680990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9c1840fc-f39c-4a5f-828b-8e2192b49961 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:15.682505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9c1840fc-f39c-4a5f-828b-8e2192b49961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:15.784232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1541/3114] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:15.807714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:15.809695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:15.830314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962a1d-d83b-44d7-a70f-9a26ae1445f7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:15.837136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:15.838001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:15.838277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:15.838628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:15.848087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:15.850410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:15.862681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1574/3115] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:18.047232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:18.047859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:18.047859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:18.084065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] MFA Rules not processed for user `c80f5171e36f498cb2601ae92861a94a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:18.085416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:18.091937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:18.233120 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1542/3116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:18.605166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:18.606886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:18.704063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09f892-ca08-4f19-b480-5aa19145ae19 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:18.709102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:18.710154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:18.710449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:18.710723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] PATH_INFO: `/v3/users/71d29871def3409f89efcda0e82a4ad3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:18.712036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d29871def3409f89efcda0e82a4ad3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:18.714041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:18.726888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:18.783613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d29871def3409f89efcda0e82a4ad3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:18.791397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d29871def3409f89efcda0e82a4ad3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:18.792647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d29871def3409f89efcda0e82a4ad3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:18.793389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d29871def3409f89efcda0e82a4ad3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:18.820028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d29871def3409f89efcda0e82a4ad3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:18.840280 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1575/3117] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:18 2022] DELETE /identity/v3/users/71d29871def3409f89efcda0e82a4ad3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:19.335499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:19.370652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f177a-176e-4398-970e-8f97a6b0e8a6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:19.450796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:19.451719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:19.452023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:19.452528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] PATH_INFO: `/v3/projects/a23b90f117684cff9d0ffccf630d8307` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:19.453775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23b90f117684cff9d0ffccf630d8307)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:19.455876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:19.537839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:19.539859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:19.540765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23b90f117684cff9d0ffccf630d8307', 'request_id': 'req-4dca140b-6082-4fdc-b8d6-393491c95ae9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.548909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23b90f117684cff9d0ffccf630d8307', 'request_id': 'req-4dca140b-6082-4fdc-b8d6-393491c95ae9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.556324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23b90f117684cff9d0ffccf630d8307', 'request_id': 'req-4dca140b-6082-4fdc-b8d6-393491c95ae9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.574278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] The token cache is being invalidate because project a23b90f117684cff9d0ffccf630d8307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:19.574665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.575372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.580669 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1543/3118] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:19 2022] DELETE /identity/v3/projects/a23b90f117684cff9d0ffccf630d8307 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:19.581997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:19.583559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:19.615290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e6cbf-536b-44c7-b11f-06805adb0b08 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:19.662644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:19.680223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:19.680223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:19.680223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:19.680223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:19.680756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:19.691647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca140b-6082-4fdc-b8d6-393491c95ae9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:19.692159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:19.693754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:19.697345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:19.703847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1576/3119] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:19.706428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:19.706702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:19.706987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] PATH_INFO: `/v3/users/858dec3e74964fd290e3bc622cd0dab2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:19.708813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=858dec3e74964fd290e3bc622cd0dab2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:19.710755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:19.794433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858dec3e74964fd290e3bc622cd0dab2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.795663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858dec3e74964fd290e3bc622cd0dab2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.806344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858dec3e74964fd290e3bc622cd0dab2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.807195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858dec3e74964fd290e3bc622cd0dab2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.825511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63bba10f-f51b-412d-b2a0-7769bc5c7e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858dec3e74964fd290e3bc622cd0dab2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:19.852548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1544/3120] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:19 2022] DELETE /identity/v3/users/858dec3e74964fd290e3bc622cd0dab2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:20.066129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:20.082882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ed14-4989-41e8-a513-fc9e9a9772cd service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:20.187671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:20.209100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:20.212375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.214122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.214749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] PATH_INFO: `/v3/projects/7df2a8ee35b644258b36388d425322ab` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.216839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df2a8ee35b644258b36388d425322ab)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:20.219495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:20.310609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df2a8ee35b644258b36388d425322ab', 'request_id': 'req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:20.325292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df2a8ee35b644258b36388d425322ab', 'request_id': 'req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:20.338800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df2a8ee35b644258b36388d425322ab', 'request_id': 'req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:20.363896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] The token cache is being invalidate because project 7df2a8ee35b644258b36388d425322ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:20.364193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:20.364963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fdbe621-8512-403f-bfa9-cb812a1d2dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:20.370757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1577/3121] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:20 2022] DELETE /identity/v3/projects/7df2a8ee35b644258b36388d425322ab => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:20.372776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658da27-1151-4078-bdcc-78824b57e961 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.373241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658da27-1151-4078-bdcc-78824b57e961 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.375336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658da27-1151-4078-bdcc-78824b57e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.398999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4658da27-1151-4078-bdcc-78824b57e961 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:20.400462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4658da27-1151-4078-bdcc-78824b57e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:20.564544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1545/3122] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:20.565845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.566218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.566399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.592887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:20.593530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.594674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:20.595168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.595463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.612145 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1578/3123] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:20.613487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:20.625149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76254e52-9f24-403b-a358-4707e1db3f40 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:20.631035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:20.631968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.632504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.632954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.633904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:58:20.635117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:20.637115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:20.640616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] MFA Rules not processed for user `e25328c90d26437a85d8d5509437ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:20.642440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:20.657976 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1579/3124] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:58:20.663572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:20.691141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9c6b-963b-4a48-bb7d-48b67ba60dc3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:20.696829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:20.697639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.698235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.699333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.700205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:20.702428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:20.759710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1580/3125] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:20 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:20.761817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:20.787191 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1546/3126] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:58:20.864610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1389-8195-4d32-9872-4c370ecd01c1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:20.872884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:20.873642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.873987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.874350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.875733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:20.882871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:20.928875 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1581/3127] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:20 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:20.933439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:20.952318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea84e4-2d90-4e8e-9fa4-87fedc95fd83 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:20.958790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:20.959961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:20.961860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:20.962374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:20.964387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:20.968288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:20.972884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:20.985799 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1547/3128] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:20.988782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:21.006407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d389-d6da-4b74-8ad0-d426fffc145b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:21.017293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:21.018619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:21.019362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:21.019688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:21.020616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:21.022634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02da1e9-7ab6-4ee8-9bee-ede52e58c73d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:21.043442 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1582/3129] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:21.047377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:21.061864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee94c1-b8c8-4133-a522-f4bb1c436c9f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:21.067495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:21.068737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:21.069023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:21.069306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] PATH_INFO: `/v3/projects/ca8653fe7077444c88c7be214c0ca8eb/users/5fb164815f7a4469a9c27fd3ad9212ca/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:21.090719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8653fe7077444c88c7be214c0ca8eb, user_id=5fb164815f7a4469a9c27fd3ad9212ca, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:21.094753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:21.109346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1548/3130] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:21 2022] PUT /identity/v3/projects/ca8653fe7077444c88c7be214c0ca8eb/users/5fb164815f7a4469a9c27fd3ad9212ca/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:21.114663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba396-8211-4889-97c9-1f9d0eb1566f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:21.114851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba396-8211-4889-97c9-1f9d0eb1566f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:21.115108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba396-8211-4889-97c9-1f9d0eb1566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:21.138005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d46ba396-8211-4889-97c9-1f9d0eb1566f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:21.139273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d46ba396-8211-4889-97c9-1f9d0eb1566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:21.149900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:21.240609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1583/3131] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:58:21.251003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:21.252953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:21.391549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefd12e-fb8d-4979-85ab-c41a105c4fee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:21.396412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:21.397595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:21.398886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:21.399591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:21.412215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:21.413679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:21.426525 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1549/3132] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:22.643963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:22.645935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:22.646954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:22.716603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] MFA Rules not processed for user `5fb164815f7a4469a9c27fd3ad9212ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:22.721818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:22.844030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1584/3133] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:23.163446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:23.166338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:23.315567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684883b1-1eea-4cf4-b8be-a422d5a087e6 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:23.322953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:23.324038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:23.324318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:23.324590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:23.335352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:23.337044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c7faa-b823-44bc-b8e6-05e84064128e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:23.349251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1550/3134] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:24.953496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:24.983980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c22af4-01b9-417d-b3bf-4f180ff26206 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:24.996512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:24.997723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:24.998212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:24.998756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:25.001879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:25.130768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:25.130768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:25.153256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1585/3135] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:29.784959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca479b21-fa5b-4a3b-a54f-f48bb67a090d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:29.785451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca479b21-fa5b-4a3b-a54f-f48bb67a090d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:29.785654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca479b21-fa5b-4a3b-a54f-f48bb67a090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:29.809193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ca479b21-fa5b-4a3b-a54f-f48bb67a090d None None] MFA Rules not processed for user `fb5163967e1f4f14b64ed72ffbf64db8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:29.810827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca479b21-fa5b-4a3b-a54f-f48bb67a090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:29.879612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1551/3136] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:35.141512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:35.506862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:35.508431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:35.526973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c190de-90d3-4b43-8ef8-9f449cfde237 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:35.534763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:35.535818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:35.536231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:35.536647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] PATH_INFO: `/v3/users/d3508546117f459a9a0b21da6b4a07f1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:35.538459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3508546117f459a9a0b21da6b4a07f1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:35.541153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:35.604063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3508546117f459a9a0b21da6b4a07f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:35.613976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3508546117f459a9a0b21da6b4a07f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:35.614832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3508546117f459a9a0b21da6b4a07f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:35.615530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3508546117f459a9a0b21da6b4a07f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:35.631345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3508546117f459a9a0b21da6b4a07f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:35.660752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1586/3137] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:35 2022] DELETE /identity/v3/users/d3508546117f459a9a0b21da6b4a07f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:35.665302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:35.665794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:35.665918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:35.682361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:35.689806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:35.691271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:35.788200 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1552/3138] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:35.817753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:35.819914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:35.903502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fc744-3591-4358-b3da-bb8c5eee9e7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:35.908994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:35.909962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:35.910620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:35.911054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:35.927476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:35.929543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:35.942461 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1587/3139] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:36.545182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:36.546886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:36.563589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529d434-9a38-4b2f-ba79-2cc2f714664a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:36.571484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:36.573963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:36.574467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:36.574748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] PATH_INFO: `/v3/projects/fbf8c0a57b514a0f9b42a2fcfd3070bf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:36.576238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf8c0a57b514a0f9b42a2fcfd3070bf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:36.578405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:36.661801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'request_id': 'req-3f036340-30de-4b8c-a5c0-22b90025d5de'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.674051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'request_id': 'req-3f036340-30de-4b8c-a5c0-22b90025d5de'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.683324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'request_id': 'req-3f036340-30de-4b8c-a5c0-22b90025d5de'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.703017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] The token cache is being invalidate because project fbf8c0a57b514a0f9b42a2fcfd3070bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:36.703390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.704090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.705724 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1553/3140] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:36 2022] DELETE /identity/v3/projects/fbf8c0a57b514a0f9b42a2fcfd3070bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:36.710108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:36.721172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d719ad-93f4-469a-895e-821c94db1c12 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:36.786334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:36.787233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:36.787545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:36.787876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] PATH_INFO: `/v3/users/28ff09a1c4fa4fb1abfbc6d1bea970b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:36.790435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ff09a1c4fa4fb1abfbc6d1bea970b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:36.792934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:36.813123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:36.853967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ff09a1c4fa4fb1abfbc6d1bea970b2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.862116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ff09a1c4fa4fb1abfbc6d1bea970b2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.862936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ff09a1c4fa4fb1abfbc6d1bea970b2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.863651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ff09a1c4fa4fb1abfbc6d1bea970b2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.878229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e046b8a1-99c0-4288-850c-7a457935f48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ff09a1c4fa4fb1abfbc6d1bea970b2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:36.895466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1588/3141] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:36 2022] DELETE /identity/v3/users/28ff09a1c4fa4fb1abfbc6d1bea970b2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:37.234505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:37.236291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:37.264361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036340-30de-4b8c-a5c0-22b90025d5de admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:37.341263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:37.342256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.342602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.342884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] PATH_INFO: `/v3/projects/d154ba7a416846888ed6614fa2973739` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.344136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d154ba7a416846888ed6614fa2973739)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:37.346109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:37.397294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:37.414223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd154ba7a416846888ed6614fa2973739', 'request_id': 'req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:37.423740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd154ba7a416846888ed6614fa2973739', 'request_id': 'req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:37.431947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd154ba7a416846888ed6614fa2973739', 'request_id': 'req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:37.452395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] The token cache is being invalidate because project d154ba7a416846888ed6614fa2973739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:37.452797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:37.453648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84c8f3ca-edae-4006-88c5-12fdb4bd40c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:37.460141 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1554/3142] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:37 2022] DELETE /identity/v3/projects/d154ba7a416846888ed6614fa2973739 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:37.461887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.462179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.462465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.483389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:37.484578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:37.608995 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1589/3143] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:37.617294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.617630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.617954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.641186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:37.642504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:37.667797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1555/3144] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:37.669554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:37.690118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48489d6b-5884-4a5b-8011-55acd2800530 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:37.697491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:37.698592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.698940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.699309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.700157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:58:37.701028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:37.702828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:37.720480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1590/3145] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:58:37.727327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:37.751369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b1571-6595-45f9-b7dd-1d074d20be9e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:37.761840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:37.763693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.765784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.766484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.769009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:37.772450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:37.843376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:37.843976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1556/3146] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:37 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:37.854185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2349dd-46b2-481b-bbf5-8f67b78f3049 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:37.974842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:37.976306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:37.977043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:37.977736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:37.980157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:37.985258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:38.034837 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1591/3147] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:37 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:38.038943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:38.054244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691c8d7-8035-4d2f-92a4-678a665278b0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:38.069676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:38.069676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:38.070192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:38.070790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:38.072289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:38.075679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:38.096713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1557/3148] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:38.100833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:38.115657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dfa1-7e23-4447-9486-773a1a4fc44f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:38.123194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:38.124283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:38.124633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:38.124914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:38.125728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:38.127391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044039da-0a9c-47de-bfcb-86c5cb1d8402 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:38.136333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:38.147748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1592/3149] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:58:38.148584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:38.165598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8217f36-eaae-450d-be12-7d33ff2c6ca8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:38.173296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:38.175215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:38.175813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:38.176195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] PATH_INFO: `/v3/projects/164d90f06576437c967ac86132b9a730/users/17c2fd62612a43b4b4838cbd45b22218/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:38.198468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164d90f06576437c967ac86132b9a730, user_id=17c2fd62612a43b4b4838cbd45b22218, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:38.202157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:38.224224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1558/3150] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:38 2022] PUT /identity/v3/projects/164d90f06576437c967ac86132b9a730/users/17c2fd62612a43b4b4838cbd45b22218/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:38.229433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde925-c357-45bc-a1ed-499fc9c25533 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:38.229831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde925-c357-45bc-a1ed-499fc9c25533 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:38.230210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dde925-c357-45bc-a1ed-499fc9c25533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:38.254737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d5dde925-c357-45bc-a1ed-499fc9c25533 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:38.257172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d5dde925-c357-45bc-a1ed-499fc9c25533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:38.372669 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1593/3151] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:38.378140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:38.382287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:38.468907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828689-e83a-4e53-948c-e0968215ee34 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:38.474514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:38.475784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:38.476680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:38.477038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:38.496667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:38.503349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:38.526312 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1559/3152] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:47.458078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:47.458647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:47.459044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:47.502265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] MFA Rules not processed for user `17c2fd62612a43b4b4838cbd45b22218`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:47.505047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:47.604023 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1594/3153] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:48.191190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:48.192932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:48.205986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb567e-90ff-4dd6-8fce-4508e6b46751 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:48.210671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:48.211750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:48.211889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:48.212130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] PATH_INFO: `/v3/users/5fb164815f7a4469a9c27fd3ad9212ca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:48.214407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb164815f7a4469a9c27fd3ad9212ca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:48.216376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:48.279850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb164815f7a4469a9c27fd3ad9212ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.280745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb164815f7a4469a9c27fd3ad9212ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.286356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:48.289324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb164815f7a4469a9c27fd3ad9212ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.290337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb164815f7a4469a9c27fd3ad9212ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.307373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64402b27-807f-44d9-95d1-f577c210856a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb164815f7a4469a9c27fd3ad9212ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.325006 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1560/3154] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:48 2022] DELETE /identity/v3/users/5fb164815f7a4469a9c27fd3ad9212ca => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:48.538641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:48.551281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f180c3-3573-46a2-806e-d9c7a0f35a18 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:48.623804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:48.624700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:48.624987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:48.625262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] PATH_INFO: `/v3/projects/ca8653fe7077444c88c7be214c0ca8eb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:48.626520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8653fe7077444c88c7be214c0ca8eb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:48.628590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:48.677339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:48.692052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8653fe7077444c88c7be214c0ca8eb', 'request_id': 'req-396d721f-154a-42bb-885e-c86ac4c39a5a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.699614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8653fe7077444c88c7be214c0ca8eb', 'request_id': 'req-396d721f-154a-42bb-885e-c86ac4c39a5a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.708207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8653fe7077444c88c7be214c0ca8eb', 'request_id': 'req-396d721f-154a-42bb-885e-c86ac4c39a5a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.726999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] The token cache is being invalidate because project ca8653fe7077444c88c7be214c0ca8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:48.727310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.728099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-396d721f-154a-42bb-885e-c86ac4c39a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:48.730282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1595/3155] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:48 2022] DELETE /identity/v3/projects/ca8653fe7077444c88c7be214c0ca8eb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:48.738055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:48.738399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:48.738626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:48.770599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:48.774278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:48.882455 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1561/3156] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:58:48.892333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:48.892620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:48.893105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:48.953421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:48.955264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:48.975716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1596/3157] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:48.979871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:48.996880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0361b-0279-4c79-a122-604fe344330f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.007534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.008318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.008674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.009053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.009959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:58:49.010467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.018052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.046934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1562/3158] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:58:49.048378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.067641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab26b-cea5-4a63-9467-ebddd1df5971 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.086184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.087336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.087819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.088584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.091374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.094385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.149149 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1597/3159] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:49 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:49.149649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.163328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814c99d-0e4a-4de2-9dd3-875dd1066103 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.251790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.253380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.253837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.254290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.255344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.257693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.285219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1563/3160] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:49 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:49.289788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.307450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c447662-2398-44ed-9e17-07cf48cea00d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.314620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.315768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.316214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.316654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.317636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.319735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.372179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1598/3161] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:49.375792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.391858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6da1e-24fc-4f58-9cf8-c40c4230c183 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.406815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.407525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.407841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.408124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.410328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.412272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.448826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1564/3162] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:49.450596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.478975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0bbf1-01aa-4f5a-a1fb-ac83d6032ed1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.496908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.498902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:49.506923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.508536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.508886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.509300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] PATH_INFO: `/v3/projects/d9e0e340cb8d4a64bdfeafcba8908f89/users/81630e4b323d43a08a368471273a2989/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.527865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e0e340cb8d4a64bdfeafcba8908f89, user_id=81630e4b323d43a08a368471273a2989, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.531979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638c962-c033-4be7-8831-5c33dcb9ed31 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.553479 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1599/3163] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:49 2022] PUT /identity/v3/projects/d9e0e340cb8d4a64bdfeafcba8908f89/users/81630e4b323d43a08a368471273a2989/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:49.560507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.560836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.561063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.575007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:49.605161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:49.606429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:49.637340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7e40f-f4e6-4f78-a861-e77f1866ca5b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.728287 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1600/3164] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:49.744644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:49.749142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:49.785286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.786394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.786394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.786617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.791653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:49.896496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1827e8-cfe9-4ee2-a3b9-7f43cb2de29c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:49.900961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:49.903993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:49.904348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:49.904789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:49.916772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.918628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.924262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:49.932743 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1601/3165] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:49.963783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:49.965484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faa654-3e18-4faa-85e6-86bd2e0cf1f9 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:49.989491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1565/3166] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:58:50.453130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:50.454602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:50.482035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc03454-e89c-42ea-94af-f75c8df1f143 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:50.496359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:50.497681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:50.497681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:50.498000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] PATH_INFO: `/v3/users/93597ab23b2a41db94d09d78de7659d2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:50.499268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93597ab23b2a41db94d09d78de7659d2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:50.501408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:50.617654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93597ab23b2a41db94d09d78de7659d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:50.631808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93597ab23b2a41db94d09d78de7659d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:50.632563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93597ab23b2a41db94d09d78de7659d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:50.633173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93597ab23b2a41db94d09d78de7659d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:50.656767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93597ab23b2a41db94d09d78de7659d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:50.675865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1602/3167] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:50 2022] DELETE /identity/v3/users/93597ab23b2a41db94d09d78de7659d2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:50.680638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:50.680638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:50.681272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:50.735663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:50.736812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:50.908181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1566/3168] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:50.933172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:50.935216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:51.087766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a20db-4139-46fd-8ad3-1bbd9c91bb8b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:51.099467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:51.100182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:51.100467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:51.100740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:51.128656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:51.130473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb00b2-2f87-478e-a5a2-6acae7a7fb2a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:51.166131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1603/3169] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:52.438627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:52.441993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:52.483272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a19a5-8415-4a98-94ea-b6cb071e9446 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:52.507404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:52.508606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:52.509085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:52.509518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] PATH_INFO: `/v3/projects/cf5eb8af4980464f85c99b9986abf8cb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:52.511596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5eb8af4980464f85c99b9986abf8cb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:52.524999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:52.543603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:52.628568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5eb8af4980464f85c99b9986abf8cb', 'request_id': 'req-52e270a4-028a-448b-ab6c-bd5c96032a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:52.639237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5eb8af4980464f85c99b9986abf8cb', 'request_id': 'req-52e270a4-028a-448b-ab6c-bd5c96032a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:52.653442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5eb8af4980464f85c99b9986abf8cb', 'request_id': 'req-52e270a4-028a-448b-ab6c-bd5c96032a8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:52.678251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] The token cache is being invalidate because project cf5eb8af4980464f85c99b9986abf8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:52.678970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:52.681043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-52e270a4-028a-448b-ab6c-bd5c96032a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:52.685348 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1567/3170] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:52 2022] DELETE /identity/v3/projects/cf5eb8af4980464f85c99b9986abf8cb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:52.690257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:52.691499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:52.692016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:52.725977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:52.732649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:52.873239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1604/3171] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:52.881355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:52.881654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:52.881943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:52.927529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:52.928798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:52.950440 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1568/3172] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:52.954797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:52.970792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a84bf3-664d-4181-96e7-3ac499828128 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:52.983149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:52.984383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:52.984717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:52.984950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:52.985741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:58:52.986054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:52.988000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.022256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1605/3173] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:58:53.026863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.050255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597c5bb-50f0-436d-b720-2bcb23ed1610 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.061713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.063254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.063708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.064036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.064763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.066806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.146075 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1569/3174] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:58:53 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:58:53.147995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.154437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:53.163378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83fa58-b8fa-4b9f-98b1-26de3cbdc121 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.287087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.288949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.289517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.290007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.291794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.299119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.346052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1606/3175] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:58:53 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:58:53.348849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.382761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ec0ca-f44a-480b-9257-2d791b937cd5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.389733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.389733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.390059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.390866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.391536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.393210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.411693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1570/3176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:53.412472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.423935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695da2-102f-447b-bd66-543d8abc3389 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.430261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.431004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.431307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.431594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.432634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.434283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2fb8e-c782-4bcc-a00d-21c5b6a06937 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.450514 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1607/3177] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:58:53.452072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.465739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfac7-1d8f-47ba-b70a-fd9756460a2a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.481056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.484531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.488885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.489399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] PATH_INFO: `/v3/projects/c13a926a61e0412c8eae94528aeb0a4e/users/425dba3904234fc08c2913a4e299b003/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.519138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13a926a61e0412c8eae94528aeb0a4e, user_id=425dba3904234fc08c2913a4e299b003, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.524002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.559017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1571/3178] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:58:53 2022] PUT /identity/v3/projects/c13a926a61e0412c8eae94528aeb0a4e/users/425dba3904234fc08c2913a4e299b003/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:53.564093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642578-c8ed-454e-a5ef-bd6a5e121be2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.564620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642578-c8ed-454e-a5ef-bd6a5e121be2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.565126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642578-c8ed-454e-a5ef-bd6a5e121be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.595214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ba642578-c8ed-454e-a5ef-bd6a5e121be2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:53.596454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba642578-c8ed-454e-a5ef-bd6a5e121be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:53.760870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1608/3179] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:53.775708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:53.778430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:53.877595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923363-9a08-41c7-81ac-4c2a82cc5146 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:53.889908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:53.890570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:53.891030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:53.891479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:53.908558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:53.911023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8fd3-aafb-43c9-b7a4-765ecea3d95b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:53.925641 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1572/3180] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:56.803109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:56.803722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:56.803851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:56.837249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:56.839213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:56.943030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1609/3181] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:56.954562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:56.955176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:56.955176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:56.986814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:58:56.988567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:57.013629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1573/3182] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:58:59.533229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:59.536802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:59.556949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:59.672886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153781-7482-49ae-8c67-74c7c64b0f31 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:59.681394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:59.682465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:59.682908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:59.683342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:59.685850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:59.783050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:59.789604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8dfe-6b51-4a94-8c0b-6ef78daa4511 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:59.808821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1610/3183] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:00.015096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:00.016873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:00.039628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a4684-8fa0-425d-b226-9278dfad5f92 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:00.048154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:00.053356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:00.053902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:00.054391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:00.068627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f805f0-42d3-4e07-a4f1-ca141a679db4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:00.068923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f805f0-42d3-4e07-a4f1-ca141a679db4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:00.069202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f805f0-42d3-4e07-a4f1-ca141a679db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:00.078329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:00.080004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:00.096076 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1574/3184] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:00.104033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-63f805f0-42d3-4e07-a4f1-ca141a679db4 None None] MFA Rules not processed for user `81630e4b323d43a08a368471273a2989`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:00.108911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-63f805f0-42d3-4e07-a4f1-ca141a679db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:00.221041 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1611/3185] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:59:00.237281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:00.238830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:00.252231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fdd3-80d9-46d4-8481-015fa5a9c91f service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:00.256774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:00.257535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:00.257725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:00.258354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:00.272859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:00.274790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade9d45-f1be-4f3b-8377-e6e083d5aed2 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:00.287898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1575/3186] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:02.355846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d044-19c4-4741-906a-93279307a781 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:02.356968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d044-19c4-4741-906a-93279307a781 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:02.357573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d044-19c4-4741-906a-93279307a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:02.384877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8aa8d044-19c4-4741-906a-93279307a781 None None] MFA Rules not processed for user `81630e4b323d43a08a368471273a2989`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:02.386954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8aa8d044-19c4-4741-906a-93279307a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:02.446900 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1612/3187] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:08.681099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:08.681990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:08.681990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:08.683714 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1576/3188] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:59:08.694368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:08.694984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:08.694984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:08.720132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:08.721686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:08.773337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:08.825030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1613/3189] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:08.848576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:08.852104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:08.865820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:08.882278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f58b9-cd1c-4561-9b78-109c33602c41 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:08.888199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:08.889041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:08.889356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:08.889649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:08.901364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:08.903283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:08.929797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1577/3190] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:09.846921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:09.859861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06d384-831f-457a-a1e6-88ddf8ce90ac None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:09.864086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:09.864801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:09.865341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:09.865673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:09.868161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:09.882640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:09.884102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d17c-3f04-491f-90a8-6bdf9ccf40b2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:09.898935 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1614/3191] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:10.989624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:11.006855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8509-f499-43c5-a0fa-203ab90c211f service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:11.023187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:11.023906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:11.024394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:11.024848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:11.032725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:11.056747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:11.058755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:11.085290 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1578/3192] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:11.698622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:11.700413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:11.700899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:11.725732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] MFA Rules not processed for user `be44957fa2304f52a8d34bdac9eaca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:11.727326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:11.804513 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1615/3193] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:12.712874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:12.715841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:12.737013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81c3f-8715-4aa0-b88b-7998fc824cf1 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:12.742286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:12.744154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:12.744723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:12.745121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] PATH_INFO: `/v3/users/ac8ef83fa94e4c9db70a0115cc867dfc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:12.746745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8ef83fa94e4c9db70a0115cc867dfc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:12.748765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:12.812497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8ef83fa94e4c9db70a0115cc867dfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:12.813499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8ef83fa94e4c9db70a0115cc867dfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:12.823280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8ef83fa94e4c9db70a0115cc867dfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:12.824779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8ef83fa94e4c9db70a0115cc867dfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:12.845714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8ef83fa94e4c9db70a0115cc867dfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:12.863880 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1579/3194] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:12 2022] DELETE /identity/v3/users/ac8ef83fa94e4c9db70a0115cc867dfc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:13.302164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:13.316175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cd2a-afb7-495d-86fc-947fa61beeb3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:13.417381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:13.420289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:13.420667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:13.421057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] PATH_INFO: `/v3/projects/0aeb9ab07bf8476082d5add829aec29f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:13.422794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aeb9ab07bf8476082d5add829aec29f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:13.425024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:13.489856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aeb9ab07bf8476082d5add829aec29f', 'request_id': 'req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.499186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aeb9ab07bf8476082d5add829aec29f', 'request_id': 'req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.505833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:13.508546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aeb9ab07bf8476082d5add829aec29f', 'request_id': 'req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.529792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] The token cache is being invalidate because project 0aeb9ab07bf8476082d5add829aec29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:13.530199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.531890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.533565 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1616/3195] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:13 2022] DELETE /identity/v3/projects/0aeb9ab07bf8476082d5add829aec29f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:13.537616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:13.539151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:13.555926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21593a37-8c71-44f7-8317-64311aee5a85 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:13.618532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:13.620151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:13.620277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:13.620534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] PATH_INFO: `/v3/users/c39b50c6acd14d2aa8dc4c4e59c83fe3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:13.621773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39b50c6acd14d2aa8dc4c4e59c83fe3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:13.624451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:13.685034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39b50c6acd14d2aa8dc4c4e59c83fe3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.685927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39b50c6acd14d2aa8dc4c4e59c83fe3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.688531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:13.696125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39b50c6acd14d2aa8dc4c4e59c83fe3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.697217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39b50c6acd14d2aa8dc4c4e59c83fe3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.717240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4abcc901-f88d-4802-9866-813dec44effa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39b50c6acd14d2aa8dc4c4e59c83fe3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:13.752073 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1580/3196] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:13 2022] DELETE /identity/v3/users/c39b50c6acd14d2aa8dc4c4e59c83fe3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:13.980904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:13.988241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:14.020157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e38c7-d1b0-4f4b-9db5-621802c3583e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.135151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.136233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.136513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.136788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] PATH_INFO: `/v3/projects/a2401931660d4c928ac8119ce7ec8736` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.138633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2401931660d4c928ac8119ce7ec8736)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.141630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.235900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2401931660d4c928ac8119ce7ec8736', 'request_id': 'req-1c9dee2a-ba28-4327-a6c9-e60387f11b22'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:14.243385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2401931660d4c928ac8119ce7ec8736', 'request_id': 'req-1c9dee2a-ba28-4327-a6c9-e60387f11b22'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:14.249710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2401931660d4c928ac8119ce7ec8736', 'request_id': 'req-1c9dee2a-ba28-4327-a6c9-e60387f11b22'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:14.281643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] The token cache is being invalidate because project a2401931660d4c928ac8119ce7ec8736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:14.281943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:14.284303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1c9dee2a-ba28-4327-a6c9-e60387f11b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:14.291901 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1617/3197] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:13 2022] DELETE /identity/v3/projects/a2401931660d4c928ac8119ce7ec8736 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:14.298984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.299244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.299738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.332925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:14.352071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:14.423317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1581/3198] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:14.431178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.431832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.432059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.454618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:14.455948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:14.465883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1618/3199] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:14.470363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.482093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5290eb-3e56-4542-8fcc-f2a3dc9e1256 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.487687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.488310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.488743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.489028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.489960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:59:14.490255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.492008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.511998 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1582/3200] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:59:14.513440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.524183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59814c-f68f-497d-bacd-672696a59a61 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.530531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.531279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.531602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.531900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.532606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.534577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.573602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1619/3201] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:14.574914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.586984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e75b7c-8ec3-4c7d-a680-52dc5f305dda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.658402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.659267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.659715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.660094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.661041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.663041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.691448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1583/3202] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:14.695392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.706769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aeb45-0068-4ba6-9d47-4816edcaa7ff admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.716308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.717036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.717322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.717607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.718485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.720209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.732835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1620/3203] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:14.737119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.750870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446cbb9-9f03-4d65-bf47-a85f51986be5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.756266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.757202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.757494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.757778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.758522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.760821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f384e1-41be-4591-88fc-7428980561c6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.775745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1584/3204] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:14.777847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.789621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79d88f-a7a6-4505-a285-6b32f8c9b2c6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:14.795938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:14.796996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.797439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.797783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] PATH_INFO: `/v3/projects/29ca718638c842a98bb90cc3adb3979f/users/5b4c3539c5534d2c844944f9be3f9963/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.814959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ca718638c842a98bb90cc3adb3979f, user_id=5b4c3539c5534d2c844944f9be3f9963, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:14.817890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:14.834249 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1621/3205] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:14 2022] PUT /identity/v3/projects/29ca718638c842a98bb90cc3adb3979f/users/5b4c3539c5534d2c844944f9be3f9963/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:14.844486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:14.844786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:14.845063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:14.874720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] MFA Rules not processed for user `5b4c3539c5534d2c844944f9be3f9963`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:14.876154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:14.899184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:14.951722 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1585/3206] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:14.960506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:14.996922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:15.079572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233531f-9ebe-4518-9818-3c6156a0e9e9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.086404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.088125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.088565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.089013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.089879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.093734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.151333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1622/3207] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:14 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:15.155465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:15.172390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e869d-71d6-43f5-bb29-64d765fffbe9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.278014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.278710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.278989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.279264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.280031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.282683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.323845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1586/3208] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:15 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:59:15.324579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:15.347822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937352-8367-457f-b4fb-9749b6423fee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.353899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.354614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.354899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.355189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.356609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.375246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.410310 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1623/3209] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:15.414818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:15.432898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322fee0-4712-4dbf-9802-77271e6a6acf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.451499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.452970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.453257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.453576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] PATH_INFO: `/v3/projects/8e8d612beb2b4d758bbae05a31ba753c/users/416e81041f5545889211b6f6f777a5cb/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.476070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8d612beb2b4d758bbae05a31ba753c, user_id=416e81041f5545889211b6f6f777a5cb, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.479974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.509474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:15.510773 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1587/3210] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:15 2022] PUT /identity/v3/projects/8e8d612beb2b4d758bbae05a31ba753c/users/416e81041f5545889211b6f6f777a5cb/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:15.526506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c239c9-0802-4ff0-ac4b-2d2c9c7bf653 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.644780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.648390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.648690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.648975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.649728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.652128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ad9b8-4308-421d-a366-e3b74c6bf69d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.665732 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1624/3211] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:15.669913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:15.681977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0e2c-e8b0-4f97-a7e4-ca64ecccad06 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:15.687587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:15.688836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.689640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.689640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] PATH_INFO: `/v3/projects/8e8d612beb2b4d758bbae05a31ba753c/users/416e81041f5545889211b6f6f777a5cb/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.691557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8d612beb2b4d758bbae05a31ba753c, user_id=416e81041f5545889211b6f6f777a5cb, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:15.694908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89f049-8856-43b6-90b5-7bc7d6d38819 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:15.711550 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1588/3212] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:15 2022] PUT /identity/v3/projects/8e8d612beb2b4d758bbae05a31ba753c/users/416e81041f5545889211b6f6f777a5cb/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:59:15.719287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.719612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.719894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.754312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] MFA Rules not processed for user `416e81041f5545889211b6f6f777a5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:15.755918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:15.890340 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1625/3213] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:15.898384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc94d-72b3-49fe-b5e9-16333375b467 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:15.898889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc94d-72b3-49fe-b5e9-16333375b467 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:15.899180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffc94d-72b3-49fe-b5e9-16333375b467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:15.920083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-27ffc94d-72b3-49fe-b5e9-16333375b467 None None] MFA Rules not processed for user `5b4c3539c5534d2c844944f9be3f9963`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:15.921662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27ffc94d-72b3-49fe-b5e9-16333375b467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:15.982854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1589/3214] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:16.604985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:16.606880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:16.630461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:16.708893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9c846-b36f-4a1c-aded-2221ba671da5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:16.714700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:16.715377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:16.715694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:16.715971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:16.724860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:16.726790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:16.737220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1626/3215] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:18.892207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:18.893369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:18.893928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:18.941464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:18.944208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:18.968328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:19.030407 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1590/3216] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:20.780363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:20.782028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:20.896750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62bd32-10a0-425b-82f4-919742aa9d46 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:20.902662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:20.904450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:20.904910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:20.905370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] PATH_INFO: `/v3/users/17c2fd62612a43b4b4838cbd45b22218` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:20.910109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c2fd62612a43b4b4838cbd45b22218)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:20.912178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:21.027035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c2fd62612a43b4b4838cbd45b22218'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:21.037994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c2fd62612a43b4b4838cbd45b22218'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:21.038871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c2fd62612a43b4b4838cbd45b22218'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:21.039921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c2fd62612a43b4b4838cbd45b22218'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:21.056962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2bc6669a-a191-461e-b5e9-dbbd74789eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c2fd62612a43b4b4838cbd45b22218'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:21.103336 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1627/3217] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:20 2022] DELETE /identity/v3/users/17c2fd62612a43b4b4838cbd45b22218 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:22.628568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:22.652423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dec9f-da35-45bb-9721-fd007f465e22 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:22.739697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:22.741134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:22.741423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:22.741700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] PATH_INFO: `/v3/projects/164d90f06576437c967ac86132b9a730` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:22.743087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=164d90f06576437c967ac86132b9a730)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:22.745510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:22.817565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164d90f06576437c967ac86132b9a730', 'request_id': 'req-0e372b57-8f49-4324-b237-e0b7101a3f69'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:22.826277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164d90f06576437c967ac86132b9a730', 'request_id': 'req-0e372b57-8f49-4324-b237-e0b7101a3f69'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:22.842443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164d90f06576437c967ac86132b9a730', 'request_id': 'req-0e372b57-8f49-4324-b237-e0b7101a3f69'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:22.873787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] The token cache is being invalidate because project 164d90f06576437c967ac86132b9a730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:22.874084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:22.877030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e372b57-8f49-4324-b237-e0b7101a3f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:22.882893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1591/3218] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:22 2022] DELETE /identity/v3/projects/164d90f06576437c967ac86132b9a730 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:22.884777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:22.885331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:22.885331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:22.975642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:22.977548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:23.005090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:23.088916 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1628/3219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:23.092024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.092312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.092586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.137561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:23.142384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:23.169127 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1592/3220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:23.173752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.193246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4e66-443c-4013-a356-29e380a9ac6e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.206098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.207965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.208422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.208907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.209972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:59:23.210473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.212365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.233059 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1629/3221] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:59:23.237217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.255827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad11a5-2109-4406-a8c5-32e1bc87aedc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.262894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.264252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.264728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.265394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.268578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.280148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.333629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1593/3222] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:23 2022] POST /identity/v3/projects => generated 413 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:23.337715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.354296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf88fd5-d90d-439b-91ed-cb098a5baa5d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.440272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.441258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.441531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.441813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.442521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.444699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.472858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1630/3223] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:23 2022] POST /identity/v3/users => generated 307 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:23.476161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.487774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079800bb-a0b6-405e-bd7b-5b55cb7436eb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.495438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.496176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.496458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.496735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.497476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.499967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.515617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1594/3224] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:23.516628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.528607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbcca5-05d0-4f39-9a67-9b5e44bc4caf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.534022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.534715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.535186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.535464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.536252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.537877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76edf2-20f9-4f33-8186-48272cd290da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.550570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1631/3225] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:23.554615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.570760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c71c9-bcbb-4c38-b822-8c3e25b56a45 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.576563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.577520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.577807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.578134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] PATH_INFO: `/v3/projects/2df84f0dd560488b9b85303294bc6fca/users/c329a5d4cc2f4311ae154a8810698837/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.596642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:23.604034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df84f0dd560488b9b85303294bc6fca, user_id=c329a5d4cc2f4311ae154a8810698837, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.608860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.627105 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1595/3226] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:23 2022] PUT /identity/v3/projects/2df84f0dd560488b9b85303294bc6fca/users/c329a5d4cc2f4311ae154a8810698837/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:59:23.632278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3cba2-4bbe-42ff-8a3c-9a55582e3850 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.632584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3cba2-4bbe-42ff-8a3c-9a55582e3850 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.632835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3cba2-4bbe-42ff-8a3c-9a55582e3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.652922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9ed3cba2-4bbe-42ff-8a3c-9a55582e3850 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:23.654731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9ed3cba2-4bbe-42ff-8a3c-9a55582e3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:23.724014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1632/3227] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:23.742088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:23.745783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:23.830579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fae80-d9dd-4212-82f2-cfd4b7dab5a3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:23.836160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:23.837020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:23.837524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:23.838013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:23.856337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:23.858281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59bde2-09a6-40f5-b544-737dc22c4dc1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:23.871864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1596/3228] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:33.715005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:33.865419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:34.415055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:34.415454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:34.415774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:34.473826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] MFA Rules not processed for user `c329a5d4cc2f4311ae154a8810698837`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:34.475035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:34.624229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1633/3229] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:34.634130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:34.634456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:34.638784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:34.677866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] MFA Rules not processed for user `c329a5d4cc2f4311ae154a8810698837`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:34.679149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:34.709376 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1597/3230] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:35.357139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:35.357590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:35.357965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:35.364676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:35.378706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05870-a945-4bd1-bed8-25d9d9da864d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:35.384148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:35.396825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:35.397499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:35.397795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] PATH_INFO: `/v3/users/c80f5171e36f498cb2601ae92861a94a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:35.399343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80f5171e36f498cb2601ae92861a94a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:35.401420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:35.478609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80a6f-4ed9-4550-9f36-25ea3bfe9dd6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:35.486097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:35.487098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:35.487838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:35.488289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:35.506286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80f5171e36f498cb2601ae92861a94a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:35.516086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:35.517789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:35.528002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80f5171e36f498cb2601ae92861a94a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:35.529013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80f5171e36f498cb2601ae92861a94a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:35.529959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80f5171e36f498cb2601ae92861a94a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:35.543902 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1598/3231] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:59:35.572431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80f5171e36f498cb2601ae92861a94a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:35.603624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1634/3232] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:35 2022] DELETE /identity/v3/users/c80f5171e36f498cb2601ae92861a94a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:35.872673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:35.917086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e411bf-8328-4dcf-ae8a-c41d9986ad58 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.036787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.038275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:36.065172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.066167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.066333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.066612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] PATH_INFO: `/v3/projects/5f72194d8a044e81a3a48e7716a1395f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.071365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f72194d8a044e81a3a48e7716a1395f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.084792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.201845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08244f52-4b46-4655-abb9-812c99aa74d3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.205733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f72194d8a044e81a3a48e7716a1395f', 'request_id': 'req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:36.213770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f72194d8a044e81a3a48e7716a1395f', 'request_id': 'req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:36.222872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f72194d8a044e81a3a48e7716a1395f', 'request_id': 'req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:36.255966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] The token cache is being invalidate because project 5f72194d8a044e81a3a48e7716a1395f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:36.256672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:36.257877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d9b7726-95d3-4d0d-a74f-1c7061a3a2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:36.261793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1599/3233] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:35 2022] DELETE /identity/v3/projects/5f72194d8a044e81a3a48e7716a1395f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:36.267059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b4a1-071d-4490-b5db-eac6283bc8f6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.267059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b4a1-071d-4490-b5db-eac6283bc8f6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.267059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41b4a1-071d-4490-b5db-eac6283bc8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.282083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:36.314907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7c41b4a1-071d-4490-b5db-eac6283bc8f6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:36.316552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7c41b4a1-071d-4490-b5db-eac6283bc8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:36.333134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:36.371719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.373658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.374206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.374770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.386352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:36.423818 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1600/3234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:59:36.427092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.427452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.427737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.428629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.432575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.462383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1635/3235] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:59:36.465186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:36.466905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:36.481161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1601/3236] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:36.483051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.496553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec205cd1-9d42-4c1a-b917-97cbf0d2b2aa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.503541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.504490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.504901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.505146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.505843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:59:36.506381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.508535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.523324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1636/3237] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:59:36.528476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.538353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d99cf-19e0-463f-bfec-50feadd62c5a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.544432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.545236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.545402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.545662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.546365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.548509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.586926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1602/3238] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:36 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:36.588349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.601154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41b8db-b874-4315-b24f-96d7bee94c66 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.704587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.705637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.706206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.706626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.707454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.709525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.744186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1637/3239] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:36 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:59:36.745409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.756890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b5e9c-09c0-4b0e-838a-05480d3e300d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.762181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.762866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.763152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.765179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.765179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.765953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.784150 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1603/3240] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:36.785546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.799056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac3bd1-150a-4ae3-9936-404d4868068c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.806441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.808903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.809435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.810537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.811636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.814027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f0ac2-96e3-4adc-aad4-1bf387a4a86d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.836736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:36.840581 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1638/3241] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:36.865125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083515-714d-42a5-b213-108dad841c6b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:36.871035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:36.871729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.872017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.872292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] PATH_INFO: `/v3/projects/89b34ac08aef435c97db4e30fa0eb3d1/users/08668532897146e38928d6370c974168/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.899602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b34ac08aef435c97db4e30fa0eb3d1, user_id=08668532897146e38928d6370c974168, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:36.902802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:36.925223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1604/3242] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:36 2022] PUT /identity/v3/projects/89b34ac08aef435c97db4e30fa0eb3d1/users/08668532897146e38928d6370c974168/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:36.930613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8937-3302-4252-8422-b7664becab1c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:36.931051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8937-3302-4252-8422-b7664becab1c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:36.931701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8937-3302-4252-8422-b7664becab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:36.955018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-413f8937-3302-4252-8422-b7664becab1c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:36.956107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-413f8937-3302-4252-8422-b7664becab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:37.057571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1639/3243] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:37.065637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:37.069158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:37.163050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e1ae-eb29-44b9-9896-675e63532774 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:37.167483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:37.168358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:37.168752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:37.169168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:37.180568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:37.182618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336ebd6-fdee-4452-beef-471b5b699528 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:37.196343 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1605/3244] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:39.955219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:39.956243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:39.956715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:39.993845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] MFA Rules not processed for user `e25328c90d26437a85d8d5509437ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:39.996165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:40.058738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:40.123905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1640/3245] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:41.385042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:41.386010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:41.386467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:41.467829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:41.469739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:41.600670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:41.643862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1606/3246] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:44.715666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:44.720984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:44.761067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429fd1-cfcc-4217-89f7-508cb38a7805 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:44.772250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:44.775404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:44.776205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:44.777100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] PATH_INFO: `/v3/users/fb5163967e1f4f14b64ed72ffbf64db8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:44.779719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5163967e1f4f14b64ed72ffbf64db8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:44.785040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:44.944492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5163967e1f4f14b64ed72ffbf64db8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:44.976405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5163967e1f4f14b64ed72ffbf64db8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:44.978072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5163967e1f4f14b64ed72ffbf64db8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:44.980545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5163967e1f4f14b64ed72ffbf64db8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:45.031807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9ee1701e-ea28-4265-af01-3fb604c1c74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5163967e1f4f14b64ed72ffbf64db8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:45.089038 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1641/3247] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:44 2022] DELETE /identity/v3/users/fb5163967e1f4f14b64ed72ffbf64db8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:45.797387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:45.818784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194441a5-5be0-4fb8-8192-48ee3051117d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:46.016282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:46.018010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:46.033740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:46.036995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] PATH_INFO: `/v3/projects/89428fdfbe7748018280e169ceebc0df` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:46.042378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89428fdfbe7748018280e169ceebc0df)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:46.055030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:46.208582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89428fdfbe7748018280e169ceebc0df', 'request_id': 'req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:46.224319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89428fdfbe7748018280e169ceebc0df', 'request_id': 'req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:46.240871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89428fdfbe7748018280e169ceebc0df', 'request_id': 'req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:46.268378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] The token cache is being invalidate because project 89428fdfbe7748018280e169ceebc0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:46.268670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:46.271198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15c9a2fe-57a7-473f-afec-ccfa6ade12d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:46.273904 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1607/3248] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:45 2022] DELETE /identity/v3/projects/89428fdfbe7748018280e169ceebc0df => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:46.280256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:46.281089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:46.281590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:46.336130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:46.343619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:46.613398 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1642/3249] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:46.623019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:46.623670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:46.623959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:46.687111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:46.693139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:46.746019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:46.746743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1608/3250] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:46.747860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:46.751111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:46.764612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ef66-398e-44e5-b9a9-26a36acc9749 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:46.777225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:46.779434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:46.780196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:46.780777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:46.783197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:59:46.785647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:46.789920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:46.824398 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1609/3251] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:59:46.832792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:46.854767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cbbd6-fb42-4580-bdcb-1aaad08140e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:46.862534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:46.864254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:46.864749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:46.865245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:46.866147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:46.869935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:46.884642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:46.935152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1610/3252] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:46 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:46.940343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:46.959793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b272c92-3af4-447c-a0d1-cb08124fd672 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:47.179199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:47.181354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:47.182511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.182922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.183332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.188444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:47.242892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44c0e-ec24-4aea-81a8-d8a5b26c4522 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:47.256445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:47.257551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.258004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.258424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.259536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:47.265974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:47.311908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1611/3253] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:46 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:59:47.330780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:47.345936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:47.355586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a2b54-4c24-4001-8248-f553be03bbab service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:47.366806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eae19-2dc0-493f-bf38-232143bbe2e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:47.382320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:47.383031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.383318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.386714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.390680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:47.396912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:47.412534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1643/3254] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:59:47.414161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119304-2307-4650-802b-fb727be07c6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.418097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119304-2307-4650-802b-fb727be07c6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.418528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c119304-2307-4650-802b-fb727be07c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.433508 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1612/3255] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:47.438449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:47.454579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249c67c-f980-4a71-abe7-0947f9967819 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:47.462177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:47.463400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.464202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.464661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.465735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:47.467616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:47.482050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6c119304-2307-4650-802b-fb727be07c6b None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:47.483645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c119304-2307-4650-802b-fb727be07c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:47.485918 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1613/3256] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:47.494182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:47.519452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f52326-f611-4a10-a8bd-8cfd8e411e34 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:47.543282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:47.547411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.547732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.548019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] PATH_INFO: `/v3/projects/41a6c9f3ddbf4fb48fc2d1272c612739/users/21ae179d22a140f7a6ebccaeea7932db/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.642151 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1644/3257] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:47.646972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a6c9f3ddbf4fb48fc2d1272c612739, user_id=21ae179d22a140f7a6ebccaeea7932db, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:47.657570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:47.706121 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1614/3258] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:47 2022] PUT /identity/v3/projects/41a6c9f3ddbf4fb48fc2d1272c612739/users/21ae179d22a140f7a6ebccaeea7932db/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:47.707998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c3a6-aca7-4a2e-b9d0-776e234f1865 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:47.708415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c3a6-aca7-4a2e-b9d0-776e234f1865 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:47.708796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c3a6-aca7-4a2e-b9d0-776e234f1865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:47.764600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-18c6c3a6-aca7-4a2e-b9d0-776e234f1865 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:47.766241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18c6c3a6-aca7-4a2e-b9d0-776e234f1865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:47.795723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:47.957952 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1645/3259] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:59:47.979783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:47.986582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:48.218263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355dbf-49ff-42d6-8957-1122adbdba51 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:48.223729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:48.225190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:48.225491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:48.225896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:48.258433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:48.261386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86fca6-4ee9-454f-9425-7060ec00b5c4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:48.290047 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1615/3260] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:49.392224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdc55-119a-4b77-8f65-fef4bc3e903e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:49.392810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdc55-119a-4b77-8f65-fef4bc3e903e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:49.392810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdc55-119a-4b77-8f65-fef4bc3e903e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:49.394562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1646/3261] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 20:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:59:49.402691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:49.403268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:49.403405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:49.443128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:49.447928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:49.579723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1616/3262] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:49.582830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3eb6-0c6e-46c5-8e47-cef83e32e3a2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:49.583125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3eb6-0c6e-46c5-8e47-cef83e32e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:49.583404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f3eb6-0c6e-46c5-8e47-cef83e32e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:49.610857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:49.613610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:49.635832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d7b94-c99c-435a-9b34-404feb9c1d31 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:49.645266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:49.645563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-303f3eb6-0c6e-46c5-8e47-cef83e32e3a2 None None] MFA Rules not processed for user `08668532897146e38928d6370c974168`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:49.646955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:49.647353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-303f3eb6-0c6e-46c5-8e47-cef83e32e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:49.647717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:49.648226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:49.660894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:49.663411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e7955-532b-422a-8625-c5befbe68744 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:49.688968 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1617/3263] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:49.782000 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1647/3264] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:50.273439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36725ef-325e-4a1b-9bf4-923bd4975118 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.274860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36725ef-325e-4a1b-9bf4-923bd4975118 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.277371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36725ef-325e-4a1b-9bf4-923bd4975118 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.288139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1618/3265] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:59:50 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:59:50.296677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.298975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.299711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.335408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:50.337142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:50.354631 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1648/3266] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:50.404864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36725ef-325e-4a1b-9bf4-923bd4975118 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:50.424754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36725ef-325e-4a1b-9bf4-923bd4975118 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:50.433297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:50.434230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.434687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.435121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.445662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:50.447714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b352e-bd03-451e-8dc3-bb087bc439bc service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:50.461706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:50.480152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1619/3267] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:50.554818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:50.660011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b303a-63b1-47ca-b544-74c3f63d77f4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:50.668423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:50.669565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.670330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.670850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.680667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:50.682657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36767-1f0e-4826-876c-677f22dc6113 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:50.694697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1649/3268] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:50.741059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.745077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.745591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.747320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1620/3269] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 20:59:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:59:50.754715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5c81-8275-44f6-9b9e-6c84e673d1d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.755817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5c81-8275-44f6-9b9e-6c84e673d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.756666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb5c81-8275-44f6-9b9e-6c84e673d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.781611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fedb5c81-8275-44f6-9b9e-6c84e673d1d5 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:50.782759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fedb5c81-8275-44f6-9b9e-6c84e673d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:50.793736 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1650/3270] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:50.805152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:50.807881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:50.825626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d342cf-494a-4420-84e7-4d60c5998481 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:50.837125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:50.837125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:50.837429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:50.837908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:50.854497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:50.856724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1559840-d7e9-49ba-b64d-a07f76bb333e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:50.873680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1621/3271] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:52.976133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8eda-c65f-4016-9137-15e45a4a7429 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:52.977179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8eda-c65f-4016-9137-15e45a4a7429 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:52.978241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f8eda-c65f-4016-9137-15e45a4a7429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:53.059595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-320f8eda-c65f-4016-9137-15e45a4a7429 None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:53.061574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-320f8eda-c65f-4016-9137-15e45a4a7429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:53.100010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:53.249288 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1651/3272] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:53.252493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:53.252493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:53.252493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:53.288707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:53.290058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:53.315086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21659-1887-49c3-b92c-35d65926e004 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:53.315654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21659-1887-49c3-b92c-35d65926e004 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:53.316111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21659-1887-49c3-b92c-35d65926e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:53.317211 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1622/3273] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:53.373819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f1f21659-1887-49c3-b92c-35d65926e004 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:53.382439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f1f21659-1887-49c3-b92c-35d65926e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:53.525453 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1652/3274] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:59:53.793320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:53.794868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:53.838098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b442d-e2ff-452f-95d9-c4f49c737c7a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:53.863443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:53.868336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:53.871743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:53.872204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:53.910161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:53.911790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:53.936898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1623/3275] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:55.121200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1320d-1c6d-4035-8ea0-99cacb37e06d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:55.121713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1320d-1c6d-4035-8ea0-99cacb37e06d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:55.121861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1320d-1c6d-4035-8ea0-99cacb37e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:55.152631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a6f1320d-1c6d-4035-8ea0-99cacb37e06d None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:55.153868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a6f1320d-1c6d-4035-8ea0-99cacb37e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:55.172319 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1653/3276] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:56.766564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:56.768029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:56.795430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bdc4e-401e-4dd4-bb0d-58dfadca7ec1 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:56.800628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:56.801527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:56.801979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:56.802465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] PATH_INFO: `/v3/users/08668532897146e38928d6370c974168` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:56.803823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] RBAC: Authorizing `identity:delete_user(user_id=08668532897146e38928d6370c974168)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:56.805817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:56.863007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08668532897146e38928d6370c974168'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:56.863776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08668532897146e38928d6370c974168'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:56.876694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08668532897146e38928d6370c974168'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:56.877601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08668532897146e38928d6370c974168'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:56.891214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08668532897146e38928d6370c974168'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:56.912301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1624/3277] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:59:56 2022] DELETE /identity/v3/users/08668532897146e38928d6370c974168 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:56.926162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf7890-a9f0-4f7b-ae41-d0702c19495c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:56.926702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf7890-a9f0-4f7b-ae41-d0702c19495c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:56.926702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf7890-a9f0-4f7b-ae41-d0702c19495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:56.950261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6edf7890-a9f0-4f7b-ae41-d0702c19495c None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:56.951486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6edf7890-a9f0-4f7b-ae41-d0702c19495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:57.018127 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1654/3278] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:57.131790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.133707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:57.220838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f81832-73fb-4877-baa5-7c152f56baee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.227166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.228287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.228673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.228985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] PATH_INFO: `/v3/projects/89b34ac08aef435c97db4e30fa0eb3d1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.230331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b34ac08aef435c97db4e30fa0eb3d1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.232483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.280260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:57.287411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b34ac08aef435c97db4e30fa0eb3d1', 'request_id': 'req-402fe451-d3b9-4dd2-804d-7604579b3bec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:57.295328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b34ac08aef435c97db4e30fa0eb3d1', 'request_id': 'req-402fe451-d3b9-4dd2-804d-7604579b3bec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:57.302378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b34ac08aef435c97db4e30fa0eb3d1', 'request_id': 'req-402fe451-d3b9-4dd2-804d-7604579b3bec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:57.320374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] The token cache is being invalidate because project 89b34ac08aef435c97db4e30fa0eb3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:59:57.320982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:57.322372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-402fe451-d3b9-4dd2-804d-7604579b3bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:59:57.324049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1625/3279] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:59:57 2022] DELETE /identity/v3/projects/89b34ac08aef435c97db4e30fa0eb3d1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:59:57.329285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.329646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.329995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.349683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:57.351032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:57.406930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:57.426337 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1655/3280] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:57.428340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.428628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.428907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.448579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:57.449810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:57.458533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1626/3281] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:59:57.462990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.474536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05667-f67b-4277-9521-097e8609ab4d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.479839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.480537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.480823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.481100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.482854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:59:57.483386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.485767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.500068 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1656/3282] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 20:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:59:57.504674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.514644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48b97-b128-4fe1-9bdf-6c81a85f6825 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.519576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.520293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.520581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.520857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.521912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.523874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.556568 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1627/3283] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 20:59:57 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:59:57.558231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.577477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b656a08-d744-4365-8aa6-79f63777f855 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.659798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.660508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.660823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.661490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.661880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.664237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.687905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1657/3284] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 20:59:57 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:59:57.692487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.704568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5eaee-5eba-4379-aee3-878eb9a3feb7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.710613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.711548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.712002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.712460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.713504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.715720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.730304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1628/3285] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:57.734266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.746786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238049-14b0-49e4-b0e5-41f2424e929e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.752054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.752757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.753079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.753363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.754223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.755921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad29d10-e46e-4f15-b743-5d8d601889ef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.767228 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1658/3286] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:59:57.772693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:57.783812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13148759-331c-4b88-a58f-208e017deb82 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:57.789267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:57.790355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.790629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.790905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] PATH_INFO: `/v3/projects/6f1bae4089ad4a3b9f60e428562f72b6/users/08a2bdc9ea314187bfaa5e64627e7420/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.808027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1bae4089ad4a3b9f60e428562f72b6, user_id=08a2bdc9ea314187bfaa5e64627e7420, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:57.810686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:57.828538 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1629/3287] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 20:59:57 2022] PUT /identity/v3/projects/6f1bae4089ad4a3b9f60e428562f72b6/users/08a2bdc9ea314187bfaa5e64627e7420/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:59:57.840706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1c6f-bfef-4c1a-92df-9a0bd53104c3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:57.841081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1c6f-bfef-4c1a-92df-9a0bd53104c3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:57.841425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc1c6f-bfef-4c1a-92df-9a0bd53104c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:57.897051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3ddc1c6f-bfef-4c1a-92df-9a0bd53104c3 None None] MFA Rules not processed for user `08a2bdc9ea314187bfaa5e64627e7420`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:57.898270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3ddc1c6f-bfef-4c1a-92df-9a0bd53104c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:57.973283 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1659/3288] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:59:58.261043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:59:58.263182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:58.351858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992517-7a2e-4150-8ba7-a8584c5b14c5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:59:58.359125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:59:58.359836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:58.360122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:58.361355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:58.372137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:59:58.374039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5a28c-669d-4ff4-9325-1de24e2ea5d5 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:59:58.385546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1630/3289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:59.603213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:59:59.603927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:59:59.603927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:59:59.645886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:59:59.647928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:59:59.748767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:59.769817 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1660/3290] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:02.291774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2098-b982-4998-8c99-f516e220d8af None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:02.292269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2098-b982-4998-8c99-f516e220d8af None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:02.292395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2098-b982-4998-8c99-f516e220d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:02.310972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-559f2098-b982-4998-8c99-f516e220d8af None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:02.312382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-559f2098-b982-4998-8c99-f516e220d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:02.320270 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1631/3291] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:05.547845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:05.669746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041451f-968c-46c9-9693-d4d0b18e2086 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:05.675048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:05.675983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:05.676268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:05.676546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] PATH_INFO: `/v3/users/08a2bdc9ea314187bfaa5e64627e7420` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:05.677821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a2bdc9ea314187bfaa5e64627e7420)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:05.679813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:05.759848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a2bdc9ea314187bfaa5e64627e7420'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:05.767247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a2bdc9ea314187bfaa5e64627e7420'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:05.767995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a2bdc9ea314187bfaa5e64627e7420'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:05.768608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a2bdc9ea314187bfaa5e64627e7420'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:05.784648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fb37b149-f4c6-4a5f-938a-fc9b8095852b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a2bdc9ea314187bfaa5e64627e7420'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:05.808753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1661/3292] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:00:05 2022] DELETE /identity/v3/users/08a2bdc9ea314187bfaa5e64627e7420 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:05.811621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:05.814016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:05.815068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:05.873546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:05.876245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:05.938797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:05.951090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:05.951603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:05.951985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:05.981518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:05.983374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:05.990933 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1632/3293] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:06.008790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:06.010625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:06.084762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623663f-a093-4393-b67b-a576ec2ff8d1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:06.092970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:06.093804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:06.094269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:06.094561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:06.110084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:06.112462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f82f7-c8bc-437c-b5a7-925ca532a5eb service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:06.133661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1662/3294] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:06.136569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1633/3295] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:06.828144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:06.829753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:06.847417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538b50-ca39-4ead-b6d7-23c80187cfa4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:06.856002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:06.857070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:06.858047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:06.858586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] PATH_INFO: `/v3/projects/6f1bae4089ad4a3b9f60e428562f72b6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:06.860057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1bae4089ad4a3b9f60e428562f72b6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:06.865296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:06.890493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:06.920854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1bae4089ad4a3b9f60e428562f72b6', 'request_id': 'req-e449a33f-e8d9-47c0-9099-51686a55fd33'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:06.927478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1bae4089ad4a3b9f60e428562f72b6', 'request_id': 'req-e449a33f-e8d9-47c0-9099-51686a55fd33'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:06.934071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1bae4089ad4a3b9f60e428562f72b6', 'request_id': 'req-e449a33f-e8d9-47c0-9099-51686a55fd33'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:06.948333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] The token cache is being invalidate because project 6f1bae4089ad4a3b9f60e428562f72b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:00:06.948783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:06.949648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e449a33f-e8d9-47c0-9099-51686a55fd33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:06.955004 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1663/3296] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:00:06 2022] DELETE /identity/v3/projects/6f1bae4089ad4a3b9f60e428562f72b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:06.957031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:06.957552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:06.957734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:06.977311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:06.978688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:07.059440 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1634/3297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:07.069335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.069921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.070357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.094170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:07.095712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:07.105469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1664/3298] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:07.109834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.125083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad348b-15f4-43b4-8086-d647e2342f49 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.131657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.132393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.133255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.133942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.134996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:00:07.135341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.137343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.158554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1635/3299] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:00:07.163071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.173845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe20726-5ad8-4ada-994a-06075ea28353 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.178478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.179245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.179572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.179854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.180631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.182532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.210077 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1665/3300] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:00:07 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:00:07.214539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.225900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99fe82-11c1-42d8-893f-10b41e3f02b2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.297727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.298679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.299038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.299382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.300185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.302298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.332997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1636/3301] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:00:07 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:00:07.337158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.368666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220046fc-8ea5-442f-9e74-787c696389ee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.384439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.386038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.386403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.387376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.387613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.391776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.424573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1666/3302] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:07.425495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.432257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:07.444427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c07344-2efb-429e-b63b-3277570a13df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.458808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.459692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.460076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.460451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.461290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.463281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d148d-83cb-49a5-8263-58f5b71f0a80 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.488430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1637/3303] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:07.490378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.507724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2bb90-0f23-4aa7-b0fe-9716da5272a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.515007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.516217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.516600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.516976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] PATH_INFO: `/v3/projects/2f6678835ec247d69b883f430be98e08/users/3f083a447601492b8b9d7ad1ad9d934a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.536488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6678835ec247d69b883f430be98e08, user_id=3f083a447601492b8b9d7ad1ad9d934a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.539308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.557341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1667/3304] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:00:07 2022] PUT /identity/v3/projects/2f6678835ec247d69b883f430be98e08/users/3f083a447601492b8b9d7ad1ad9d934a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:07.562470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcac82-9010-44b2-bc62-0dd17e4aea4d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.562834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcac82-9010-44b2-bc62-0dd17e4aea4d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.563177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcac82-9010-44b2-bc62-0dd17e4aea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.599501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-87fcac82-9010-44b2-bc62-0dd17e4aea4d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:07.600179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87fcac82-9010-44b2-bc62-0dd17e4aea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:07.708430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1638/3305] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:07.732996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:07.735406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:07.857416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251166c8-6992-422d-be22-f00ae95acf5f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:07.861874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:07.864054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:07.864511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:07.864974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:07.880430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:07.882493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0681ef-9b0e-4ff8-8e9a-ccd3820d24a4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:07.894636 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1668/3306] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:08.494631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:08.496264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:08.496994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:08.500462 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1639/3307] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:00:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:00:08.511970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:08.512559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:08.513014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:08.536589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:08.539763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:08.613057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:08.680189 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1669/3308] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:08.700235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:08.702331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:08.741833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ebdf-3088-4b8f-9d90-6aa53d9c7874 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:08.756903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:08.757963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:08.758525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:08.759315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:08.785610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:08.788761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3eaa7-bf15-4a65-9257-b9a5f0da7d3a service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:08.826818 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1640/3309] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:09.113557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:09.126395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bd7d8-1182-47bb-b780-486d8a80514f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:09.133569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:09.134303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:09.134582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:09.134857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:09.137716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:09.167790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:09.173875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1c84-0a69-4f07-a030-8fc4b65c2ce0 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:09.188680 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1670/3310] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:09.516304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7661-29d5-47be-90b7-8209996cfa7f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:09.516769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7661-29d5-47be-90b7-8209996cfa7f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:09.516897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7661-29d5-47be-90b7-8209996cfa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:09.552727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-94ab7661-29d5-47be-90b7-8209996cfa7f None None] MFA Rules not processed for user `81630e4b323d43a08a368471273a2989`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:09.559480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:09.560156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:09.560612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:09.573025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94ab7661-29d5-47be-90b7-8209996cfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:09.591971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:09.593196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:09.675339 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1641/3311] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:09.679889 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1671/3312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:11.468749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:11.470675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:11.494694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a997f-fd3d-470d-91c3-0f655f9b214a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:11.502669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:11.503353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:11.504295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:11.505205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:11.508806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:11.527708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:11.529684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5ebff-5ce3-4cd1-a7ce-2bfc7d72671f service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:11.554942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1672/3313] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:16.671977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59de0c-7af8-4a60-aa74-5283f4a42fff None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:16.672880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59de0c-7af8-4a60-aa74-5283f4a42fff None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:16.673325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59de0c-7af8-4a60-aa74-5283f4a42fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:16.727390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4c59de0c-7af8-4a60-aa74-5283f4a42fff None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:16.731403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4c59de0c-7af8-4a60-aa74-5283f4a42fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:16.745812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1642/3314] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:21.539706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=47 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:21.738995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:21.739347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:21.739711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:21.781393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:21.783881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:21.954332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1673/3315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:22.833686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:22.834136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:22.834518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:22.886080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] MFA Rules not processed for user `3f083a447601492b8b9d7ad1ad9d934a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:22.887437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:22.992178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1643/3316] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:25.479016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:25.481598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:25.681696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d89b32-1167-4bb8-9916-ede0e5c873ff None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:25.691553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:25.692644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:25.693088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:25.693582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:25.707663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:25.710431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dd499-332f-48f5-940b-7d1384dc1569 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:25.724124 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1674/3317] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:26.050892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:26.078249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d509c0-295e-4d1b-8a1d-d815242f8f2d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:26.085699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:26.086886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:26.087232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:26.087676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:26.090253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:26.113321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:26.126692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:26.129050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd59c6-290b-491f-adee-f845eecabdc4 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:26.144025 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1644/3318] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:28.747253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232483d9-6133-4d38-9e02-9e3e040c0abe None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:28.748557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232483d9-6133-4d38-9e02-9e3e040c0abe None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:28.749218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232483d9-6133-4d38-9e02-9e3e040c0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:28.781630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-232483d9-6133-4d38-9e02-9e3e040c0abe None None] MFA Rules not processed for user `3f083a447601492b8b9d7ad1ad9d934a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:28.782786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-232483d9-6133-4d38-9e02-9e3e040c0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:28.794950 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1675/3319] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:36.138143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:36.294782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d705a-4608-44ac-8e33-8169d7d4c0cf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:36.295461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d705a-4608-44ac-8e33-8169d7d4c0cf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:36.295886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d705a-4608-44ac-8e33-8169d7d4c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:36.355968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-990d705a-4608-44ac-8e33-8169d7d4c0cf None None] MFA Rules not processed for user `be44957fa2304f52a8d34bdac9eaca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:36.364191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-990d705a-4608-44ac-8e33-8169d7d4c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:36.499654 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1645/3320] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:38.774911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=62 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:39.001179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:39.002178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:39.002589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:39.031993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] MFA Rules not processed for user `5b4c3539c5534d2c844944f9be3f9963`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:39.035097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:39.134751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1676/3321] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:42.610218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e720-c333-4b90-9bd7-60e59db2a64e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:42.611426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e720-c333-4b90-9bd7-60e59db2a64e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:42.611983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9e720-c333-4b90-9bd7-60e59db2a64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:42.632059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9ee9e720-c333-4b90-9bd7-60e59db2a64e None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:42.633849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9ee9e720-c333-4b90-9bd7-60e59db2a64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:42.641025 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1646/3322] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:43.182449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:43.197549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfcf45-3d44-4757-826c-5048683f8793 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:43.207540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:43.208771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:43.209259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:43.209755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:43.212097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:43.227292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:43.230262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:43.244860 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1677/3323] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:43.350946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:43.351194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:43.352112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:43.367085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:43.368881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:43.398814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3ff9a-13d1-4a12-bfe1-721df6dff931 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:43.404293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:43.405714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:43.406250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:43.406885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] PATH_INFO: `/v3/users/c329a5d4cc2f4311ae154a8810698837` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:43.409064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c329a5d4cc2f4311ae154a8810698837)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:43.411300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:43.427657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:43.429145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:43.450711 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1647/3324] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:43.533290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c329a5d4cc2f4311ae154a8810698837'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:43.548244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c329a5d4cc2f4311ae154a8810698837'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:43.550420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c329a5d4cc2f4311ae154a8810698837'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:43.552028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c329a5d4cc2f4311ae154a8810698837'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:43.583846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-455fa7a9-4971-484d-b8b3-20b2b0cb25fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c329a5d4cc2f4311ae154a8810698837'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:43.613490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1678/3325] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:00:43 2022] DELETE /identity/v3/users/c329a5d4cc2f4311ae154a8810698837 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:00:44.239744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:44.256232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57c074-f4d5-4367-a644-05a94b7bd54b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:44.326206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:44.327750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.328335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.329562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] PATH_INFO: `/v3/projects/2df84f0dd560488b9b85303294bc6fca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.331102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df84f0dd560488b9b85303294bc6fca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:44.334178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:44.421826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df84f0dd560488b9b85303294bc6fca', 'request_id': 'req-e1284eb8-d1db-4729-ae8b-418f27a00a7a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:44.444410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df84f0dd560488b9b85303294bc6fca', 'request_id': 'req-e1284eb8-d1db-4729-ae8b-418f27a00a7a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:44.460248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df84f0dd560488b9b85303294bc6fca', 'request_id': 'req-e1284eb8-d1db-4729-ae8b-418f27a00a7a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:44.482343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] The token cache is being invalidate because project 2df84f0dd560488b9b85303294bc6fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:00:44.482888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:44.484507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e1284eb8-d1db-4729-ae8b-418f27a00a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:44.487179 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1648/3326] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:00:44 2022] DELETE /identity/v3/projects/2df84f0dd560488b9b85303294bc6fca => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:44.494106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.495377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.496101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.540083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:44.542934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:44.667653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.668094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.668256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.668427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1679/3327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:44.694362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:44.696271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:44.711727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:44.717743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1649/3328] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:44.720936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:44.728307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed2a1-a089-4cf2-ba6c-9917ef792a09 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:44.738345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:44.739410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.740180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.741060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.742251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:00:44.742893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:44.744791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:44.782946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1680/3329] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:00:44.783416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:44.798292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5404012-27cf-43e9-b909-4f11dea094e0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:44.810086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:44.811242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.811763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.813171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.814111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:44.816286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:44.832889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:44.858142 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1650/3330] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:00:44 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:00:44.862095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:44.873085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599a7a0-b372-4848-9599-d6db6fcf6d23 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:44.963259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:44.963997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:44.964277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:44.964554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:44.965784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:44.967413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:45.017517 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1681/3331] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:00:44 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:00:45.019409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:45.039170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1d7f-9455-4cae-ac36-6638ce458f65 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:45.053131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:45.054921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:45.056653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:45.057992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:45.062079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:45.067363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:45.105497 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1651/3332] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:00:45.106425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:45.141968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3c6e6-7044-49f8-bd01-b3f1c3de185f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:45.163403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:45.164278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:45.164561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:45.164870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:45.176279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:45.177940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8189e-2a71-460a-8ea2-10db940fefbc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:45.217840 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1682/3333] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:45.222243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:45.239847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daa655-1315-41c3-8ea8-d2c52c3ad8ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:45.248261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:45.250696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:45.252083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:45.252573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] PATH_INFO: `/v3/projects/b0cebb51402146e693490f681342be4f/users/d96f5288364449e3af2f39c71a8c3ef2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:45.292540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cebb51402146e693490f681342be4f, user_id=d96f5288364449e3af2f39c71a8c3ef2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:45.298672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:45.335611 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1652/3334] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:00:45 2022] PUT /identity/v3/projects/b0cebb51402146e693490f681342be4f/users/d96f5288364449e3af2f39c71a8c3ef2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:00:45.340788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff47-ec5e-428e-b51c-7ded57dc2c92 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:45.341091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff47-ec5e-428e-b51c-7ded57dc2c92 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:45.342886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff47-ec5e-428e-b51c-7ded57dc2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:45.383725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-224aff47-ec5e-428e-b51c-7ded57dc2c92 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:45.386623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-224aff47-ec5e-428e-b51c-7ded57dc2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:45.520173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1683/3335] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:45.572303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:45.575459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:45.697498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b603f-e97c-4abf-b8c6-d5fcf3810e4e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:45.706739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:45.707839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:45.709177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:45.709702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:45.737079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:45.741212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb10065-3ab9-4d8b-bc4a-96879be12003 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:45.762668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1653/3336] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:48.071568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:48.072519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:48.072984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:48.106717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] MFA Rules not processed for user `d96f5288364449e3af2f39c71a8c3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:48.108295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:48.193129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:48.207038 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1684/3337] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:48.218313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aba9f-dcf9-4860-bbd4-39193910ea4e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:48.223434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aba9f-dcf9-4860-bbd4-39193910ea4e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:48.223835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aba9f-dcf9-4860-bbd4-39193910ea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:48.242768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-908aba9f-dcf9-4860-bbd4-39193910ea4e None None] MFA Rules not processed for user `d96f5288364449e3af2f39c71a8c3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:48.244069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-908aba9f-dcf9-4860-bbd4-39193910ea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:48.253223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1654/3338] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:48.750404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:48.752009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:48.838473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc320-ea9d-4117-a6dd-851851cd93ba None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:48.844460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:48.845123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:48.845428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:48.845690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:48.854433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:48.856103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40c91-b8dd-4021-ad69-e9019b8e31e3 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:48.866327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1685/3339] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:52.177034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336ba2-cfb0-4b62-8aea-21157fc31cab None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:52.177597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336ba2-cfb0-4b62-8aea-21157fc31cab None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:52.177597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b336ba2-cfb0-4b62-8aea-21157fc31cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:52.219721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0b336ba2-cfb0-4b62-8aea-21157fc31cab None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:52.221334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b336ba2-cfb0-4b62-8aea-21157fc31cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:52.402726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1655/3340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:55.044139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:55.044647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:55.044754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:55.046639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1686/3341] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:00:55.053167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9edbba-7d42-4dc6-934f-99e870bdda14 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:55.053800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9edbba-7d42-4dc6-934f-99e870bdda14 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:55.053800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9edbba-7d42-4dc6-934f-99e870bdda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:55.086036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3e9edbba-7d42-4dc6-934f-99e870bdda14 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:55.091238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e9edbba-7d42-4dc6-934f-99e870bdda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:55.167967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:55.188577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1656/3342] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:55.214315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:55.221806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:55.244917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468faad9-02b2-4018-ab51-b6ea4c689729 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:55.250682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:55.252416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:55.252874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:55.253323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:55.263935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:55.266591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:55.283686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1687/3343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:55.433532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:55.433805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:55.434090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:55.471134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:55.472774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:55.481228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1657/3344] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:55.844287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:55.847135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:55.870512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319b72-2312-4f09-997d-50c6adc2be34 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:55.883233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:55.884287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:55.884574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:55.884854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] PATH_INFO: `/v3/users/e25328c90d26437a85d8d5509437ed99` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:55.886189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25328c90d26437a85d8d5509437ed99)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:55.888059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:56.033664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25328c90d26437a85d8d5509437ed99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.050022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25328c90d26437a85d8d5509437ed99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.052787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25328c90d26437a85d8d5509437ed99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.053901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25328c90d26437a85d8d5509437ed99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.097132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25328c90d26437a85d8d5509437ed99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.135169 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1688/3345] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:00:55 2022] DELETE /identity/v3/users/e25328c90d26437a85d8d5509437ed99 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:56.179785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:56.181486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:56.197724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a951-7641-4129-9e06-ff31ddd13000 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:56.287925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:56.289720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:56.290208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:56.290668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:56.292793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:56.306980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:56.309475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:56.322149 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1658/3346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:56.506823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:56.508791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:56.569019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:56.594784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea154-377f-49f8-8f9a-9c578ce7dc4d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:56.599678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:56.600810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:56.601231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:56.601661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] PATH_INFO: `/v3/projects/af5ccb3a1d6f4f9e9eaad08d25ce57fd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:56.602886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5ccb3a1d6f4f9e9eaad08d25ce57fd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:56.604887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:56.663668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'request_id': 'req-08a54f10-28e0-42c9-84c6-022cc9c30871'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.670780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'request_id': 'req-08a54f10-28e0-42c9-84c6-022cc9c30871'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.680661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'request_id': 'req-08a54f10-28e0-42c9-84c6-022cc9c30871'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.698576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] The token cache is being invalidate because project af5ccb3a1d6f4f9e9eaad08d25ce57fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:00:56.698868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.699575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-08a54f10-28e0-42c9-84c6-022cc9c30871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.701379 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1689/3347] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:00:56 2022] DELETE /identity/v3/projects/af5ccb3a1d6f4f9e9eaad08d25ce57fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:56.705834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:56.719361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f14c3d-0d47-4108-950e-513f3db8eb69 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:56.799231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:56.800164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:56.800445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:56.800718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] PATH_INFO: `/v3/users/759145aa1b1b49aa89e3fd53b03639db` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:56.813585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=759145aa1b1b49aa89e3fd53b03639db)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:56.815654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:56.868951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949218aa-fda3-4f65-bf28-8310d7cd86c2 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:56.869238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949218aa-fda3-4f65-bf28-8310d7cd86c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:56.870759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949218aa-fda3-4f65-bf28-8310d7cd86c2 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:56.872715 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1690/3348] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:00:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:00:56.879928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:56.880825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:56.881272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:56.899407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759145aa1b1b49aa89e3fd53b03639db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.901330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759145aa1b1b49aa89e3fd53b03639db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.914873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759145aa1b1b49aa89e3fd53b03639db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.915880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759145aa1b1b49aa89e3fd53b03639db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.921916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:56.923854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:56.951777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759145aa1b1b49aa89e3fd53b03639db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:56.980506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1659/3349] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:00:56 2022] DELETE /identity/v3/users/759145aa1b1b49aa89e3fd53b03639db => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:57.097740 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1691/3350] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:57.135373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:57.137483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:57.163611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:57.280405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0ea2a-32eb-44e3-b967-e58efb75e15b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:57.290396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:57.291187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.291941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.292329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.303936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:57.305779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09a466-021b-4dcc-81ab-46a9a407c779 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:57.317577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1660/3351] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:57.578402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:57.580274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:57.597914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2a5b-3e6c-47ed-98f2-501c734df8ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:57.632268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980079ee-9154-40d5-ab29-f3fc4b36f5e2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.632813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980079ee-9154-40d5-ab29-f3fc4b36f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.633013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980079ee-9154-40d5-ab29-f3fc4b36f5e2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.635387 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1661/3352] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:00:57.649888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a3c7-6116-4d65-9330-720225730136 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.650346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a3c7-6116-4d65-9330-720225730136 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.651106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365a3c7-6116-4d65-9330-720225730136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.698585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f365a3c7-6116-4d65-9330-720225730136 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:57.699155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:57.700105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.700301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f365a3c7-6116-4d65-9330-720225730136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:57.700425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.700657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] PATH_INFO: `/v3/projects/750e978f5ee641678fe8a459dcb1b5bb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.701927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750e978f5ee641678fe8a459dcb1b5bb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:57.703919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:57.717105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:57.790084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750e978f5ee641678fe8a459dcb1b5bb', 'request_id': 'req-3b498178-ef14-462b-a199-bf411928d3e7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:57.797352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750e978f5ee641678fe8a459dcb1b5bb', 'request_id': 'req-3b498178-ef14-462b-a199-bf411928d3e7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:57.809750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750e978f5ee641678fe8a459dcb1b5bb', 'request_id': 'req-3b498178-ef14-462b-a199-bf411928d3e7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:57.814617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1662/3353] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:57.830300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] The token cache is being invalidate because project 750e978f5ee641678fe8a459dcb1b5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:00:57.830696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:57.831458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:00:57.833530 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1692/3354] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:00:57 2022] DELETE /identity/v3/projects/750e978f5ee641678fe8a459dcb1b5bb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:57.838688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1751c3-4a61-44d8-ad0b-276cede6456e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.839241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1751c3-4a61-44d8-ad0b-276cede6456e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.839606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1751c3-4a61-44d8-ad0b-276cede6456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.855955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:57.857663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:57.863751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1d1751c3-4a61-44d8-ad0b-276cede6456e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:57.865410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1d1751c3-4a61-44d8-ad0b-276cede6456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:57.933113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498178-ef14-462b-a199-bf411928d3e7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:57.937150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:57.938432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:57.938725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:57.939007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:57.941152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:58.006626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1663/3355] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:58.006626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22007-88a8-4861-9436-08298356728a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.006626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22007-88a8-4861-9436-08298356728a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.006626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22007-88a8-4861-9436-08298356728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.034570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1b22007-88a8-4861-9436-08298356728a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:58.036225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1b22007-88a8-4861-9436-08298356728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:58.053404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.055440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.067209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1664/3356] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:58.072464 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1693/3357] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:58.073058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22007-88a8-4861-9436-08298356728a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.087453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22007-88a8-4861-9436-08298356728a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.098141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.099320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.099850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.100314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.101370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:00:58.101849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.103728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.120735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1665/3358] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:00:58.125254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.137476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271591c-5056-40e6-87a6-a3761ba7a32b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.143152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.143919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.144196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.144682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.145710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.148289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.189308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1694/3359] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:00:58.194154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.214474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a6f8-819c-4da7-b73b-e6102d530fbd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.230762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:58.316620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.317953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.318346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.319697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.320829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.343297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.397570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1666/3360] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:00:58 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:00:58.402205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.416811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab945-2e94-4d0f-82ed-ea9c7715d603 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.423960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.425865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.426543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.427258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.430039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.432765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.450532 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1695/3361] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:58.455967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.485342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab3a86-5a59-4c12-ac78-0acaafb95bf1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.494014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.495247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.495761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.496864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.497723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.500691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02adec-3fef-4712-8d3e-87637633803a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.524667 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1667/3362] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:58.529521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:58.556375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46868-3866-4a93-b8aa-b22d66a4747a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:58.567744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:58.574495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.575094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.575521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] PATH_INFO: `/v3/projects/16009ca6488d471ab09561f8ce213d85/users/1cf3ea135b544f08aa06e58d4d485126/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.585040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:58.641060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16009ca6488d471ab09561f8ce213d85, user_id=1cf3ea135b544f08aa06e58d4d485126, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:58.652020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:58.691491 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1696/3363] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:00:58 2022] PUT /identity/v3/projects/16009ca6488d471ab09561f8ce213d85/users/1cf3ea135b544f08aa06e58d4d485126/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:58.704836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:58.705589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:58.705983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:58.780292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] MFA Rules not processed for user `1cf3ea135b544f08aa06e58d4d485126`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:58.783633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:58.947570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1668/3364] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:58.954996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.036033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd880470-76e6-420a-ac64-76268e94c629 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.045148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.047453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.047865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.048805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.049048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.051559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.082536 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1697/3365] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:00:59.086685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.100936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b318ba-7526-4614-997d-39565c63bad5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.211372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.213047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.213334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.213878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.214728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.217332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.246349 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1669/3366] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:00:59 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:00:59.250081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.262656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a317235-9ebd-48a1-92ff-a56ddc104163 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.269115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.269858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.270377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.270869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.272241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.274382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.292660 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1698/3367] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:59.296744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.313885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382740b-97a5-4fa9-a3f0-51dcb418a2f0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.328536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.329803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.330154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.330501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] PATH_INFO: `/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c/users/3cef145ac1e641a09d22ddfe8f913fd5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.346926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:59.364177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299a9d6db4e34ee6b3b08f4edc37ee7c, user_id=3cef145ac1e641a09d22ddfe8f913fd5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.373673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.399439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1670/3368] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:00:59 2022] PUT /identity/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c/users/3cef145ac1e641a09d22ddfe8f913fd5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:59.403806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.419163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf959205-b28a-4f0d-8746-9c1b30cba1a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.498596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.499658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.499929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.500267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.501117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.502960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1d200-ddea-4a72-8fd2-ee5650f5cdce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.518068 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1699/3369] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:00:59.522797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.534823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.535172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.535443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.541697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6583d-d226-4b04-a796-e8a213fdedb2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:00:59.556900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:00:59.558267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.558713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.559157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] PATH_INFO: `/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c/users/3cef145ac1e641a09d22ddfe8f913fd5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.560131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] MFA Rules not processed for user `425dba3904234fc08c2913a4e299b003`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:59.561465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=299a9d6db4e34ee6b3b08f4edc37ee7c, user_id=3cef145ac1e641a09d22ddfe8f913fd5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:00:59.562741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:59.565405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29d3d-1baa-4083-82b4-44dddc71ca1e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:00:59.581314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1671/3370] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:00:59 2022] PUT /identity/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c/users/3cef145ac1e641a09d22ddfe8f913fd5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:00:59.598188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:00:59.598820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:00:59.599092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:00:59.631681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:59.632650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] MFA Rules not processed for user `3cef145ac1e641a09d22ddfe8f913fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:00:59.633922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:00:59.642265 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1700/3371] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:00:59.729305 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1672/3372] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:00:59.925786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:00:59.927501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:00.049609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf78d2-1996-4023-a201-5fc574bdb3dd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:00.163672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:00.164986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:00.165571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:00.165873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:00.178568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:00.181750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b835fae-3441-4875-a835-a9e4c6a9c080 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:00.198587 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1701/3373] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:00.954673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:01.057148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4579b-2f6e-4d33-a1ff-a76473fc7347 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:01.063082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:01.063720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:01.064003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:01.064276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] PATH_INFO: `/v3/users/1cf3ea135b544f08aa06e58d4d485126` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:01.065510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf3ea135b544f08aa06e58d4d485126)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:01.067460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:01.164437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf3ea135b544f08aa06e58d4d485126'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:01.168658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf3ea135b544f08aa06e58d4d485126'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:01.194166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf3ea135b544f08aa06e58d4d485126'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:01.194871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf3ea135b544f08aa06e58d4d485126'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:01.203670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:01.228425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf3ea135b544f08aa06e58d4d485126'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:01.255829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1673/3374] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:00 2022] DELETE /identity/v3/users/1cf3ea135b544f08aa06e58d4d485126 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:01.265555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:01.266791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:01.267707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:01.307544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:01.308879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:01.434238 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1702/3375] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:01.445004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:01.446873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:01.550592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44288a-90d8-498f-bc5c-742faa2f76b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:01.554704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:01.555080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:01.555338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:01.555653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:01.567199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:01.569514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:01.585798 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1674/3376] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:02.167231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:02.169612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:02.199006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a08401-33e4-48b2-89cc-252c4443b1a3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:02.210837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:02.211718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:02.212008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:02.212284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] PATH_INFO: `/v3/projects/16009ca6488d471ab09561f8ce213d85` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:02.215746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=16009ca6488d471ab09561f8ce213d85)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:02.218333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:02.250799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:02.289705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16009ca6488d471ab09561f8ce213d85', 'request_id': 'req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.306446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16009ca6488d471ab09561f8ce213d85', 'request_id': 'req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.315876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16009ca6488d471ab09561f8ce213d85', 'request_id': 'req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.335565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] The token cache is being invalidate because project 16009ca6488d471ab09561f8ce213d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:02.336184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.337379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.343588 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1703/3377] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:02 2022] DELETE /identity/v3/projects/16009ca6488d471ab09561f8ce213d85 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:02.345402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:02.367323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038a59c-1ff2-41be-8d82-88c55fe08bd7 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:02.441692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:02.442594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:02.442995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:02.443153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] PATH_INFO: `/v3/users/3cef145ac1e641a09d22ddfe8f913fd5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:02.444784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cef145ac1e641a09d22ddfe8f913fd5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:02.446958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:02.513110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cef145ac1e641a09d22ddfe8f913fd5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.513954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cef145ac1e641a09d22ddfe8f913fd5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.523223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cef145ac1e641a09d22ddfe8f913fd5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.524523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cef145ac1e641a09d22ddfe8f913fd5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.540117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1ca63972-7ddd-4f2d-aee6-b9261b82e5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cef145ac1e641a09d22ddfe8f913fd5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:02.550987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:02.559903 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1675/3378] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:02 2022] DELETE /identity/v3/users/3cef145ac1e641a09d22ddfe8f913fd5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:03.564703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:03.566416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:03.581425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd03cf5-e020-49ba-97ad-182ee0c8c1de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:03.659651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:03.660670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:03.661023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:03.661456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] PATH_INFO: `/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:03.662746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299a9d6db4e34ee6b3b08f4edc37ee7c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:03.665209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:03.728322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299a9d6db4e34ee6b3b08f4edc37ee7c', 'request_id': 'req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:03.735799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299a9d6db4e34ee6b3b08f4edc37ee7c', 'request_id': 'req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:03.742262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299a9d6db4e34ee6b3b08f4edc37ee7c', 'request_id': 'req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:03.761194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] The token cache is being invalidate because project 299a9d6db4e34ee6b3b08f4edc37ee7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:03.761574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:03.762232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d2a23bf1-5796-46d3-aaa2-eb15a62503f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:03.763873 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1704/3379] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:03 2022] DELETE /identity/v3/projects/299a9d6db4e34ee6b3b08f4edc37ee7c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:03.769199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:03.769707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:03.769812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:03.792799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:03.794447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:03.859094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1676/3380] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:03.867452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:03.867863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:03.868089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:03.899583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:03.901116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:03.913425 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1705/3381] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:03.921572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:03.939244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2099d-ca98-467e-99c0-dd3f7da9b57e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:03.947580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:03.948279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:03.948553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:03.948829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:03.949568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:03.949873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:03.951689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:03.974384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1677/3382] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:01:03.976008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:03.990827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bae4a-c63c-4520-8867-a2b755ba5be8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.000814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.001781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.002648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.003095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.004037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.007453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.044486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1706/3383] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:03 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:04.048330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.060909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02fe05-bcba-4157-8f57-8cf27cdf98b1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.108847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.111763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.139195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.140235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.140520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.140794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.141479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.143397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.143578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.169190 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1678/3384] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:04.176694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.189516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec6c1d-e75f-4a4c-848c-1933e740c72e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.196039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.196725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.197009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.197286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.198026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.199662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.205387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111492e9-87f5-4829-a56b-62793e3f95cd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.210303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.210502 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1679/3385] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:04.211434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.211706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.211988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] PATH_INFO: `/v3/users/81630e4b323d43a08a368471273a2989` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.213683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81630e4b323d43a08a368471273a2989)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.214556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.215468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.224969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c1f21-357a-43b1-ab6c-838fee3187e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.230470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.231276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.231482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.231907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.232644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.234247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.246675 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1680/3386] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:01:04.250998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.262086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da831-a9cc-40b3-abe9-d02abaeaeab7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.267098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.268017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.268300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.268574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] PATH_INFO: `/v3/projects/7e07c2f32e614025b7ae8c027e30025e/users/46319305d0da4bddb917b356d0aea258/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.272144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81630e4b323d43a08a368471273a2989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.280576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81630e4b323d43a08a368471273a2989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.281503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81630e4b323d43a08a368471273a2989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.282181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81630e4b323d43a08a368471273a2989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.285376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e07c2f32e614025b7ae8c027e30025e, user_id=46319305d0da4bddb917b356d0aea258, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.288122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4aac5-9265-4c4a-9786-b3562b31f92c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.294952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81630e4b323d43a08a368471273a2989'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.304945 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1681/3387] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:04 2022] PUT /identity/v3/projects/7e07c2f32e614025b7ae8c027e30025e/users/46319305d0da4bddb917b356d0aea258/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:04.313549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1707/3388] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:04 2022] DELETE /identity/v3/users/81630e4b323d43a08a368471273a2989 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:04.315983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.316275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.316557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.343991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] MFA Rules not processed for user `46319305d0da4bddb917b356d0aea258`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:04.345223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.379106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.424807 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1682/3389] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:04.429867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.432288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.520420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.521903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7ee21-337f-44a1-9e52-65d604a2fd70 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.523397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.533122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.537351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.537658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.537989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.538795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.540947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.547771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00ccd0-3833-4dc0-9193-e02bdd30ed5e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.557024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.557925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.558208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.558828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] PATH_INFO: `/v3/projects/d9e0e340cb8d4a64bdfeafcba8908f89` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.560110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e0e340cb8d4a64bdfeafcba8908f89)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.562786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.576693 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1708/3390] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:04.580836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.597934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.624012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'request_id': 'req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.630932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'request_id': 'req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.636561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'request_id': 'req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.651789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] The token cache is being invalidate because project d9e0e340cb8d4a64bdfeafcba8908f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:04.652099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.652776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1dccc7b5-5d2d-4786-ad8e-a250d82c3e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:04.654371 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1683/3391] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:04 2022] DELETE /identity/v3/projects/d9e0e340cb8d4a64bdfeafcba8908f89 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:04.655185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195308-e825-428b-a877-57c9d12ba7d6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.660560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a73f6-aa50-41e9-b9d7-566db14ca0bf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.660923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a73f6-aa50-41e9-b9d7-566db14ca0bf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.661181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a73f6-aa50-41e9-b9d7-566db14ca0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.680405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cb3a73f6-aa50-41e9-b9d7-566db14ca0bf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:04.681690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb3a73f6-aa50-41e9-b9d7-566db14ca0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.714984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.715691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.715971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.716248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.717041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.719031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.741651 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1709/3392] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:04.746997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1684/3393] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:04.748630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.750340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.755496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.755815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.756236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.765043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea9a9f-744a-4022-bfbd-984314e46750 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.770434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.771306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.771983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.772350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.773250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.775389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.777389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:04.778601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:04.788005 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1685/3394] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:04.788228 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1710/3395] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:04.791983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.792122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.801642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c00be7-78fe-44a4-a2aa-9ed055c31142 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.803476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9addee-bf8f-4316-97ec-82efdb7884c5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.806707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.807376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.807693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.808072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.808746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.808891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:04.809173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.809723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.809981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.810257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] PATH_INFO: `/v3/projects/2fd04bdf1d94442e8f24473b329d1968/users/735146df0d4942f6a71a0e1031176413/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.810833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.827386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1686/3396] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:01:04.828506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.832152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd04bdf1d94442e8f24473b329d1968, user_id=735146df0d4942f6a71a0e1031176413, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.834862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.839990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3ba1-c170-496e-9efc-6f4ae81d6f48 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.844795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.845481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.845842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.846244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.846838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.848795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.855321 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1711/3397] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:04 2022] PUT /identity/v3/projects/2fd04bdf1d94442e8f24473b329d1968/users/735146df0d4942f6a71a0e1031176413/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:04.860932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.880600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1687/3398] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:04.885550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:04.891249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.937353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435a37a-23ce-41a8-9289-b43f58c41754 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.956161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:04.959795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d547ca-d3b7-4567-b4e1-3894e15dd69d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:04.965337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:04.966091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:04.966321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:04.966594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:04.967288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:04.969308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:04.995213 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1688/3399] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:04 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:04.996441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.002810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.003420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.003744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.004025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.004759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.006426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.006558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43193c4-d29c-48ad-b4ac-aa6843f2c2bf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.012241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.012907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.013190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.013469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.014275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.015817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.017522 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1712/3400] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:05.021923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.027217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1689/3401] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:05.030707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.032502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce286f0-9147-44d9-a86e-5c6ac8428128 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.037123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.038019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.038299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.038632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] PATH_INFO: `/v3/projects/2fd04bdf1d94442e8f24473b329d1968/users/735146df0d4942f6a71a0e1031176413/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.040706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd04bdf1d94442e8f24473b329d1968, user_id=735146df0d4942f6a71a0e1031176413, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.041440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2197fb-b080-4804-9800-4e0c93f64155 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.043391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e08a1-acd3-4f17-831e-b05e9907fa0c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.046470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.047184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.047466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.047775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.048496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.050589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.054497 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1713/3402] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:05 2022] PUT /identity/v3/projects/2fd04bdf1d94442e8f24473b329d1968/users/735146df0d4942f6a71a0e1031176413/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:05.068027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1690/3403] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:01:05.068248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2a85-279c-4b0f-b145-f7c4ea1ac322 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.068248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2a85-279c-4b0f-b145-f7c4ea1ac322 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.068248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f2a85-279c-4b0f-b145-f7c4ea1ac322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.069267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.081121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8a8a0-c917-44e7-b17f-bd42bcfadcc2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.095853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a31f2a85-279c-4b0f-b145-f7c4ea1ac322 None None] MFA Rules not processed for user `735146df0d4942f6a71a0e1031176413`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:05.097070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a31f2a85-279c-4b0f-b145-f7c4ea1ac322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:05.146355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.147843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.148134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.148414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] PATH_INFO: `/v3/projects/83e17865ce4e4d2ba7854d03668bfb78/users/890837d5b27e4471b54c1eac851e88c5/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.172797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e17865ce4e4d2ba7854d03668bfb78, user_id=890837d5b27e4471b54c1eac851e88c5, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.176188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.185014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1714/3404] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:05.195380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1691/3405] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:05 2022] PUT /identity/v3/projects/83e17865ce4e4d2ba7854d03668bfb78/users/890837d5b27e4471b54c1eac851e88c5/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:05.202539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.202834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.203118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.221025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:05.222952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:05.285331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1715/3406] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:05.294945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.296772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:05.354683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3bf1-201c-496e-bcba-6478b5fb5954 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.358888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.359582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.359868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.360144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.369222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:05.371871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.381358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.387265 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1692/3407] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:05.388809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:05.391222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:05.431071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:05.472621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987505-4fd6-428c-96bd-fb1f284e1170 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:05.478995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:05.479724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:05.480007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:05.480282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:05.482179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:05.555729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:05.557400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62aa816-42c0-48d6-975b-77f3a393e0e7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:05.568074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1716/3408] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:06.289383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:06.291275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:06.308640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c293-4c71-46d4-99f4-e005ccf413e1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:06.315301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:06.316004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:06.316307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:06.316562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:06.388852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:06.391022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:06.403779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1693/3409] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:10.876354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:10.876991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:10.876991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:10.909032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] MFA Rules not processed for user `890837d5b27e4471b54c1eac851e88c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:10.910267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:11.000242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.001056 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1717/3410] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:11.014264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b88b-2205-47ca-99d0-a1c1afa8c998 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.020327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.021205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.021891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.022236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.023324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.025664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.066346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1694/3411] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:10 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:11.070590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.092698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674316b-b2ae-4eaf-a5e8-2659322ef4c2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.163782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:11.176550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.177818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.178649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.180083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.187813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.189802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.219555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1718/3412] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:11 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:11.222039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.235372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2cb53-f79c-476a-be8b-28f92fa7ebe1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.241151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.241921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.242209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.242492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.243654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.244907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.259600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1695/3413] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:11.262300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.278516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5844ae-e05a-4d51-865d-f3758f3e617e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.284904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.286111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.286774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.287656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] PATH_INFO: `/v3/projects/1fe754dc088e4273aa7204d368d076d3/users/2223013130e24fbf8c5f254456bd9417/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.318272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe754dc088e4273aa7204d368d076d3, user_id=2223013130e24fbf8c5f254456bd9417, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.321805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.363305 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1719/3414] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:11 2022] PUT /identity/v3/projects/1fe754dc088e4273aa7204d368d076d3/users/2223013130e24fbf8c5f254456bd9417/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:11.369370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.393699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c047e-c61e-4bf6-9433-9864158e56ce admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.479437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.480399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.480711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.481051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.481921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.483916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.500153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1696/3415] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:11.504065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:11.543357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1acec-434c-465b-b8ad-5f67faaeec3c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:11.543357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:11.543357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:11.543357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:11.543842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] PATH_INFO: `/v3/projects/1fe754dc088e4273aa7204d368d076d3/users/2223013130e24fbf8c5f254456bd9417/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:11.543842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe754dc088e4273aa7204d368d076d3, user_id=2223013130e24fbf8c5f254456bd9417, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:11.543842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795f23-8134-4cb3-8bb5-dbe82b6cdb4c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:11.551712 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1720/3416] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:11 2022] PUT /identity/v3/projects/1fe754dc088e4273aa7204d368d076d3/users/2223013130e24fbf8c5f254456bd9417/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:12.354362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:12.370641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba596c1-42c8-4732-ac44-0838e3bd6488 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:12.531173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:12.563155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:12.564108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:12.564396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:12.564680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] PATH_INFO: `/v3/users/46319305d0da4bddb917b356d0aea258` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:12.565935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] RBAC: Authorizing `identity:delete_user(user_id=46319305d0da4bddb917b356d0aea258)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:12.568232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:12.693504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46319305d0da4bddb917b356d0aea258'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:12.694199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46319305d0da4bddb917b356d0aea258'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:12.703734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46319305d0da4bddb917b356d0aea258'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:12.704468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46319305d0da4bddb917b356d0aea258'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:12.729847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46319305d0da4bddb917b356d0aea258'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:12.758356 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1697/3417] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:12 2022] DELETE /identity/v3/users/46319305d0da4bddb917b356d0aea258 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:12.765012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:12.765900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:12.766364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:12.818380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:12.820326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:12.973414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1721/3418] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:12.979899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:12.982629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:13.090523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eae8-97cf-4f90-bbfb-5da372a6febc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:13.094674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:13.095357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:13.095677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:13.095957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:13.109619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:13.111792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:13.126694 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1698/3419] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:13.977326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:13.981189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:14.018165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473f4-b95f-4c0b-9ac7-3d85294080e0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:14.028941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:14.029852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:14.030273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:14.030566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] PATH_INFO: `/v3/projects/7e07c2f32e614025b7ae8c027e30025e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:14.038032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e07c2f32e614025b7ae8c027e30025e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:14.040978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:14.134479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e07c2f32e614025b7ae8c027e30025e', 'request_id': 'req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.142639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e07c2f32e614025b7ae8c027e30025e', 'request_id': 'req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.162075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e07c2f32e614025b7ae8c027e30025e', 'request_id': 'req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.187771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] The token cache is being invalidate because project 7e07c2f32e614025b7ae8c027e30025e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:14.188219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.193564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdcca26-a799-4af9-85bb-a4f2b6c6d341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.195976 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1722/3420] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:13 2022] DELETE /identity/v3/projects/7e07c2f32e614025b7ae8c027e30025e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:14.201404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:14.230836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e7d0-8694-43d7-9842-64bab1ef5f41 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:14.380531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:14.381552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:14.382091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:14.383914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] PATH_INFO: `/v3/users/735146df0d4942f6a71a0e1031176413` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:14.385312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735146df0d4942f6a71a0e1031176413)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:14.387214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:14.433588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:14.513522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735146df0d4942f6a71a0e1031176413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.515809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735146df0d4942f6a71a0e1031176413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.549845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:14.550162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:14.550474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:14.553365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735146df0d4942f6a71a0e1031176413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.555165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735146df0d4942f6a71a0e1031176413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.581778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:14.583879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:14.593797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735146df0d4942f6a71a0e1031176413'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:14.643829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1699/3421] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:14 2022] DELETE /identity/v3/users/735146df0d4942f6a71a0e1031176413 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:14.673108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:14.711281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1723/3422] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:14.789069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:14.790561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:14.928290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031b1d-2433-45b2-9e5c-0aa59da249f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:14.949403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:14.952757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:14.955807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:14.958021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:15.078675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:15.083719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf20f57-b86f-4b95-9eb5-47844e6bf5d1 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:15.115762 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1700/3423] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:15.469163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:15.473678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:15.510563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d046ca-2e72-4351-8afb-99e126c490d4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:15.737490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:15.739116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:15.742518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:15.743028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] PATH_INFO: `/v3/projects/2fd04bdf1d94442e8f24473b329d1968` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:15.748870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd04bdf1d94442e8f24473b329d1968)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:15.757392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:15.904880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd04bdf1d94442e8f24473b329d1968', 'request_id': 'req-40da5107-edb5-4380-bc83-fdb52430b730'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:15.938583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd04bdf1d94442e8f24473b329d1968', 'request_id': 'req-40da5107-edb5-4380-bc83-fdb52430b730'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:15.968543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd04bdf1d94442e8f24473b329d1968', 'request_id': 'req-40da5107-edb5-4380-bc83-fdb52430b730'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:16.003731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] The token cache is being invalidate because project 2fd04bdf1d94442e8f24473b329d1968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:16.004195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:16.005056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40da5107-edb5-4380-bc83-fdb52430b730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:16.009027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1724/3424] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:15 2022] DELETE /identity/v3/projects/2fd04bdf1d94442e8f24473b329d1968 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:16.016131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bbaf4-c93c-452a-aaf7-9fd4132dc1c4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.016131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bbaf4-c93c-452a-aaf7-9fd4132dc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.016131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bbaf4-c93c-452a-aaf7-9fd4132dc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.046650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-915bbaf4-c93c-452a-aaf7-9fd4132dc1c4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:16.052277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-915bbaf4-c93c-452a-aaf7-9fd4132dc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:16.153548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:16.177534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4332-437c-44d5-b544-73077a90df2f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.178301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4332-437c-44d5-b544-73077a90df2f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.182225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4332-437c-44d5-b544-73077a90df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.227685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-400e4332-437c-44d5-b544-73077a90df2f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:16.233809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-400e4332-437c-44d5-b544-73077a90df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:16.236548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1701/3425] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:16.245713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.246007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.246312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.283722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:16.284955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:16.315267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1702/3426] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:16.320600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.340067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beefda8-0a1a-49a0-9e79-644e1398e33f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.357717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.358411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.358689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.358960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.359732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:16.363279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:16.368228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:16.398336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1703/3427] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:01:16.402669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.414269 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1725/3428] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:16.422935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04c19-42bc-4be6-a23b-3d534c03649a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.437214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.437897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.438178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.438450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.439146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:16.441633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:16.453427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4332-437c-44d5-b544-73077a90df2f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.455007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-400e4332-437c-44d5-b544-73077a90df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:16.491704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:16.510756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1704/3429] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:16 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:16.516980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.653025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ee08-f56a-4d41-b49c-d3b344c175d6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.666272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.666913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.667851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.668435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.669148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:16.673112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:16.705508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4332-437c-44d5-b544-73077a90df2f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.726972 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1705/3430] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:16 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:16.731799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.746257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b9563-0a73-406c-9d1c-427c831e9b3c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.755353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.756356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.756742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.757224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.758639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:16.761316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:16.780380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1706/3431] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:01:16.791177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.817806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb22bd-2caf-4e70-b8df-d587f6f3bb86 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.834508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.835448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.835762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.836044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.837018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:16.840860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:16.893379 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1707/3432] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:16.897825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:16.909975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.910658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.910946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.911269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:16.925825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3397364-74f6-40ca-a133-4052f7eb3626 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:16.946946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:16.947836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:16.948229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:16.948388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] PATH_INFO: `/v3/projects/574e32b3eb5f4945a0db8b24ea8f8469/users/cea501dbd3de466a9c1095e8466165d0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:17.001383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574e32b3eb5f4945a0db8b24ea8f8469, user_id=cea501dbd3de466a9c1095e8466165d0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:17.014387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:17.014584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:17.016257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89328c-75e5-406d-b1c5-3824f24ebeca service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:17.028621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1726/3433] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:01:17.047927 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1708/3434] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:16 2022] PUT /identity/v3/projects/574e32b3eb5f4945a0db8b24ea8f8469/users/cea501dbd3de466a9c1095e8466165d0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:17.052988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-33af-4321-9b76-ae7bee561f0b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:17.053640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-33af-4321-9b76-ae7bee561f0b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:17.053962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e1e84-33af-4321-9b76-ae7bee561f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:17.115622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b89e1e84-33af-4321-9b76-ae7bee561f0b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:17.118086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b89e1e84-33af-4321-9b76-ae7bee561f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:17.264686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:17.291835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1727/3435] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:17.302445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:17.304578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:17.461194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:17.523613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b078-e5a8-485d-ada7-024102818998 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:17.538957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:17.539689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:17.540051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:17.540240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:17.576319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:17.577824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f6e29-318f-4fb2-9af6-6cde9d00e41c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:17.621912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1709/3436] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:22.078421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:22.078952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:22.078952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:22.129619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] MFA Rules not processed for user `2223013130e24fbf8c5f254456bd9417`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:22.131089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:22.253831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3d9-ac7e-4fec-a885-bfe9c78cbee8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:22.254285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3d9-ac7e-4fec-a885-bfe9c78cbee8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:22.254367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e3d9-ac7e-4fec-a885-bfe9c78cbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:22.291410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4e65e3d9-ac7e-4fec-a885-bfe9c78cbee8 None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:22.300583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4e65e3d9-ac7e-4fec-a885-bfe9c78cbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:22.332540 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1728/3437] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:22.341252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:22.347082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:22.479860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3f226-ae54-466e-953e-9940537cbfcc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:22.485891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1710/3438] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:22.487921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:22.490562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:22.492464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:22.493960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:22.500171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:22.732211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:22.734731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:22.763638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1729/3439] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:29.808565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851665-504d-430b-8cf6-8336accb636c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:29.809408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851665-504d-430b-8cf6-8336accb636c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:29.809408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851665-504d-430b-8cf6-8336accb636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:29.989227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-03851665-504d-430b-8cf6-8336accb636c None None] MFA Rules not processed for user `cea501dbd3de466a9c1095e8466165d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:30.000467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-03851665-504d-430b-8cf6-8336accb636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:30.337209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1711/3440] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:32.758061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:38.314356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:38.316884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:38.482381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42c100-46f3-49e4-accd-521cf268bb09 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:38.498413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:38.499280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:38.499670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:38.499955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:38.514234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:38.517195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:38.544685 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1730/3441] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:40.098871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a1f-8e8a-4c27-a955-a6569fffe297 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:40.099364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a1f-8e8a-4c27-a955-a6569fffe297 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:40.099440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a1f-8e8a-4c27-a955-a6569fffe297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:40.130731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4cf99a1f-8e8a-4c27-a955-a6569fffe297 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:40.132131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4cf99a1f-8e8a-4c27-a955-a6569fffe297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:40.266710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1712/3442] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:40.282991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:40.453060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53790710-9c01-450f-b9e4-2c414ad230c9 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:40.463627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:40.465349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:40.466465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:40.466887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:40.482466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:40.485176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:40.504888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1731/3443] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:01:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:41.504768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:41.505290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:41.505290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:41.536730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] MFA Rules not processed for user `d96f5288364449e3af2f39c71a8c3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:41.538135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:41.574765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:41.641255 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1713/3444] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:01:48.211101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:48.233601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858541d-ea8e-463d-8398-c406dda7e100 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:48.244406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:48.246292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:48.246738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:48.249564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] PATH_INFO: `/v3/users/cea501dbd3de466a9c1095e8466165d0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:48.253253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea501dbd3de466a9c1095e8466165d0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:48.269775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:48.378806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea501dbd3de466a9c1095e8466165d0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:48.408311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:48.409651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea501dbd3de466a9c1095e8466165d0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:48.410912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:48.411449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea501dbd3de466a9c1095e8466165d0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:48.413825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea501dbd3de466a9c1095e8466165d0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:48.462777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:48.470109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea501dbd3de466a9c1095e8466165d0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:48.503376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1732/3445] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:48 2022] DELETE /identity/v3/users/cea501dbd3de466a9c1095e8466165d0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:48.594579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd297709-c746-4afe-8716-f7b244606da6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:48.763775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:48.764886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:48.765362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:48.768630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:48.772244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:48.988742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:48.991891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a36f84-060c-4809-8cf7-53f855096976 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:49.041180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1714/3446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:01:49.939221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:49.946052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:50.149152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf616-18dc-4d45-9c0d-80614f73cea6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:50.183003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:50.183940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:50.188119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:50.188704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] PATH_INFO: `/v3/projects/574e32b3eb5f4945a0db8b24ea8f8469` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:50.192019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=574e32b3eb5f4945a0db8b24ea8f8469)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:50.194729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:50.273992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574e32b3eb5f4945a0db8b24ea8f8469', 'request_id': 'req-9130095b-175a-431e-a2ea-519f331a87ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:50.283630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574e32b3eb5f4945a0db8b24ea8f8469', 'request_id': 'req-9130095b-175a-431e-a2ea-519f331a87ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:50.295096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574e32b3eb5f4945a0db8b24ea8f8469', 'request_id': 'req-9130095b-175a-431e-a2ea-519f331a87ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:50.330018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] The token cache is being invalidate because project 574e32b3eb5f4945a0db8b24ea8f8469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:50.330507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:50.337803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9130095b-175a-431e-a2ea-519f331a87ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:50.350698 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1733/3447] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:49 2022] DELETE /identity/v3/projects/574e32b3eb5f4945a0db8b24ea8f8469 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:50.352638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:50.353165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:50.353346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:50.403065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:50.404764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:50.492528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:50.616530 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1715/3448] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:50.623846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:50.624258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:50.625100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:50.684075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:50.689648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:50.711869 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1734/3449] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:50.717285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:50.743447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe5fcc-829a-45bc-904c-0e93fb5186f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:50.765461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:50.766837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:50.767814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:50.770812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:50.774550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:50.775435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:50.777733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:50.849177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:50.861582 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1716/3450] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:01:50.867381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc785a-9163-4e7a-a5d0-ba806ba0003d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:50.884952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:50.886751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:50.887631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:50.888065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:50.890462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:50.920358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:50.994511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:50.995071 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1735/3451] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:50 2022] POST /identity/v3/projects => generated 395 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:51.010079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b223d-8b7d-4836-b5f8-8127e06ca3c5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:51.247883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:51.249418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:51.249880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:51.251122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:51.253303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:51.259483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:51.321519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1717/3452] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:50 2022] POST /identity/v3/users => generated 298 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:01:51.325448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:51.342643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faa0c3-cde7-4225-9373-d530a6d01563 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:51.348902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:51.349986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:51.350435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:51.350851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:51.351994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:51.353960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:51.372774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:51.383207 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1736/3453] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:51.387892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff31f-0e21-4e0b-a979-3aabb07d4b02 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:51.395841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:51.397333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:51.397792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:51.398255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:51.399930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:51.401905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7e96-82a1-4e13-b2e3-16eaebc13e21 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:51.420275 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1718/3454] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:51.424395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:51.438394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e56c-e208-4ba1-89e5-d2ceab461233 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:51.460678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:51.461722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:51.462007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:51.462319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] PATH_INFO: `/v3/projects/30dfb49bbee24d9dacf529ded86a18f8/users/28c7d452f8ee427f8b40c32ab14de52e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:51.494788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dfb49bbee24d9dacf529ded86a18f8, user_id=28c7d452f8ee427f8b40c32ab14de52e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:51.497581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:51.528985 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1737/3455] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:51 2022] PUT /identity/v3/projects/30dfb49bbee24d9dacf529ded86a18f8/users/28c7d452f8ee427f8b40c32ab14de52e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:51.532272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:51.532555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:51.532845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:51.576226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] MFA Rules not processed for user `28c7d452f8ee427f8b40c32ab14de52e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:51.581745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:51.728728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1719/3456] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:52.266738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:52.269178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:52.298030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:52.401095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c387ea1-882b-47cc-97f3-ca6440a5cb44 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:52.413150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:52.414144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:52.414571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:52.415014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:52.429298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:52.431869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f65551-c842-477b-8da4-8ab668039cf7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:52.514333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1738/3457] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:52.857671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:52.892307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:52.996407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98cc66-2a94-4844-aae3-d63c523dfa06 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:53.001884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:53.003304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:53.003799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:53.004310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] PATH_INFO: `/v3/users/28c7d452f8ee427f8b40c32ab14de52e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:53.006063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c7d452f8ee427f8b40c32ab14de52e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:53.008695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:53.101189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c7d452f8ee427f8b40c32ab14de52e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:53.102610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c7d452f8ee427f8b40c32ab14de52e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:53.112996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c7d452f8ee427f8b40c32ab14de52e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:53.114083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c7d452f8ee427f8b40c32ab14de52e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:53.130970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c7d452f8ee427f8b40c32ab14de52e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:53.152238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1720/3458] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:52 2022] DELETE /identity/v3/users/28c7d452f8ee427f8b40c32ab14de52e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:53.156903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:53.157662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:53.158602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:53.180941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:53.183453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:53.277769 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1739/3459] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:53.321288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:53.324420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:53.416614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0452bd4-7b5c-447f-ae8e-f1ea5ec61a6f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:53.422037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:53.422501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:53.422762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:53.423044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:53.437771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:53.439670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb267f-9ce7-48c8-a2d6-1b82701cbb5b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:53.453107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1721/3460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:55.506860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:55.509416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:55.526070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d654ec4-ee8c-42ce-b24c-350d4a50fa42 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:55.537768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:55.540118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:55.540622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:55.541155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] PATH_INFO: `/v3/projects/30dfb49bbee24d9dacf529ded86a18f8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:55.544146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dfb49bbee24d9dacf529ded86a18f8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:55.547416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:55.628888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dfb49bbee24d9dacf529ded86a18f8', 'request_id': 'req-a9740669-a4ed-485d-a410-bc9b2f1a98e3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:55.637720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dfb49bbee24d9dacf529ded86a18f8', 'request_id': 'req-a9740669-a4ed-485d-a410-bc9b2f1a98e3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:55.648594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dfb49bbee24d9dacf529ded86a18f8', 'request_id': 'req-a9740669-a4ed-485d-a410-bc9b2f1a98e3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:55.677350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] The token cache is being invalidate because project 30dfb49bbee24d9dacf529ded86a18f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:55.678242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:55.679064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a9740669-a4ed-485d-a410-bc9b2f1a98e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:55.684350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1740/3461] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:55 2022] DELETE /identity/v3/projects/30dfb49bbee24d9dacf529ded86a18f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:55.686197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:55.686649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:55.686809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:55.720443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:55.721483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:55.806097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:55.863304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1722/3462] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:55.873379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:55.874424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:55.874804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:55.901358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:55.903646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:55.914397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1741/3463] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:55.918990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:55.940568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b0da2-bc03-4d33-93ed-e3b182ff4ee4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:55.946330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:55.947763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:55.949176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:55.949660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:55.950915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:55.951464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:55.953661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:55.973652 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1723/3464] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:01:55.978596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:55.992875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9816-36b9-40eb-be64-57a8dcbebd8d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.001268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.002008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.002304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.002585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.003307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.005871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.022861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:56.048001 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1742/3465] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:55 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:56.052093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:56.068101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10e2b-59c4-4870-b5d4-f5d92b48a60c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.158803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.159764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.160147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.160869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.161797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.165860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.199032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1724/3466] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:56 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:56.200753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:56.220084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76704c-a678-466d-8b62-1b59734dc70f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.230779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.231555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.231851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.232322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.233087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.236109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.266114 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1743/3467] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:56.268489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:56.290412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664251b8-7889-4a4e-8371-555a40698fc3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.296692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.297836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.298126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.298407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.299587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.301277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a5bc-7a8c-415e-b91b-d57468026f70 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.315656 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1725/3468] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:01:56.319309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:56.337210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d6743-e8bc-419b-9bf3-aee93b4ba294 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.344929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.346154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.346604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.346923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] PATH_INFO: `/v3/projects/1da06376b8cf4b54ae700f8bcc8b26ee/users/ba0538ac4197469b93008ddee8fb38ba/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.371251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da06376b8cf4b54ae700f8bcc8b26ee, user_id=ba0538ac4197469b93008ddee8fb38ba, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.374052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.404298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1744/3469] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:01:56 2022] PUT /identity/v3/projects/1da06376b8cf4b54ae700f8bcc8b26ee/users/ba0538ac4197469b93008ddee8fb38ba/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:56.406486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0c92-26ad-40a5-b13c-623c80ad8030 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.406779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0c92-26ad-40a5-b13c-623c80ad8030 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.407058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0c92-26ad-40a5-b13c-623c80ad8030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.447577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fcae0c92-26ad-40a5-b13c-623c80ad8030 None None] MFA Rules not processed for user `ba0538ac4197469b93008ddee8fb38ba`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:56.449148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fcae0c92-26ad-40a5-b13c-623c80ad8030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:56.539380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1726/3470] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:56.788972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:56.791291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:56.941139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b6df-9d9e-44f8-9b83-33429930500b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:56.949093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:56.950103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:56.950544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:56.950853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:56.960709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:56.962356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0808aa-9187-4119-b706-5ad8c63f3689 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:56.975033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1745/3471] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:01:57.943727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:57.944689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:57.945164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:57.999720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] MFA Rules not processed for user `5b4c3539c5534d2c844944f9be3f9963`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:58.007635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:58.117725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:58.233221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1727/3472] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:58.242636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:58.244538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:58.244984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:58.273236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:58.275650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:58.433948 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1746/3473] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:58.441468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:58.445323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:58.546741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:58.548586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:58.581007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf499-1a72-4586-9502-7614ad449f82 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:58.587420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:58.588134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:58.588422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:58.588699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:58.598136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:58.600278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:58.610505 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1728/3474] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:01:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:58.655643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:58.682068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b391e0d-bef5-4c08-9ea2-7bab1b23e547 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:58.689183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:58.690317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:58.690734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:58.691302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] PATH_INFO: `/v3/users/3f083a447601492b8b9d7ad1ad9d934a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:58.692729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f083a447601492b8b9d7ad1ad9d934a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:58.694928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:58.807018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f083a447601492b8b9d7ad1ad9d934a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:58.828607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f083a447601492b8b9d7ad1ad9d934a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:58.829374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f083a447601492b8b9d7ad1ad9d934a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:58.830061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f083a447601492b8b9d7ad1ad9d934a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:58.851523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4093837f-9f0e-402b-9507-d44fbf6bda2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f083a447601492b8b9d7ad1ad9d934a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:58.882169 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1747/3475] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:01:58 2022] DELETE /identity/v3/users/3f083a447601492b8b9d7ad1ad9d934a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:01:59.187192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:59.230083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ca05-c4ad-4752-9e98-70ce7dedd52c service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:59.339595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:59.340434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:59.341257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:59.341676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] PATH_INFO: `/v3/projects/2f6678835ec247d69b883f430be98e08` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:59.343754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6678835ec247d69b883f430be98e08)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:59.346629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:59.477731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6678835ec247d69b883f430be98e08', 'request_id': 'req-c220d4ae-9e54-4bd0-bf45-79f32f011682'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:59.485861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6678835ec247d69b883f430be98e08', 'request_id': 'req-c220d4ae-9e54-4bd0-bf45-79f32f011682'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:59.492376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6678835ec247d69b883f430be98e08', 'request_id': 'req-c220d4ae-9e54-4bd0-bf45-79f32f011682'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:59.508404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:59.512977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] The token cache is being invalidate because project 2f6678835ec247d69b883f430be98e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:01:59.513876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:59.514562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c220d4ae-9e54-4bd0-bf45-79f32f011682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:01:59.516867 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1729/3476] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:59 2022] DELETE /identity/v3/projects/2f6678835ec247d69b883f430be98e08 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:01:59.522485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:59.523278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:59.523278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:59.541757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:59.542969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:59.613469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1748/3477] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:59.621274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:59.621568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:59.621946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:59.643205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:01:59.644593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:01:59.662190 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1730/3478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:01:59.664198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:59.677015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0a131-9367-4a62-ae81-5a5aa879499a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:59.691902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:59.692680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:59.693023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:59.693361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:59.694714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:01:59.695193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:59.698003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:59.725946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1749/3479] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:01:59.727596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:59.741271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bd253-4ea6-4a82-a8b6-c9bae1677f33 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:01:59.773180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:01:59.776631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:01:59.777016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:01:59.777789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:01:59.783216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:01:59.785316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:01:59.859232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1731/3480] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:01:59 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:01:59.861008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:01:59.884429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00e374-56d7-4068-bcf8-941f10b1bcb9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.026647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.028668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:00.041444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:00.056930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.059382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.059832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.061421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.062443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.069970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.127737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1750/3481] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:01:59 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:00.130842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.171576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258c443-67ac-4904-accd-47467a0a5051 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.185607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.186465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.186892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.187373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.188410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.190325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.205464 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1751/3482] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:00.209127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.223650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db008-cd8f-44ab-a1ed-7c8e817c2535 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.237096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.237928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793699-44ca-421d-b715-7a9843b33a99 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.238150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.238374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.238663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] PATH_INFO: `/v3/users/ba0538ac4197469b93008ddee8fb38ba` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.244950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0538ac4197469b93008ddee8fb38ba)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.249293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.249916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.251872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.252297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.253446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.255816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.261164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.320552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1752/3483] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:00.322846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.338528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee78f-398d-405b-a0df-a51f735458bc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.350105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.352336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.355498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.356073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] PATH_INFO: `/v3/projects/01083c40e40446e581220f68d579105d/users/b865a42bb19745bc84c5138c90162e30/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.393284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0538ac4197469b93008ddee8fb38ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:00.394249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0538ac4197469b93008ddee8fb38ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:00.401347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01083c40e40446e581220f68d579105d, user_id=b865a42bb19745bc84c5138c90162e30, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.411610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827618ad-9da5-4a45-964d-f072ef1fde48 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.420159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0538ac4197469b93008ddee8fb38ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:00.438697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0538ac4197469b93008ddee8fb38ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:00.453162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1753/3484] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:00 2022] PUT /identity/v3/projects/01083c40e40446e581220f68d579105d/users/b865a42bb19745bc84c5138c90162e30/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:00.457963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.458244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.458524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.498617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-abde4ba9-02e9-4b76-a57c-a95a2117b837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0538ac4197469b93008ddee8fb38ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:00.519736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:00.523268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:00.526307 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1732/3485] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:00 2022] DELETE /identity/v3/users/ba0538ac4197469b93008ddee8fb38ba => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:00.530633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.530992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.531215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.591402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:00.595317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:00.705295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1754/3486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:00.725343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:00.739693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.743256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:00.762894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1733/3487] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:00.837158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:00.840189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:00.949475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c159d6-1e42-44e1-83b1-9a296f0a5474 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:00.957768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:00.958444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:00.958729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:00.959038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:00.980907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:00.982546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20de42-ecb5-4d53-986d-1c2e094172dd service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:00.993527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4104ac1-dc30-4222-8e81-755f181dda1f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:01.005813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1755/3488] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:02:01.008316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:01.008994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:01.009408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:01.009706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:01.030881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:01.032591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0450cc9-dff4-4ef5-905d-21548eb96735 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:01.060552 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1734/3489] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:01.766635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:01.767127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:01.767481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:01.819269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] MFA Rules not processed for user `890837d5b27e4471b54c1eac851e88c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:01.821758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:01.941676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:01.997271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1756/3490] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:02.009868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bddf-1160-4060-bece-caf54aa02d04 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:02.010435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bddf-1160-4060-bece-caf54aa02d04 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:02.010435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6bddf-1160-4060-bece-caf54aa02d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:02.040333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-18a6bddf-1160-4060-bece-caf54aa02d04 None None] MFA Rules not processed for user `890837d5b27e4471b54c1eac851e88c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:02.041725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18a6bddf-1160-4060-bece-caf54aa02d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:02.080764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1735/3491] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:03.133684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:03.136040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:03.158453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c097b-b9d0-43d7-9367-a9a7de7ec396 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:03.170466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:03.172682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.172682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.172682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] PATH_INFO: `/v3/projects/1da06376b8cf4b54ae700f8bcc8b26ee` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.184795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da06376b8cf4b54ae700f8bcc8b26ee)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:03.186945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:03.303884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da06376b8cf4b54ae700f8bcc8b26ee', 'request_id': 'req-411e1045-9d3c-4446-b0c5-d2753f6a7419'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:03.311363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da06376b8cf4b54ae700f8bcc8b26ee', 'request_id': 'req-411e1045-9d3c-4446-b0c5-d2753f6a7419'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:03.329160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da06376b8cf4b54ae700f8bcc8b26ee', 'request_id': 'req-411e1045-9d3c-4446-b0c5-d2753f6a7419'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:03.347619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] The token cache is being invalidate because project 1da06376b8cf4b54ae700f8bcc8b26ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:03.347975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:03.348574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411e1045-9d3c-4446-b0c5-d2753f6a7419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:03.360693 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1757/3492] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:03 2022] DELETE /identity/v3/projects/1da06376b8cf4b54ae700f8bcc8b26ee => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:03.362339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a984b1-8ace-4751-a25c-9166f3eab1b0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.362813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a984b1-8ace-4751-a25c-9166f3eab1b0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.363181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a984b1-8ace-4751-a25c-9166f3eab1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.406233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-42a984b1-8ace-4751-a25c-9166f3eab1b0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:03.407362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-42a984b1-8ace-4751-a25c-9166f3eab1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:03.475226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3b07-846e-45b9-9989-4813dcb9d0af None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.475777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3b07-846e-45b9-9989-4813dcb9d0af None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.476188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3b07-846e-45b9-9989-4813dcb9d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.544901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-666e3b07-846e-45b9-9989-4813dcb9d0af None None] MFA Rules not processed for user `b865a42bb19745bc84c5138c90162e30`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:03.547954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-666e3b07-846e-45b9-9989-4813dcb9d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:03.604266 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1736/3493] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:03.605847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.606123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.606401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.659219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:03.660490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:03.700042 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1737/3494] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:03.701189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:03.722978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7e8e2-017f-445c-94e5-7fec4d3916d3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:03.734824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:03.735800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.736230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.736654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.737740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:03.738195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:03.741419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:03.772117 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1738/3495] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:03.773349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:03.805236 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1758/3496] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:03.806686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73064d46-4939-40d9-9875-4678321ad890 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:03.808147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.808470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.809303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.821475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:03.822572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:03.823011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:03.823444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:03.824320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:03.826411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:03.876372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] MFA Rules not processed for user `b865a42bb19745bc84c5138c90162e30`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:03.879154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:03.893429 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1739/3497] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:03.894593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:03.902391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1759/3498] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:04.002343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:04.029703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830112-86b0-4225-af45-d66114394084 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:04.043108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:04.043851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.044119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.044399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.045110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:04.047098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:04.106357 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1740/3499] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:03 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:04.110251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:04.132198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216704e-234d-43bf-bef3-6d0679d4c589 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:04.158677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:04.160462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.163201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.163986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.170017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:04.183807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:04.217646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:04.224341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1760/3500] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:04.234845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ce965-64b5-4409-9063-412ff71892e3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:04.253396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:04.255325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.256537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.256842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.257614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:04.259264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c889a-fe59-4d10-9a14-ed7331111e53 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:04.320022 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1741/3501] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:04.323818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:04.341410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557890ee-a0ad-4891-9605-ba076bb7395d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:04.364359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:04.365316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.365599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.365877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] PATH_INFO: `/v3/projects/6b1dd7943ab249e6bf2156b54b4c3a20/users/61a665da0b8f4dcd8c39570a49b62449/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.420186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1dd7943ab249e6bf2156b54b4c3a20, user_id=61a665da0b8f4dcd8c39570a49b62449, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:04.432370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:04.469885 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1761/3502] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:04 2022] PUT /identity/v3/projects/6b1dd7943ab249e6bf2156b54b4c3a20/users/61a665da0b8f4dcd8c39570a49b62449/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:04.481540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.482621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.483085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.578687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] MFA Rules not processed for user `61a665da0b8f4dcd8c39570a49b62449`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:04.583010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:04.794957 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1742/3503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:04.808926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:04.811007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:04.851704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:04.943368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3307f-a759-489d-b4ad-763bdf09f9e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:04.951298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:04.953402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:04.954066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:04.954603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:04.968098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:04.970077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659b33d-8fea-4dcf-95f2-c6768d0488a7 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:04.993011 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1762/3504] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:05.297396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:05.299892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:05.466180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e8220-f6d1-48ab-8607-ba2d025b719e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:05.509796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:05.510592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:05.510817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:05.511014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:05.676862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:05.692108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:05.693814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:05.715668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1743/3505] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:06.287650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:06.288247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:06.288247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:06.380552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:06.382228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:06.606910 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1763/3506] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:06.636010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:06.637683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:06.857091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0f2fe-89a4-4080-8356-c848f8f0bf76 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:06.873385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:06.874124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:06.874442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:06.874733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:06.889400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:06.891435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:06.932059 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1744/3507] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:07.932256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:07.934318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:08.125103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94aa549-a943-4beb-ab97-398bdbda0961 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:08.143865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:08.149954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:08.150303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:08.150649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] PATH_INFO: `/v3/users/be44957fa2304f52a8d34bdac9eaca4f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:08.154855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=be44957fa2304f52a8d34bdac9eaca4f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:08.160444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:08.264733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be44957fa2304f52a8d34bdac9eaca4f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:08.282562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be44957fa2304f52a8d34bdac9eaca4f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:08.284145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be44957fa2304f52a8d34bdac9eaca4f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:08.295875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be44957fa2304f52a8d34bdac9eaca4f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:08.342256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:08.357740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b90b231e-cfbf-44b6-b41d-280fa3769ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be44957fa2304f52a8d34bdac9eaca4f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:08.392470 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1764/3508] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:07 2022] DELETE /identity/v3/users/be44957fa2304f52a8d34bdac9eaca4f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:08.954030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:08.992551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4acf49-ca70-4a95-9020-e7be84d69fa8 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:09.279313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:09.280342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:09.280645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:09.280895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] PATH_INFO: `/v3/projects/867cd3b05ecb4c93a28ab7a55928789b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:09.282199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] RBAC: Authorizing `identity:delete_project(project_id=867cd3b05ecb4c93a28ab7a55928789b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:09.284866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:09.422054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867cd3b05ecb4c93a28ab7a55928789b', 'request_id': 'req-63eada33-fb2b-4004-9115-e7a2de8b798f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:09.436500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867cd3b05ecb4c93a28ab7a55928789b', 'request_id': 'req-63eada33-fb2b-4004-9115-e7a2de8b798f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:09.448089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867cd3b05ecb4c93a28ab7a55928789b', 'request_id': 'req-63eada33-fb2b-4004-9115-e7a2de8b798f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:09.480848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] The token cache is being invalidate because project 867cd3b05ecb4c93a28ab7a55928789b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:09.481248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:09.484490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-63eada33-fb2b-4004-9115-e7a2de8b798f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:09.493035 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1745/3509] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:08 2022] DELETE /identity/v3/projects/867cd3b05ecb4c93a28ab7a55928789b => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:09.495361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:09.495966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:09.496594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:09.528945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:09.531591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:09.652998 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1765/3510] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:09.666287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:09.667644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:09.668553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:09.786783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:09.793533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:09.828651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1746/3511] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:09.830577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:09.848377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e74f7-32f6-4547-a08c-201029aa7f2a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:09.865184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:09.866179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:09.866672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:09.867080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:09.867927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:09.868466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:09.870689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:09.950175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1766/3512] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:09.954591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:09.963300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:09.977912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c88da-54c7-4f78-bc06-73b5e6707f2a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:09.993317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:09.995942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:09.997574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:09.998047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:09.999090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.002207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.043913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1747/3513] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:09 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:10.048380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:10.061567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b0729-ae17-4bbc-af3a-d06914a40137 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:10.128638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:10.129321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.129742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.130022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.130750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.132726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.156783 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1767/3514] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:10 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:10.161247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:10.176105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38d69-c7f0-4ef6-bf48-15c0452ddefb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:10.184303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:10.185432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.185933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.186379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.187378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.189741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.206184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1748/3515] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:02:10.213221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:10.228941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44550-868c-4b53-970f-51c9bbfcf60b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:10.244636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:10.245456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.245741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.246091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.246840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.248668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5d5b-20a1-4274-918d-96264ac9e494 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.274522 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1768/3516] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:10.279261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:10.306146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b882bc-dd62-4f9e-bbd4-5e6dc9e34630 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:10.312127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:10.313386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.314178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.314612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] PATH_INFO: `/v3/projects/139f5d3f3de240729676f4ddd8be570b/users/9b880344bb5846c299d5b6d653f44d61/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.347227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139f5d3f3de240729676f4ddd8be570b, user_id=9b880344bb5846c299d5b6d653f44d61, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.356082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.390027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1749/3517] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:10 2022] PUT /identity/v3/projects/139f5d3f3de240729676f4ddd8be570b/users/9b880344bb5846c299d5b6d653f44d61/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:10.403215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf41c-5c47-47d2-a029-5658fd4cb617 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.403525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf41c-5c47-47d2-a029-5658fd4cb617 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.403846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf41c-5c47-47d2-a029-5658fd4cb617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.438929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89fcf41c-5c47-47d2-a029-5658fd4cb617 None None] MFA Rules not processed for user `9b880344bb5846c299d5b6d653f44d61`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:10.440953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89fcf41c-5c47-47d2-a029-5658fd4cb617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:10.498440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:10.558882 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1769/3518] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:10.566050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:10.567912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:10.650504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7870-efd2-4f50-aa0e-96cc6e7d1de2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:10.654909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:10.655759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:10.656090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:10.656389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:10.668640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:10.670322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:10.680686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1750/3519] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:12.411139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8d2f-d503-40af-984d-892260336d30 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:12.412755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8d2f-d503-40af-984d-892260336d30 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:12.413313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b8d2f-d503-40af-984d-892260336d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:12.440613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1e5b8d2f-d503-40af-984d-892260336d30 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:12.442166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e5b8d2f-d503-40af-984d-892260336d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:12.551162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1770/3520] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:12.566382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:12.568866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:12.677403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965b348-5fbe-406d-97ac-75677092ca5c service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:12.689637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:12.691706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:12.692748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:12.693339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:12.708833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:12.712205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:12.732230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1751/3521] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:16.279618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf654e-c8ef-453e-8f45-49dd937a4e90 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:16.280559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf654e-c8ef-453e-8f45-49dd937a4e90 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:16.280992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf654e-c8ef-453e-8f45-49dd937a4e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:16.305764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-eacf654e-c8ef-453e-8f45-49dd937a4e90 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:16.307197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eacf654e-c8ef-453e-8f45-49dd937a4e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:16.315434 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1771/3522] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:16.344424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:16.357182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ef34-8530-412b-a63c-69a7b54724c6 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:16.362418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:16.363050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:16.363488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:16.363926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:16.375389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:16.377367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:16.389780 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1752/3523] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:18.245389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae0ca0-8729-437d-870d-c78c4d73a277 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:18.245854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae0ca0-8729-437d-870d-c78c4d73a277 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:18.245942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae0ca0-8729-437d-870d-c78c4d73a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:18.271469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fdae0ca0-8729-437d-870d-c78c4d73a277 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:18.274254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fdae0ca0-8729-437d-870d-c78c4d73a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:18.282573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1772/3524] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:02:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:18.303896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:18.320519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a8cea-5571-4587-9418-ff74b39e03b0 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:18.325920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:18.326769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:18.327212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:18.327789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:18.339205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:18.341147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ec4c8-a177-493e-b2ce-19f1d2e882d4 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:18.368463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1753/3525] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:19.141118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:19.141574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:19.142036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:19.194102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] MFA Rules not processed for user `61a665da0b8f4dcd8c39570a49b62449`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:19.197443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:19.328261 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1773/3526] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:20.882500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:20.886042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:20.886698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:20.932845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] MFA Rules not processed for user `61a665da0b8f4dcd8c39570a49b62449`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:20.934710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:20.947642 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1754/3527] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:29.304732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=65 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:30.482079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:30.483742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:30.582773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:30.598219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:30.625654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394ca15-fa54-439c-a26b-7a1ceb77dc53 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:30.648114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:30.649146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:30.649620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:30.650057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:30.652223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:30.736017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8951-9f02-442d-a9aa-602b283b2a0b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:30.744572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:30.746045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:30.746491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:30.747095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] PATH_INFO: `/v3/users/9b880344bb5846c299d5b6d653f44d61` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:30.750235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b880344bb5846c299d5b6d653f44d61)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:30.753506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:30.827896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:30.829482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f02e4-a5ba-4757-8936-b7a154030d55 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:30.853547 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1774/3528] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:02:30.913046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b880344bb5846c299d5b6d653f44d61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:30.915013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b880344bb5846c299d5b6d653f44d61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:30.928817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b880344bb5846c299d5b6d653f44d61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:30.929918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b880344bb5846c299d5b6d653f44d61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:30.951887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b880344bb5846c299d5b6d653f44d61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:30.992428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1755/3529] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:30 2022] DELETE /identity/v3/users/9b880344bb5846c299d5b6d653f44d61 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:30.997041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:30.997352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:30.997590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:31.083837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:31.088827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:31.244672 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1775/3530] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:31.259571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:31.261088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:31.353947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2753c-ad66-4554-bb6a-e481173689a3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:31.379362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:31.380239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:31.380523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:31.380810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:31.396263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:31.399075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:31.416028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1756/3531] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:31.796697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:31.798326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:31.807548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:31.819738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530bd5-3703-4585-9b18-405a7f56d3cb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:31.825213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:31.826158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:31.826449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:31.826732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] PATH_INFO: `/v3/projects/139f5d3f3de240729676f4ddd8be570b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:31.829646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139f5d3f3de240729676f4ddd8be570b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:31.832047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:31.891523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139f5d3f3de240729676f4ddd8be570b', 'request_id': 'req-aedf32ea-8669-4042-b2c9-f0f94c262316'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:31.893008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:31.895255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:31.900501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139f5d3f3de240729676f4ddd8be570b', 'request_id': 'req-aedf32ea-8669-4042-b2c9-f0f94c262316'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:31.904365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:31.908543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50506-8960-4d96-adec-1c9a7abad5ec service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:31.912601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139f5d3f3de240729676f4ddd8be570b', 'request_id': 'req-aedf32ea-8669-4042-b2c9-f0f94c262316'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:31.940041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] The token cache is being invalidate because project 139f5d3f3de240729676f4ddd8be570b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:31.940574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:31.941454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aedf32ea-8669-4042-b2c9-f0f94c262316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:31.948396 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1776/3532] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:31 2022] DELETE /identity/v3/projects/139f5d3f3de240729676f4ddd8be570b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:31.950127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1f73d-67b9-44bc-b24d-018c9e6c5654 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:31.950623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1f73d-67b9-44bc-b24d-018c9e6c5654 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:31.951009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1f73d-67b9-44bc-b24d-018c9e6c5654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:31.977399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2ac1f73d-67b9-44bc-b24d-018c9e6c5654 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:31.978606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2ac1f73d-67b9-44bc-b24d-018c9e6c5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:31.986850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:31.987528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:31.987824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:31.988295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:31.990209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:32.077271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1777/3533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:32.079161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.079457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.079794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.085365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.086945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.099838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:32.100935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1757/3534] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:02:32.101183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:32.118872 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1778/3535] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:32.122841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.134554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590f305-451f-49d4-8278-43a02eedf432 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.140187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.141169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.141536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.142065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.143266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:32.143499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.145311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.160331 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1758/3536] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:32.165556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.176397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb279d-ab7f-4898-8e70-40b77ff8a8d5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.181814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.182636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.182932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.183837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.183949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.186042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.214941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1779/3537] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:32.219015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.230260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fc21-31bb-4419-9046-4a903bc7f362 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.290578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.291322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.291644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.291924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.292660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.294645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.329140 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1759/3538] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:32.336069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.356154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2782fb-bd17-4942-b1fa-f4a0e6c985eb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.361502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.362210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.362439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.362711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.363442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.365205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.389040 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1780/3539] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:32.390489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.404366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831138-4b63-4d3b-871e-e63c6bfd4e5e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.410465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.411076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.411904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.412620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.413771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.415426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e5c6-e558-4fbb-bbfd-49b598ede1e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.426736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1760/3540] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:02:32.430932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.442524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c0d1-e64c-462e-8a2f-a846bcc1888a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.448509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.449393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.449695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.449981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] PATH_INFO: `/v3/projects/f34ecaa5797745ddac69d42982932749/users/2334f0d145514abcac86b67113d467af/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.472972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34ecaa5797745ddac69d42982932749, user_id=2334f0d145514abcac86b67113d467af, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.477557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.496471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1781/3541] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:32 2022] PUT /identity/v3/projects/f34ecaa5797745ddac69d42982932749/users/2334f0d145514abcac86b67113d467af/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:32.514731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.515023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.515312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.541010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:32.551096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] MFA Rules not processed for user `2334f0d145514abcac86b67113d467af`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:32.552916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:32.627364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1761/3542] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:32.632365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.666606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:32.740098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8f5f-8dbb-4ece-97a4-e511eaa53175 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.746577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.747407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.748743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.748743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.749022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.751691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.820643 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1782/3543] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:32.824866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:32.840088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6e37-0f6b-4778-8cd7-c75129ce4ebf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:32.941722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:32.944792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:32.945321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:32.946293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:32.947384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:32.951387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:32.999780 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1762/3544] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:32 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:33.001720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.014100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212baad5-0051-4c23-aab9-b08c057ef18a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.020176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.021427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.022491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.022995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.023976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.025848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.046183 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1783/3545] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:33.046403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.062944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d19eb4-c551-4105-8d68-1898498cb335 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.072790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.073918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.074679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.075084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] PATH_INFO: `/v3/projects/fa12c5f127034f32bd63a938425e261b/users/4dd0a610e31a468d8b437bbed98a467f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.100931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa12c5f127034f32bd63a938425e261b, user_id=4dd0a610e31a468d8b437bbed98a467f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.104492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.128854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1763/3546] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:33 2022] PUT /identity/v3/projects/fa12c5f127034f32bd63a938425e261b/users/4dd0a610e31a468d8b437bbed98a467f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:33.132942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.154501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323d97-d5e2-4bdc-8841-e245a47eb84a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.240000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.240960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.241421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.241839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.242721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.244663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16d713-9f0f-4149-a77e-91409905ef12 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.265369 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1784/3547] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:02:33.269551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.284139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2815d8-39f3-4b72-a804-d44ade58fb23 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.289386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.290734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.290734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.291010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] PATH_INFO: `/v3/projects/fa12c5f127034f32bd63a938425e261b/users/4dd0a610e31a468d8b437bbed98a467f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.293404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa12c5f127034f32bd63a938425e261b, user_id=4dd0a610e31a468d8b437bbed98a467f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.295672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3023f7b-b40b-43fb-a4ca-0afb55525bad admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.307647 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1764/3548] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:33 2022] PUT /identity/v3/projects/fa12c5f127034f32bd63a938425e261b/users/4dd0a610e31a468d8b437bbed98a467f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:33.320169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.320524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.320734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.357627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] MFA Rules not processed for user `4dd0a610e31a468d8b437bbed98a467f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:33.359021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:33.440014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edd64-8512-4e99-9d93-b03fa54a5b64 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.445372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edd64-8512-4e99-9d93-b03fa54a5b64 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.446080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edd64-8512-4e99-9d93-b03fa54a5b64 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.448646 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1765/3549] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:02:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 21:02:33.468807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.469049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.469264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.489854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:33.491672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:33.515210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1785/3550] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:33.517017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.534577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463238d8-2767-4ea7-a538-5afc8e578b95 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.548926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.549687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.549976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.550302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.551160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.552615 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.552615 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:33.552615 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:33.553512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.561783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:33.572301 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1786/3551] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/services => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:33.576387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.584935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:33.604253 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1766/3552] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3432 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:33.613164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4542a9-8489-4cb9-8212-d9a752563a71 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.623789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.625401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:33.628907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.629575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.630058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.631437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.632259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.633594 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.633594 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:33.633594 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:33.634491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.642098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75837279-e391-4e32-a904-ad7fdf93f84a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.649848 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1787/3553] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 330 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:33.651149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.652575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.653380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.655196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.655825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.670380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.672250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8b36-afe4-4828-b256-01b2826ec904 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.672665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.678502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.679231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.680030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.680356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.682177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.684342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.698897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1767/3554] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3432 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:02:33.707886 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1788/3555] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/services => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:33.709622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.730173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5f84-939c-4a22-adf5-639135d84397 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.751921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.753041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.753336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.753611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.754518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.755756 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.755756 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:33.755756 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:33.756950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.773424 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1768/3556] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Jun 4 21:02:33 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:33.774530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.791177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106753b2-6425-4532-bb71-a4ca80a7e79c tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.796187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.797219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.797659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.797891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.798787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.799931 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.799931 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:33.799931 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:33.800750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.808681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1789/3557] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 760 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:33.813010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.827290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e0075-05fb-4c7e-99dd-86438a6f4717 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.834198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.835177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.835471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.835873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.836601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4b1996ddbb3542be9ff8869512d95ffb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.837714 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.837714 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:33.837714 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:33.838740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.846702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1769/3558] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb => generated 332 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:33.851283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.863316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec88d5-947f-42a7-a089-f716e28ea0b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.868789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.869742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.870128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.870519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.871281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=4b1996ddbb3542be9ff8869512d95ffb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.872560 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.872560 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:33.872560 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:33.873651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.882472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1790/3559] 10.222.0.18 () {58 vars in 1290 bytes} [Sat Jun 4 21:02:33 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb => generated 0 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 04 21:02:33.887013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.907755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241edfae-a0d7-4676-9ac6-03f9ea13a792 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.913527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.914513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.914887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.915298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.916105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4b1996ddbb3542be9ff8869512d95ffb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.917268 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:33.917268 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:33.917268 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:33.918315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.932602 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1770/3560] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:02:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:33.936897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.951312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f82c-a3f2-41ff-8027-a2c72becfdcd tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.957220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.958103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.958703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.959192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.960041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.961775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:33.970473 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1791/3561] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 447 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:02:33.971971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.979722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:33.985207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee1087-464e-40ff-90e2-74edf54a4801 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:33.991294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:33.992312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:33.992603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:33.992881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:33.994027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4b1996ddbb3542be9ff8869512d95ffb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:33.995569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.005759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785fa31-1495-4f43-9bef-31ef1bb8099f tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.011794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.012454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.012798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.013088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Could not find Endpoint Group: 4b1996ddbb3542be9ff8869512d95ffb.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4b1996ddbb3542be9ff8869512d95ffb. Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jun 04 21:02:34.014422 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 4b1996ddbb3542be9ff8869512d95ffb. Jun 04 21:02:34.015412 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:34.016032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1771/3562] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:02:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4b1996ddbb3542be9ff8869512d95ffb => generated 120 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:34.027753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.033417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:34.038766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc215bb-883e-404d-a2b8-6e68b0117cd5 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.050842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.050842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.050842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services/775ae57652264e2da8e6cf35a041f8d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_service(service_id=775ae57652264e2da8e6cf35a041f8d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:34.051169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.051669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.054344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.082481 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1792/3563] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3566 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:34.092326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1772/3564] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/services/775ae57652264e2da8e6cf35a041f8d8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:34.101804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.114017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab41f1-5e6d-4e71-915d-4cde26d341ef service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.134101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.134889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.135234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.135604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.136394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.138060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.163707 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1793/3565] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:34 2022] POST /identity/v3/services => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:34.166414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.190444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d9bc-897c-451f-84b0-424c08def869 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.226794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.227594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.228072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.228386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.229290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.231935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.248221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1773/3566] 10.222.0.18 () {60 vars in 1212 bytes} [Sat Jun 4 21:02:34 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:34.252842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.270136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a7ebc-f694-4e94-973c-aa10cfdd98ef tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.279068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.279787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.280071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.280351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.281081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.282929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.301835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1794/3567] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:34 2022] POST /identity/v3/services => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:34.306337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.317242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe768fa-bd68-4d68-bee7-7129572a7985 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.338862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.340588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.340588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.340588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4064afa621ca4482a8fcc56f8469e7a2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.341054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=4064afa621ca4482a8fcc56f8469e7a2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.342080 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:34.342080 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:34.342080 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:34.342967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.359244 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1774/3568] 10.222.0.18 () {60 vars in 1312 bytes} [Sat Jun 4 21:02:34 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/4064afa621ca4482a8fcc56f8469e7a2 => generated 336 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:34.363602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.376183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5524be-54a5-4b3c-b607-163be51d6274 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.385855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.386354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.386697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.395916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services/fe16161e32304d30bd78dfd176f5c62c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.397512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fe16161e32304d30bd78dfd176f5c62c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.399004 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:34.399004 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:34.399004 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:34.400695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.452090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1795/3569] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/services/fe16161e32304d30bd78dfd176f5c62c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:34.455901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.473719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19404a0-5024-4a76-835a-3e50380989e7 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.503880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.504872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.505247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.505535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/4064afa621ca4482a8fcc56f8469e7a2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.506314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=4064afa621ca4482a8fcc56f8469e7a2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.508200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.528496 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1775/3570] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/4064afa621ca4482a8fcc56f8469e7a2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:34.533851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.546078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8bd0-0249-4821-a0c3-182f437ce398 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.554016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.555654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.556217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.556786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services/59f4a661010e4134ac00c0c2e24533e7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.558704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_service(service_id=59f4a661010e4134ac00c0c2e24533e7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.560450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.588699 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1796/3571] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/services/59f4a661010e4134ac00c0c2e24533e7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:34.594256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.609629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efbbd-c4f6-4e75-bf7c-4d6d43d17ab3 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.634161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.635791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.636176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.636558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/325b70a0e7cb42ee8a7737b6489451b8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.637321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=325b70a0e7cb42ee8a7737b6489451b8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.640217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.655221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1776/3572] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/325b70a0e7cb42ee8a7737b6489451b8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:34.660080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.674270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3584a-bc6d-4d74-8b5c-bea8042e48b2 tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.680903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dd0a610e31a468d8b437bbed98a467f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa12c5f127034f32bd63a938425e261b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.681918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.682888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.683419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] PATH_INFO: `/v3/services/fe361a4f52d843b0849703eb0bc41c92` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.684895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fe361a4f52d843b0849703eb0bc41c92)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.687718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e292-89eb-46b2-848d-59368f0c971b tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.729347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1797/3573] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/services/fe361a4f52d843b0849703eb0bc41c92 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:34.733112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:34.793738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=8,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:34.894500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4614e-3af9-4b75-a455-dd13438cac3d tempest-EndPointGroupsTest-168008432 tempest-EndPointGroupsTest-168008432-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:34.912956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:34.913948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:34.914234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:34.914515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] PATH_INFO: `/v3/users/2334f0d145514abcac86b67113d467af` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:34.915952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2334f0d145514abcac86b67113d467af)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:34.918063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:34.984580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2334f0d145514abcac86b67113d467af'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:34.985823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2334f0d145514abcac86b67113d467af'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:34.995419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2334f0d145514abcac86b67113d467af'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:34.996183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2334f0d145514abcac86b67113d467af'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.010193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2334f0d145514abcac86b67113d467af'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.034307 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1777/3574] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:34 2022] DELETE /identity/v3/users/2334f0d145514abcac86b67113d467af => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:35.040003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:35.040541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:35.040541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:35.059739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:35.060949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:35.104303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:35.135807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1798/3575] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:35.147609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:35.150049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:35.273934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e62b5-d089-4e2e-b3df-3f6d2286bf70 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:35.273934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:35.273934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:35.273934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:35.274328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:35.285557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:35.288929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:35.306133 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1778/3576] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:35.686344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:35.690823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:35.706998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbac9b9-46e3-4760-b831-d2f4d2fecfd4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:35.712836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:35.713843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:35.713976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:35.714265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] PATH_INFO: `/v3/projects/f34ecaa5797745ddac69d42982932749` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:35.715728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34ecaa5797745ddac69d42982932749)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:35.717641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:35.769900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34ecaa5797745ddac69d42982932749', 'request_id': 'req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.777063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34ecaa5797745ddac69d42982932749', 'request_id': 'req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.783791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34ecaa5797745ddac69d42982932749', 'request_id': 'req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.799641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] The token cache is being invalidate because project f34ecaa5797745ddac69d42982932749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:35.799932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.800593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.802316 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1799/3577] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:35 2022] DELETE /identity/v3/projects/f34ecaa5797745ddac69d42982932749 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:35.806815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:35.817087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fcf38-9a26-47d3-9875-29a189d43583 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:35.822734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:35.880663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:35.881641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:35.881927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:35.882202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] PATH_INFO: `/v3/users/4dd0a610e31a468d8b437bbed98a467f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:35.883468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd0a610e31a468d8b437bbed98a467f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:35.885477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:35.942711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd0a610e31a468d8b437bbed98a467f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.943787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd0a610e31a468d8b437bbed98a467f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.951253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd0a610e31a468d8b437bbed98a467f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.952034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd0a610e31a468d8b437bbed98a467f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.966095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a575f7af-40a3-4bb7-8e9c-75ab3a4d945c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd0a610e31a468d8b437bbed98a467f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:35.982276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1779/3578] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:35 2022] DELETE /identity/v3/users/4dd0a610e31a468d8b437bbed98a467f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:36.779535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:36.781115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:36.800751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16848fc-fabb-4ae4-bc77-0aafd4dda8fc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:36.889766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:36.891163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:36.891893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:36.892602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] PATH_INFO: `/v3/projects/fa12c5f127034f32bd63a938425e261b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:36.894385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa12c5f127034f32bd63a938425e261b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:36.897637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:36.987753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa12c5f127034f32bd63a938425e261b', 'request_id': 'req-a3870e12-89a7-4c0a-8a65-ba35a53e7035'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:36.995940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa12c5f127034f32bd63a938425e261b', 'request_id': 'req-a3870e12-89a7-4c0a-8a65-ba35a53e7035'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:37.002273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa12c5f127034f32bd63a938425e261b', 'request_id': 'req-a3870e12-89a7-4c0a-8a65-ba35a53e7035'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:37.004123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:37.023312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] The token cache is being invalidate because project fa12c5f127034f32bd63a938425e261b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:37.023661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:37.024784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3870e12-89a7-4c0a-8a65-ba35a53e7035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:37.026350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1800/3579] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:36 2022] DELETE /identity/v3/projects/fa12c5f127034f32bd63a938425e261b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:37.031413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.032387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.032868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.070438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:37.072103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:37.188184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1780/3580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:37.197351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.198185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.198624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.232996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:37.234363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:37.269219 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1801/3581] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:37.271359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.283859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c0fe4-58f7-4c39-95b3-5c08db7fdfac None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.308000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.308989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.309439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.309868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.311771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:37.313233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.317618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.349515 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1781/3582] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:37.354059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.377118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac78c5-3129-4b97-aa15-e7ea48d8eca1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.393251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.393932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.394220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.394492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.395230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.397922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.489498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.490017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1802/3583] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:37.514272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceab78-3f3d-4ac6-bdc2-a10a690e147a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.520819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:37.584981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.585670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.585958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.586245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.586944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.589003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.617610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1782/3584] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:37.621269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.638246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664523-971b-4a76-92b9-ffe9b4a57619 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.643049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.643905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.644316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.644598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.645343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.647595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.659440 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1803/3585] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:37.663589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.675230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bbb45-8b44-4160-ad21-258d16d9b922 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.680493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.681284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.684487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.684487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.684487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.685879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d659f-f38b-4b67-b55c-53af08f4ff08 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.699643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1783/3586] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:37.702430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.713476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ed1b7-c6a5-43f6-9540-0deb3a5bd86f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.718498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.719442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.719782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.720062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] PATH_INFO: `/v3/projects/53136dc0e5c5411dbc9129dfea5fdb08/users/ab99e282502f4642aca390342cc18ccc/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.736716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=53136dc0e5c5411dbc9129dfea5fdb08, user_id=ab99e282502f4642aca390342cc18ccc, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.740271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:37.758033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1804/3587] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:37 2022] PUT /identity/v3/projects/53136dc0e5c5411dbc9129dfea5fdb08/users/ab99e282502f4642aca390342cc18ccc/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:37.769370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.769602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.769877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.806648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] MFA Rules not processed for user `ab99e282502f4642aca390342cc18ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:37.809200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:37.887330 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1784/3588] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:37.892237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:37.964792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701223b5-83f1-45ea-98df-50ddeccd98cc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:37.970048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:37.970722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:37.971005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:37.971280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:37.972059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:37.974343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.011548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1805/3589] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:37 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:38.013795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.026887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992a7e4-0bf8-45a4-9384-02616300e2d6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.091026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.091754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.092039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.092314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.093055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.094998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.120060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1785/3590] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:38 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:38.121674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.132261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4acafa-d833-468c-8998-b04274b962f3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.137350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.138018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.138298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.138580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.139292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.140941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.154173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1806/3591] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:38.158458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.170610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc296-a3e3-4c47-9ed5-3bf1d5eea599 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.178753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.180108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.180393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.180673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] PATH_INFO: `/v3/projects/a0413373afcb4232b09df2936b9cc3fb/users/d28ec5b93275439aa22f08905b640107/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.183398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:38.200475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0413373afcb4232b09df2936b9cc3fb, user_id=d28ec5b93275439aa22f08905b640107, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.203397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.219320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1786/3592] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:38 2022] PUT /identity/v3/projects/a0413373afcb4232b09df2936b9cc3fb/users/d28ec5b93275439aa22f08905b640107/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:38.223711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.234198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc2270-6ce0-4e6a-9df4-69444866568a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.309084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.309842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.310265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.310546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.311288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.312946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656247d-e7c0-4cfc-b218-a506e3f91bbd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.315301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:38.326040 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1807/3593] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:38.330705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.342970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e906b-40c4-40a9-9062-37066af6a087 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.348304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.349549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.350024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.350366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] PATH_INFO: `/v3/projects/a0413373afcb4232b09df2936b9cc3fb/users/d28ec5b93275439aa22f08905b640107/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.352607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0413373afcb4232b09df2936b9cc3fb, user_id=d28ec5b93275439aa22f08905b640107, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.355576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.367988 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1787/3594] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:38 2022] PUT /identity/v3/projects/a0413373afcb4232b09df2936b9cc3fb/users/d28ec5b93275439aa22f08905b640107/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:38.379784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.380112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.380372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.410257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] MFA Rules not processed for user `d28ec5b93275439aa22f08905b640107`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:38.411619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:38.521433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1808/3595] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:38.526140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.537792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986730b-09b1-42ef-b443-7de5cb96aa3e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.544239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.545059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.545436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.545816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.546633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.547802 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:38.547802 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:38.547802 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:38.549081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.574914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1788/3596] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:02:38 2022] POST /identity/v3/regions => generated 222 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:38.579055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.589973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc00f02-e87b-4f18-aaeb-5af0714a159b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.606501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.608018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.608446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.608802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.609606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.610744 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:38.610744 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:38.610744 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:38.611847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.644268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1809/3597] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:02:38 2022] POST /identity/v3/regions => generated 223 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:38.659991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.669565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.674158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5829-d2f0-4b0f-9542-9f6c9b58ce53 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.674860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:38.699415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.700704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.700989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.701310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/232c1400-674b-4842-878b-37f274cde37b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.702012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:create_region(region_id=232c1400-674b-4842-878b-37f274cde37b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.703799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.744154 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1789/3598] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Jun 4 21:02:38 2022] PUT /identity/v3/regions/232c1400-674b-4842-878b-37f274cde37b => generated 229 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:38.750609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.753979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:38.807185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55f28d-d362-489f-80d4-4cb77a39edd3 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.832153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.832846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.833243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.833653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.839499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:38.853533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.857849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.897783 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1810/3599] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:38.899317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:38.948893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e44c2-3fc8-4344-8bc6-7bb2175af24d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.952730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a05f54-92ec-473e-99e8-78b5f4f69518 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:38.954996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.956039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.956318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.956836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/232c1400-674b-4842-878b-37f274cde37b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.957851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=232c1400-674b-4842-878b-37f274cde37b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.959455 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:38.959455 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:38.959455 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:38.960516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:38.961465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:38.962145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:38.962433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:38.962811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:38.990854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:38.993499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.001557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1811/3600] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:02:38 2022] DELETE /identity/v3/regions/232c1400-674b-4842-878b-37f274cde37b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:39.007268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.018474 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1790/3601] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:02:39.048999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:39.055664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6933111-dfbf-48ee-9abe-32d01e0768b6 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.062366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.063726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.064237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.064767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.065710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.067626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.095267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1812/3602] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:02:39 2022] POST /identity/v3/regions => generated 254 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:39.099066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.111288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa7e31-cc6b-4364-ba89-269748fb3081 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.127922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.129166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.129517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.129904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.130991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:update_region(region_id=3c5d8a02bd5147eda1a9950f4e340a47)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.132218 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:39.132218 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:39.132218 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:39.133269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.165495 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1791/3603] 10.222.0.18 () {60 vars in 1249 bytes} [Sat Jun 4 21:02:39 2022] PATCH /identity/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47 => generated 254 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:02:39.169779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.186228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c441b94-894f-4534-b0d3-0fed8b887e50 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.206668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.207572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.207865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.208145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.209097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:get_region(region_id=3c5d8a02bd5147eda1a9950f4e340a47)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.210387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.219562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1813/3604] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:02:39 2022] GET /identity/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47 => generated 254 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:39.222648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.235037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d5a8-1145-453c-b1cb-67702379578d tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.241907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.242806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.243090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.243366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.244089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=3c5d8a02bd5147eda1a9950f4e340a47)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.245104 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:39.245104 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:39.245104 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:39.245994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.275827 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1792/3605] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:39.279858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.292485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683d05c-83d7-440f-a938-1f29c15a2a52 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.315154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.315875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.316162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.316442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.317131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.318287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.328252 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1814/3606] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:02:39 2022] GET /identity/v3/regions => generated 667 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:02:39.330205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.351779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc791-133c-403c-b937-2ebcab559320 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.356748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.365706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.366060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.366279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.366977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=3c5d8a02bd5147eda1a9950f4e340a47)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.369426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Could not find region: 3c5d8a02bd5147eda1a9950f4e340a47.: keystone.exception.RegionNotFound: Could not find region: 3c5d8a02bd5147eda1a9950f4e340a47. Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 3c5d8a02bd5147eda1a9950f4e340a47. Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:39.397856 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 3c5d8a02bd5147eda1a9950f4e340a47. Jun 04 21:02:39.398961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:39.404217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1793/3607] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/regions/3c5d8a02bd5147eda1a9950f4e340a47 => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:39.405367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.417640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d7fdc-3e75-4198-87fb-b411f63aa49f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.425954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.427071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.427364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.428040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.428767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.430283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.450240 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1815/3608] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:02:39 2022] GET /identity/v3/regions => generated 667 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:39.452737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.492587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac667-0749-4e56-9e8c-c94a9ab73b9b tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.531043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.531768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.532487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.532487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.533054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.534734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.578749 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1794/3609] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:02:39 2022] POST /identity/v3/regions => generated 254 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:39.580056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.591786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c39b-2982-48c2-a848-9ae55a52c22e tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.614712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.615470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.615810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.616085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.616815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Adding query filter params (parent_region_id=dc4913c5c0a14e248fa7d3e44ab9abca) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:39.617126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.618244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.629193 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1816/3610] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:02:39 2022] GET /identity/v3/regions?parent_region_id=dc4913c5c0a14e248fa7d3e44ab9abca => generated 400 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:39.631792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.661982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c1b65-ea05-47af-8601-ce5073ea2434 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.683181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.685032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.685332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.685611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/6b9585535f57430b9f8e5dd769620eaf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.686978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6b9585535f57430b9f8e5dd769620eaf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.693038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.699832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:39.754721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1795/3611] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/regions/6b9585535f57430b9f8e5dd769620eaf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:39.756828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.768662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851d3d-966e-45af-979e-0d33ecd603fe tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.789375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.790302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.790678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.790892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/0dd2c1d8a470438c884d7dffacbfba57` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.791777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0dd2c1d8a470438c884d7dffacbfba57)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.793462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.823308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1817/3612] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/regions/0dd2c1d8a470438c884d7dffacbfba57 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:39.824642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:39.840243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf766db-91c6-4df5-a171-bd99b59f1662 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:39.866974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28ec5b93275439aa22f08905b640107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0413373afcb4232b09df2936b9cc3fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:39.873396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:39.873396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:39.873396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] PATH_INFO: `/v3/regions/dc4913c5c0a14e248fa7d3e44ab9abca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:39.873396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dc4913c5c0a14e248fa7d3e44ab9abca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:39.874933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2841f3f-8f39-486c-a362-7c91b21d698f tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:39.921176 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1796/3613] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/regions/dc4913c5c0a14e248fa7d3e44ab9abca => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:39.927014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:40.060393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0326a5-3302-46dc-a9b9-ba5c754295d8 tempest-RegionsTestJSON-2090396077 tempest-RegionsTestJSON-2090396077-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:40.104449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:40.105813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:40.106169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:40.106512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] PATH_INFO: `/v3/users/ab99e282502f4642aca390342cc18ccc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:40.108587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab99e282502f4642aca390342cc18ccc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:40.111324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:40.207215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:40.237352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab99e282502f4642aca390342cc18ccc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:40.245920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:40.246428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:40.246428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:40.258549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab99e282502f4642aca390342cc18ccc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:40.259828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab99e282502f4642aca390342cc18ccc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:40.260696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab99e282502f4642aca390342cc18ccc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:40.275363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:40.277236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:40.295938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13b58ee9-f4dd-4a59-a3e1-f13575d956f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab99e282502f4642aca390342cc18ccc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:40.325430 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1818/3614] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:39 2022] DELETE /identity/v3/users/ab99e282502f4642aca390342cc18ccc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:40.327043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:40.329562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:40.330159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:40.354760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:40.357152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:40.422626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1797/3615] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:40.439167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:40.441372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:40.491395 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1819/3616] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:40.508401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:40.510631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:40.577828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdccb9-fe5d-46e7-9cd5-882323415908 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:40.610617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc84eb-e88e-4173-b602-3af75f702c46 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:40.615248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:40.615959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:40.616244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:40.616513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:40.626623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:40.628124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:40.638730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:40.639109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1820/3617] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:02:40.659070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:40.659774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:40.660055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:40.660332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:40.762684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:40.764775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:40.776229 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1798/3618] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:41.250586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:41.256301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:41.293964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971860e-cbff-4a57-8a97-e89454240455 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:41.307382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:41.308544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:41.308837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:41.309155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] PATH_INFO: `/v3/projects/53136dc0e5c5411dbc9129dfea5fdb08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:41.310484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53136dc0e5c5411dbc9129dfea5fdb08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:41.315380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:41.384410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:41.393593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53136dc0e5c5411dbc9129dfea5fdb08', 'request_id': 'req-54d90781-5d2b-48f2-acbf-3d25d7534f0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.404673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53136dc0e5c5411dbc9129dfea5fdb08', 'request_id': 'req-54d90781-5d2b-48f2-acbf-3d25d7534f0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.414744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53136dc0e5c5411dbc9129dfea5fdb08', 'request_id': 'req-54d90781-5d2b-48f2-acbf-3d25d7534f0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.448331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] The token cache is being invalidate because project 53136dc0e5c5411dbc9129dfea5fdb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:41.449245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.452327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d90781-5d2b-48f2-acbf-3d25d7534f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.457003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1821/3619] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:41 2022] DELETE /identity/v3/projects/53136dc0e5c5411dbc9129dfea5fdb08 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:41.461055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:41.480981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb3ef-87c1-49c0-99fc-5d7f89a5dc43 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:41.619393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:41.620672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:41.620966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:41.621247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] PATH_INFO: `/v3/users/d28ec5b93275439aa22f08905b640107` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:41.623398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28ec5b93275439aa22f08905b640107)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:41.626265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:41.749893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:41.750472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:41.760167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:41.810660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28ec5b93275439aa22f08905b640107'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.812331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28ec5b93275439aa22f08905b640107'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.833775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28ec5b93275439aa22f08905b640107'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.835186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:41.835327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28ec5b93275439aa22f08905b640107'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.841922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:41.858933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28ec5b93275439aa22f08905b640107'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:41.894894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1799/3620] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:41 2022] DELETE /identity/v3/users/d28ec5b93275439aa22f08905b640107 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:42.008856 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1822/3621] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:42.028993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:42.030904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:42.046982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:42.193443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b363f-b716-481c-afbe-f6d63d52b194 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:42.212634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:42.213340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:42.213888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:42.214191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:42.323195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:42.325180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee7f19-7e21-4071-a0b4-72e296071bfa service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:42.354232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1800/3622] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:42.536856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:42.538375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:42.588902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd333e3-54bc-4448-a22a-d821355bfe97 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:42.882675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:42.882675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:42.883313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:42.884349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] PATH_INFO: `/v3/projects/a0413373afcb4232b09df2936b9cc3fb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:42.896000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0413373afcb4232b09df2936b9cc3fb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:42.899364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:43.003378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0413373afcb4232b09df2936b9cc3fb', 'request_id': 'req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:43.013816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0413373afcb4232b09df2936b9cc3fb', 'request_id': 'req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:43.022330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0413373afcb4232b09df2936b9cc3fb', 'request_id': 'req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:43.044677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] The token cache is being invalidate because project a0413373afcb4232b09df2936b9cc3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:43.045642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:43.046743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ec16a5-9da0-4d72-a2a5-c0655e42a5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:43.058179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1823/3623] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:42 2022] DELETE /identity/v3/projects/a0413373afcb4232b09df2936b9cc3fb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:43.063776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.064344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.064344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.146124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:43.155817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:43.264065 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1801/3624] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:43.273560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.274155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.274637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.283130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:43.319852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:43.321370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:43.335056 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1824/3625] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:43.338871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:43.361006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6aac-0c77-4f13-bb04-5ec4193432cb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:43.381099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:43.381836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.382070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.382421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.383932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:02:43.390565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:43.392370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:43.430853 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1802/3626] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:43.441874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:43.486500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142375a-e92a-4853-b57c-7ca35b2eb225 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:43.516412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:43.517226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.517574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.517915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.518868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:43.532321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:43.586137 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1825/3627] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:43 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:43.590192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:43.611845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba01286-1cf1-4c06-8468-3068452d8db4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:43.643841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:43.758099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:43.758099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.758099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.758099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.760894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:43.765328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:43.872758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1803/3628] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:43 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:43.874355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:43.890524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc508-c399-4f70-b01b-3cc3c1e1876f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:43.907002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:43.909236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.909541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.909824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:43.910607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:43.913278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:43.951580 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1826/3629] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:43.954984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:43.980481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eca96-1cfe-4c5e-a0aa-bd8fa179acbf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:43.998355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:43.998921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:43.999088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:43.999809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.000332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:44.002165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b847f8c-4911-4f7f-b18f-8c2abe829a28 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:44.027244 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1804/3630] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:44.032571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:44.060649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f55dc-40c5-4a2b-8cc9-0e29252fb0ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:44.079241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:44.081266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:44.085094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:44.085620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] PATH_INFO: `/v3/projects/1a321433614445d981235c1636f67323/users/6f47d49078f74c9b90bbca39da7f1255/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.136923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a321433614445d981235c1636f67323, user_id=6f47d49078f74c9b90bbca39da7f1255, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:44.139656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:44.187836 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1827/3631] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:44 2022] PUT /identity/v3/projects/1a321433614445d981235c1636f67323/users/6f47d49078f74c9b90bbca39da7f1255/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:44.199372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:44.199372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:44.199861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.264499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] MFA Rules not processed for user `6f47d49078f74c9b90bbca39da7f1255`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:44.266434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:44.444262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:44.444832 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1805/3632] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:44.577398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb108c2-067d-47cc-8378-01d8ee4d5e89 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:44.588799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:44.589490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:44.589779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:44.590053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.590754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:44.592722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:44.657316 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1828/3633] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:02:44 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:44.661552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:44.675234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f1233-091b-4644-a153-4c1ce5f09e24 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:44.820391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:44.821197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:44.821613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:44.822003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.823015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:44.828444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:44.889722 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1806/3634] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:44 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:44.891087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:44.912421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b532b9-8be4-4b79-ab4d-50be8cc32ae7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:44.931323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:44.932042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:44.932326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:44.932605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:44.933347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:44.934971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:44.978889 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1829/3635] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:44.980685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:45.007759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf69d3-1a07-4f97-a4d6-4db99f2bcfe7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:45.022697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:45.024870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:45.025371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:45.025863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] PATH_INFO: `/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792/users/ae0938e242ae40fd825fd0210633a8ec/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:45.079877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfe4e1f143e4a749e1ac7b014ad7792, user_id=ae0938e242ae40fd825fd0210633a8ec, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:45.084562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:45.088539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:45.120865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1807/3636] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:44 2022] PUT /identity/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792/users/ae0938e242ae40fd825fd0210633a8ec/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:45.128262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:45.142272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad40f21-849e-40f3-9908-95de1d7bdd32 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:45.261057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:45.261057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:45.261057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:45.261447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:45.263160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:45.266887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18444619-d930-4c75-a32c-c355cd75182c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:45.284603 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1830/3637] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:45.286063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:45.311458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6a50-0fa7-4df6-b575-7f6ea2e87e7f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:45.322068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:45.325130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:45.329853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:45.330500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] PATH_INFO: `/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792/users/ae0938e242ae40fd825fd0210633a8ec/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:45.334559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfe4e1f143e4a749e1ac7b014ad7792, user_id=ae0938e242ae40fd825fd0210633a8ec, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:45.338237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:45.368336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1808/3638] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:45 2022] PUT /identity/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792/users/ae0938e242ae40fd825fd0210633a8ec/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:45.389669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:45.390239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:45.390737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:45.453078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:45.484410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] MFA Rules not processed for user `ae0938e242ae40fd825fd0210633a8ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:45.486210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:45.710735 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1831/3639] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:45.715979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:45.752150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0f2f-5152-42cf-87c7-ed065c403d24 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:45.772483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:45.773188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:45.773626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:45.773917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:45.774617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:45.780115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:45.862890 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1809/3640] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:02:45 2022] POST /identity/v3/projects => generated 328 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:45.863960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:45.882321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8fc4-d4c5-4453-96e2-c9ce1075f628 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.031674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.032876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.033372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.033969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.034931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.037706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.066839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1832/3641] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:45 2022] POST /identity/v3/users => generated 416 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:46.071047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:46.082197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef952c-d711-424f-8566-36781a8f2f4a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.106291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.107104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.108061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.108433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.110172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.111357 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:46.111357 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:46.111357 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:46.121260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.157427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1810/3642] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:46 2022] POST /identity/v3/roles => generated 244 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:46.160979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:46.176884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda455-33f5-4e14-925f-34334786cd49 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.199966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.200673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.200971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.201256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.202020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.203130 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:46.203130 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:46.203130 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:46.204057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.233707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:46.244032 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1833/3643] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:46 2022] POST /identity/v3/roles => generated 246 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:46.245639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95f694-7ce6-4588-8dbb-b179514844bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.254693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.256259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.256664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.256952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/7d1afcc92fca4cec87d791e001de8cb9/users/8223098d60e24494b66d240aa2e10402/roles/4ec140eaf3b34c46ab82275456dd4d3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.299231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d1afcc92fca4cec87d791e001de8cb9, user_id=8223098d60e24494b66d240aa2e10402, role_id=4ec140eaf3b34c46ab82275456dd4d3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.322007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.361280 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1811/3644] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:46 2022] PUT /identity/v3/projects/7d1afcc92fca4cec87d791e001de8cb9/users/8223098d60e24494b66d240aa2e10402/roles/4ec140eaf3b34c46ab82275456dd4d3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:46.367155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:46.397924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4431cf-caef-4afb-bb1d-048783cc91c8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.542286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.543330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.543719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.544088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/7d1afcc92fca4cec87d791e001de8cb9/users/8223098d60e24494b66d240aa2e10402/roles/c89e60e2f9e3492c91a4a7d7796ec024` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.546462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7d1afcc92fca4cec87d791e001de8cb9, user_id=8223098d60e24494b66d240aa2e10402, role_id=c89e60e2f9e3492c91a4a7d7796ec024)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.549405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54e53-42de-4cde-b3ba-3d5eead22dd5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.581363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:46.584031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1834/3645] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:46 2022] PUT /identity/v3/projects/7d1afcc92fca4cec87d791e001de8cb9/users/8223098d60e24494b66d240aa2e10402/roles/c89e60e2f9e3492c91a4a7d7796ec024 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:46.600805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762486f-d0d8-4adf-8c50-21bfd52b25bb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:46.781189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:46.782750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.789899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.791135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.792300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:46.793739 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:46.793739 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:46.793739 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:46.795276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74b8b1-7d58-405b-b40f-986b65af9ff8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:46.916751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1812/3646] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:46 2022] GET /identity/v3/users => generated 8619 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:46.921547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:46.922030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:46.922114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:46.954540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:47.020946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] MFA Rules not processed for user `8223098d60e24494b66d240aa2e10402`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:47.022543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:47.171196 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1835/3647] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:47.183970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.185038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.186004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.242467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] MFA Rules not processed for user `8223098d60e24494b66d240aa2e10402`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:47.250273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:47.281701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1813/3648] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:47.286229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.305314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194edd5b-4b49-4704-a126-d5263fd44581 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.315763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8223098d60e24494b66d240aa2e10402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d1afcc92fca4cec87d791e001de8cb9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-696266994', 'tempest-DelegatedRole-1224652527'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:47.316916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.317617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.318123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.319687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: Authorizing `identity:create_trust()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:47.321727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:47.460667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1836/3649] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:02:47 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:47.464428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.481020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691a3db-a2a3-4c92-a8b8-0388ab2705fa None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.490104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:47.491644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.492952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.493900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.496125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:47.498331 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:47.498331 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:47.498331 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:47.500555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:47.517639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1814/3650] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 21:02:47 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:47.517945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.539738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6eeb-f637-485a-b199-edaec5bc3414 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.555555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8223098d60e24494b66d240aa2e10402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d1afcc92fca4cec87d791e001de8cb9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-696266994', 'tempest-DelegatedRole-1224652527'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:47.556490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.556782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.557056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] PATH_INFO: `/v3/OS-TRUST/trusts/a653fafc180048e8b58fa597695ebb96` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.575615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: Authorizing `identity:delete_trust(trust_id=a653fafc180048e8b58fa597695ebb96)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:47.577543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:47.618916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a653fafc180048e8b58fa597695ebb96', 'request_id': 'req-b6cf2a72-5981-4053-b0d0-8836f4de9e54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:47.620366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a653fafc180048e8b58fa597695ebb96', 'request_id': 'req-b6cf2a72-5981-4053-b0d0-8836f4de9e54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:47.621289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a653fafc180048e8b58fa597695ebb96', 'request_id': 'req-b6cf2a72-5981-4053-b0d0-8836f4de9e54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:47.663041 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1837/3651] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:02:47 2022] DELETE /identity/v3/OS-TRUST/trusts/a653fafc180048e8b58fa597695ebb96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:47.667468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.669270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:47.707538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c727b-cd90-4576-bbb3-b481f4151704 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.713815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8223098d60e24494b66d240aa2e10402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d1afcc92fca4cec87d791e001de8cb9', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-696266994', 'tempest-DelegatedRole-1224652527'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:47.714594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.714898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.715307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] PATH_INFO: `/v3/OS-TRUST/trusts/a653fafc180048e8b58fa597695ebb96` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Could not find trust: a653fafc180048e8b58fa597695ebb96.: keystone.exception.TrustNotFound: Could not find trust: a653fafc180048e8b58fa597695ebb96. Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 04 21:02:47.748022 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a653fafc180048e8b58fa597695ebb96. Jun 04 21:02:47.749188 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:47.754134 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1815/3652] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:47 2022] GET /identity/v3/OS-TRUST/trusts/a653fafc180048e8b58fa597695ebb96 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:47.756389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.758275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:47.778433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2a72-5981-4053-b0d0-8836f4de9e54 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.789364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:47.790697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:47.791206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:47.791728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/c89e60e2f9e3492c91a4a7d7796ec024` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:47.793471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c89e60e2f9e3492c91a4a7d7796ec024)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:47.794721 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:47.794721 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:47.794721 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:47.797357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:47.869211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:47.885663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role c89e60e2f9e3492c91a4a7d7796ec024 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:47.890578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:47.892041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:47.898256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1838/3653] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:47 2022] DELETE /identity/v3/roles/c89e60e2f9e3492c91a4a7d7796ec024 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:47.902448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:47.904405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:47.938300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114d8e7-d06a-4815-bdd5-a60627fc48f2 tempest-TrustsV3TestJSON-215354566 tempest-user-1361681578] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:47.993837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:48.005257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:48.006417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:48.006944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:48.007292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/4ec140eaf3b34c46ab82275456dd4d3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:48.008975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4ec140eaf3b34c46ab82275456dd4d3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:48.010094 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:48.010094 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:02:48.010094 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:02:48.011144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:48.094880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 4ec140eaf3b34c46ab82275456dd4d3c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:48.095301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.096921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.100456 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1816/3654] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:47 2022] DELETE /identity/v3/roles/4ec140eaf3b34c46ab82275456dd4d3c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:48.105133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:48.116886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c80e7-2fd5-464d-8851-2843db403cfe tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:48.224933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:48.226170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:48.226612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:48.227061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/8223098d60e24494b66d240aa2e10402` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:48.228561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8223098d60e24494b66d240aa2e10402)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:48.230725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:48.287455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8223098d60e24494b66d240aa2e10402'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.303296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8223098d60e24494b66d240aa2e10402'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.304411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8223098d60e24494b66d240aa2e10402'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.306449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8223098d60e24494b66d240aa2e10402'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.328455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8223098d60e24494b66d240aa2e10402'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.350303 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1839/3655] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:48 2022] DELETE /identity/v3/users/8223098d60e24494b66d240aa2e10402 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:48.354724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:48.356226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:48.390322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af6f0-94c3-462e-86bc-c7abb76c7bff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:48.527567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:48.528478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:48.528766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:48.529766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/7d1afcc92fca4cec87d791e001de8cb9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:48.530309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d1afcc92fca4cec87d791e001de8cb9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:48.534816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:48.720124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1afcc92fca4cec87d791e001de8cb9', 'request_id': 'req-c748267a-7b60-4bfa-82f2-ec8a7575d264'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.738262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1afcc92fca4cec87d791e001de8cb9', 'request_id': 'req-c748267a-7b60-4bfa-82f2-ec8a7575d264'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.761477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1afcc92fca4cec87d791e001de8cb9', 'request_id': 'req-c748267a-7b60-4bfa-82f2-ec8a7575d264'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.791960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project 7d1afcc92fca4cec87d791e001de8cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:48.792978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.795860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:48.814373 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1817/3656] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:48 2022] DELETE /identity/v3/projects/7d1afcc92fca4cec87d791e001de8cb9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:48.814583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:48.820156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:48.859172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838eb55-100b-45fc-8ed5-eb981efdb6a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:48.939047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:48.939772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:48.940068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:48.940518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:48.941220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:48.943640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.000341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1840/3657] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:02:48 2022] POST /identity/v3/projects => generated 329 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:49.004549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.006188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:49.053109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748267a-7b60-4bfa-82f2-ec8a7575d264 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:49.141077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:49.169320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:49.170959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:49.172093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:49.173103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:49.175068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:49.178961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.240036 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1818/3658] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:49 2022] POST /identity/v3/users => generated 413 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:49.245637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.252658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:49.260784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65fea0-f29b-4f28-8d73-de060fe37acb tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:49.278060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:49.279099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:49.279478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:49.279898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:49.280793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:49.282569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.325701 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1841/3659] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:49 2022] POST /identity/v3/roles => generated 244 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:49.327008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.350443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675173af-1460-4018-8fa1-592d9f306ca2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:49.356632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:49.357635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:49.358175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:49.358608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:49.359737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:49.362014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.409864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1819/3660] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:49 2022] POST /identity/v3/roles => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:49.415546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.447574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdda51-6353-49cf-92b1-9128e3a8189f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:49.464293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:49.466004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:49.466530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:49.467034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/f439c20f23764d0a802973b55ae7f46e/users/f1db40b1716c4d4f81cb5793408e7a3f/roles/93274ec000ee41ff8ed2c004a9c29d2a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:49.517014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f439c20f23764d0a802973b55ae7f46e, user_id=f1db40b1716c4d4f81cb5793408e7a3f, role_id=93274ec000ee41ff8ed2c004a9c29d2a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:49.519764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.552797 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1842/3661] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:49 2022] PUT /identity/v3/projects/f439c20f23764d0a802973b55ae7f46e/users/f1db40b1716c4d4f81cb5793408e7a3f/roles/93274ec000ee41ff8ed2c004a9c29d2a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:49.554122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.572325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84926a-a7a6-4706-8f63-18cc41693fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:49.835473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:49.836433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:49.836727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:49.837284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/f439c20f23764d0a802973b55ae7f46e/users/f1db40b1716c4d4f81cb5793408e7a3f/roles/7973ba3c798946e19fe98a504be65c1c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:49.846244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f439c20f23764d0a802973b55ae7f46e, user_id=f1db40b1716c4d4f81cb5793408e7a3f, role_id=7973ba3c798946e19fe98a504be65c1c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:49.850129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50990d-c26c-4e8e-9997-62f0c6e21dd0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:49.880089 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1820/3662] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:49 2022] PUT /identity/v3/projects/f439c20f23764d0a802973b55ae7f46e/users/f1db40b1716c4d4f81cb5793408e7a3f/roles/7973ba3c798946e19fe98a504be65c1c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:49.882124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:49.899463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568f29-21d6-458a-b57c-d2c139c22a5e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.000709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.001587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.002077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.002455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.003501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:50.004717 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:50.004717 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:02:50.004717 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:02:50.006805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b054dc-44ae-4b34-bd7b-fda236126fe7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:50.051486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1843/3663] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:49 2022] GET /identity/v3/users => generated 8616 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:50.056760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.057067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.057341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.141299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] MFA Rules not processed for user `f1db40b1716c4d4f81cb5793408e7a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:50.142991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:50.333643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1821/3664] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:50.336016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.336016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.336573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.379710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] MFA Rules not processed for user `f1db40b1716c4d4f81cb5793408e7a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:50.381071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:50.396473 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1844/3665] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:50.398330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:50.421716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950c8d-35e3-4b29-833d-d83f76bf63c6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.428531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1db40b1716c4d4f81cb5793408e7a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f439c20f23764d0a802973b55ae7f46e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-911651282', 'tempest-DelegatedRole-2074554339'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.429211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.432307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.433608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.434456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorizing `identity:create_trust()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:50.435726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:50.569444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:50.666930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1822/3666] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:02:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:50.671317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:50.686055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feadfaa-e497-4982-b882-abc243ece28e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.714608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1db40b1716c4d4f81cb5793408e7a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f439c20f23764d0a802973b55ae7f46e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-911651282', 'tempest-DelegatedRole-2074554339'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.715286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.715592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.715873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.716614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:50.718028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:50.734561 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1845/3667] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Jun 4 21:02:50 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=f1db40b1716c4d4f81cb5793408e7a3f => generated 611 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:50.739572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:50.755282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93716-a9b1-4824-832c-367d0c2785e4 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.772326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1db40b1716c4d4f81cb5793408e7a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f439c20f23764d0a802973b55ae7f46e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-911651282', 'tempest-DelegatedRole-2074554339'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.773067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.773357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.773636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] PATH_INFO: `/v3/OS-TRUST/trusts/75f2d58d774b45f39fa873ab43c69e8a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.790953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorizing `identity:delete_trust(trust_id=75f2d58d774b45f39fa873ab43c69e8a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:50.792563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:50.845744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '75f2d58d774b45f39fa873ab43c69e8a', 'request_id': 'req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:50.846880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '75f2d58d774b45f39fa873ab43c69e8a', 'request_id': 'req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:50.847149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '75f2d58d774b45f39fa873ab43c69e8a', 'request_id': 'req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:50.871812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1823/3668] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:02:50 2022] DELETE /identity/v3/OS-TRUST/trusts/75f2d58d774b45f39fa873ab43c69e8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:50.876059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:50.877819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:50.901707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9029-66a8-49e4-a639-67b020692223 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.925135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1db40b1716c4d4f81cb5793408e7a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f439c20f23764d0a802973b55ae7f46e', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-911651282', 'tempest-DelegatedRole-2074554339'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.926016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.926301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.926580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] PATH_INFO: `/v3/OS-TRUST/trusts/75f2d58d774b45f39fa873ab43c69e8a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Could not find trust: 75f2d58d774b45f39fa873ab43c69e8a.: keystone.exception.TrustNotFound: Could not find trust: 75f2d58d774b45f39fa873ab43c69e8a. Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 04 21:02:50.956705 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 75f2d58d774b45f39fa873ab43c69e8a. Jun 04 21:02:50.957793 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:50.962413 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1846/3669] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:50 2022] GET /identity/v3/OS-TRUST/trusts/75f2d58d774b45f39fa873ab43c69e8a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:50.963105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:50.964748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:50.987991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9f1b6-e0a5-4d18-9eec-cbeeabadec6d tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:50.994173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:50.995543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:50.996046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:50.996570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/7973ba3c798946e19fe98a504be65c1c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:50.998552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7973ba3c798946e19fe98a504be65c1c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:51.000451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:51.109186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 7973ba3c798946e19fe98a504be65c1c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:51.109438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.113129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.116864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1824/3670] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:50 2022] DELETE /identity/v3/roles/7973ba3c798946e19fe98a504be65c1c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:51.119677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:51.121441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:51.142332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed473e-442b-4f6c-8935-0264481503f0 tempest-TrustsV3TestJSON-2124246876 tempest-user-806605341] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:51.264622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:51.265632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:51.265935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:51.266229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/93274ec000ee41ff8ed2c004a9c29d2a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:51.270411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=93274ec000ee41ff8ed2c004a9c29d2a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:51.275596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:51.384349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 93274ec000ee41ff8ed2c004a9c29d2a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:51.385084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.385579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.390823 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1847/3671] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:51 2022] DELETE /identity/v3/roles/93274ec000ee41ff8ed2c004a9c29d2a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:51.394277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:51.416705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453a45d-dde7-4330-9132-3d3bb5d455b0 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:51.541489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:51.542718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:51.543157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:51.543687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/f1db40b1716c4d4f81cb5793408e7a3f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:51.552663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f1db40b1716c4d4f81cb5793408e7a3f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:51.554888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:51.626647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1db40b1716c4d4f81cb5793408e7a3f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.629062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1db40b1716c4d4f81cb5793408e7a3f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.634814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:51.642252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1db40b1716c4d4f81cb5793408e7a3f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.643327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1db40b1716c4d4f81cb5793408e7a3f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.661803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1db40b1716c4d4f81cb5793408e7a3f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:51.692967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1825/3672] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:51 2022] DELETE /identity/v3/users/f1db40b1716c4d4f81cb5793408e7a3f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:51.698043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:51.699493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:51.713333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:51.721554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba03e04-545a-43a8-b762-4b773f5393ac tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:51.864949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:51.866089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:51.866491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:51.866875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/f439c20f23764d0a802973b55ae7f46e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:51.871220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f439c20f23764d0a802973b55ae7f46e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:51.873993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.023236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f439c20f23764d0a802973b55ae7f46e', 'request_id': 'req-bef56cb1-7332-4575-968f-ad2cf741326f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:52.035595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f439c20f23764d0a802973b55ae7f46e', 'request_id': 'req-bef56cb1-7332-4575-968f-ad2cf741326f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:52.051653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f439c20f23764d0a802973b55ae7f46e', 'request_id': 'req-bef56cb1-7332-4575-968f-ad2cf741326f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:52.079920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project f439c20f23764d0a802973b55ae7f46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:52.080544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:52.081409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:52.083972 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1848/3673] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:51 2022] DELETE /identity/v3/projects/f439c20f23764d0a802973b55ae7f46e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:52.093718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.096068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:52.126786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723c2b9-48cf-45c7-9451-4995c115ef59 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.257019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:52.257847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:52.258259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:52.258639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:52.259441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:52.261542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.331098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1826/3674] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:02:52 2022] POST /identity/v3/projects => generated 328 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:52.332215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.334561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:52.427458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef56cb1-7332-4575-968f-ad2cf741326f tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.577285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:52.578539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:52.578987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:52.579443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:52.580402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:52.583064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.624564 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1849/3675] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:52 2022] POST /identity/v3/users => generated 416 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:52.626785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.639429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc54ec-f478-419a-a0af-8e29e06e72c9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.649326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:52.650208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:52.650604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:52.650988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:52.651951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:52.653805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.708924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1827/3676] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:52 2022] POST /identity/v3/roles => generated 242 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:52.710631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.728153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d657-603a-452b-b621-8d0b02392251 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.742159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:52.743160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:52.743723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:52.744261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:52.745219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:52.749108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.797552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1850/3677] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:52 2022] POST /identity/v3/roles => generated 247 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:52.801919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.828574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046112-e93e-4567-8ab2-a77ed89b82ff tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.847427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:52.847427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:52.847427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:52.849095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/dd87008b4e1d426c83a7f68acac7f14b/users/771775dbefc44213a1a9e073be38223f/roles/0fa1ac1703434272bc2522c5963c0d55` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:52.897084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dd87008b4e1d426c83a7f68acac7f14b, user_id=771775dbefc44213a1a9e073be38223f, role_id=0fa1ac1703434272bc2522c5963c0d55)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:52.902147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:52.926666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1828/3678] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:52 2022] PUT /identity/v3/projects/dd87008b4e1d426c83a7f68acac7f14b/users/771775dbefc44213a1a9e073be38223f/roles/0fa1ac1703434272bc2522c5963c0d55 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:52.931024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:52.950893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9fc99-85e3-48ab-b01d-7afdac7f2665 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:52.962923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:53.118420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:53.119349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.119663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.119969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/dd87008b4e1d426c83a7f68acac7f14b/users/771775dbefc44213a1a9e073be38223f/roles/509362dc9c1840a3b45fa7dbeb2d1ef2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.133073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=dd87008b4e1d426c83a7f68acac7f14b, user_id=771775dbefc44213a1a9e073be38223f, role_id=509362dc9c1840a3b45fa7dbeb2d1ef2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:53.138728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e016e-d746-4dbf-a19c-198722789076 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:53.171403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1851/3679] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:52 2022] PUT /identity/v3/projects/dd87008b4e1d426c83a7f68acac7f14b/users/771775dbefc44213a1a9e073be38223f/roles/509362dc9c1840a3b45fa7dbeb2d1ef2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:53.175779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:53.207344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5b80-51e8-49b0-a9fd-d25fa4f5c27d tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:53.344981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:53.345691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.345977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.346271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.347190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:53.350304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb317-701c-4ebc-8b65-cce73d66983a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:53.408721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1829/3680] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:53 2022] GET /identity/v3/users => generated 8619 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:53.410394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.410751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.411170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.484272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] MFA Rules not processed for user `771775dbefc44213a1a9e073be38223f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:53.486340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:53.600293 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1852/3681] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:53.603012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.603713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.604218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.639458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] MFA Rules not processed for user `771775dbefc44213a1a9e073be38223f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:53.642087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:53.655196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1830/3682] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:53.660034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:53.676633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09d44-f6ea-41ea-8b56-a08dd429f1e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:53.682313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:53.682973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.683258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.683570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.684479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:create_trust()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:53.685652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:53.891188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1853/3683] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:02:53 2022] POST /identity/v3/OS-TRUST/trusts => generated 857 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:53.897261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:53.902871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:53.913412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603779d4-1ce1-4459-936f-fbcd7a940aeb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:53.932077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:53.932899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.933181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.933458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:53.950286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:get_trust(trust_id=6739d2283cc04c588e0076a0a8e90764)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:53.951968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:53.976443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1831/3684] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:53 2022] GET /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764 => generated 857 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:53.977989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:53.990289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c852e0-d24c-43e6-a566-224203f897d8 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:53.995607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:53.996698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:53.997078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:53.997581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.010561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6739d2283cc04c588e0076a0a8e90764)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.012866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.014934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:54.029115 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1854/3685] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:02:53 2022] GET /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:54.030664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.042920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd98007-4257-4c72-8280-f7d677217649 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.054962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.056815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.057572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.057959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/0fa1ac1703434272bc2522c5963c0d55` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.066200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6739d2283cc04c588e0076a0a8e90764, role_id=0fa1ac1703434272bc2522c5963c0d55)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.068457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.087416 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1832/3686] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:02:54 2022] GET /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/0fa1ac1703434272bc2522c5963c0d55 => generated 242 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:54.089163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.105695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615537e-67f2-4943-84e0-5083f448eade tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.112673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.113903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.114150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.114725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/0fa1ac1703434272bc2522c5963c0d55` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.125478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6739d2283cc04c588e0076a0a8e90764, role_id=0fa1ac1703434272bc2522c5963c0d55)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.126922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.139696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1855/3687] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:02:54 2022] HEAD /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/0fa1ac1703434272bc2522c5963c0d55 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 04 21:02:54.143786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.158317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13647-0f36-496f-86a6-f18e0a6a8209 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.164054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.164917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.165210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.165492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/509362dc9c1840a3b45fa7dbeb2d1ef2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.174359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6739d2283cc04c588e0076a0a8e90764, role_id=509362dc9c1840a3b45fa7dbeb2d1ef2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.175943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2.: keystone.exception.RoleNotFound: Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2. Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:02:54.226023 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:02:54.226978 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2. Jun 04 21:02:54.226978 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:54.227711 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1833/3688] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:02:54 2022] GET /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/509362dc9c1840a3b45fa7dbeb2d1ef2 => generated 110 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:54.231961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.244833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d034-85a5-4976-ac11-bee3a0fdb936 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.262677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.264340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.264805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.265402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/509362dc9c1840a3b45fa7dbeb2d1ef2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.283142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6739d2283cc04c588e0076a0a8e90764, role_id=509362dc9c1840a3b45fa7dbeb2d1ef2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.284682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2.: keystone.exception.RoleNotFound: Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2. Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:02:54.301576 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:02:54.302655 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 509362dc9c1840a3b45fa7dbeb2d1ef2. Jun 04 21:02:54.302655 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:54.303061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1856/3689] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:02:54 2022] HEAD /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764/roles/509362dc9c1840a3b45fa7dbeb2d1ef2 => generated 0 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 04 21:02:54.308710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.323603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a8b3-974b-47ed-ba4e-9df45424ef36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.339793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.340712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.341001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.341292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.348362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorizing `identity:delete_trust(trust_id=6739d2283cc04c588e0076a0a8e90764)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.350085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.385338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6739d2283cc04c588e0076a0a8e90764', 'request_id': 'req-565d1013-6e8b-417b-ab70-d1bd33dcce36'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.387609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6739d2283cc04c588e0076a0a8e90764', 'request_id': 'req-565d1013-6e8b-417b-ab70-d1bd33dcce36'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.388558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6739d2283cc04c588e0076a0a8e90764', 'request_id': 'req-565d1013-6e8b-417b-ab70-d1bd33dcce36'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.433721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1834/3690] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:02:54 2022] DELETE /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:54.441002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.443451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:54.457897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f280-20b0-4b1f-b142-719ef20b2c8b tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.463860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771775dbefc44213a1a9e073be38223f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd87008b4e1d426c83a7f68acac7f14b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-88808675', 'tempest-NotDelegatedRole-1709301734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.465130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.465413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.465704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] PATH_INFO: `/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Could not find trust: 6739d2283cc04c588e0076a0a8e90764.: keystone.exception.TrustNotFound: Could not find trust: 6739d2283cc04c588e0076a0a8e90764. Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 04 21:02:54.541279 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6739d2283cc04c588e0076a0a8e90764. Jun 04 21:02:54.543461 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:54.544996 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1857/3691] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:54 2022] GET /identity/v3/OS-TRUST/trusts/6739d2283cc04c588e0076a0a8e90764 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:02:54.550035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.552130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:54.581935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1013-6e8b-417b-ab70-d1bd33dcce36 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.587127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.588182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.588567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.588946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/509362dc9c1840a3b45fa7dbeb2d1ef2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.590589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=509362dc9c1840a3b45fa7dbeb2d1ef2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.592614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.657973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 509362dc9c1840a3b45fa7dbeb2d1ef2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:54.668756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.671292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.676384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1835/3692] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:54 2022] DELETE /identity/v3/roles/509362dc9c1840a3b45fa7dbeb2d1ef2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:54.687369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.689503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:54.728743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ea796-2f8c-4a3c-b64b-9858c7ed0f66 tempest-TrustsV3TestJSON-581567780 tempest-user-1545405754] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:54.890641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:54.891946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:54.893473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:54.893473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/0fa1ac1703434272bc2522c5963c0d55` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:54.895815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0fa1ac1703434272bc2522c5963c0d55)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:54.899867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:54.963074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 0fa1ac1703434272bc2522c5963c0d55 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:54.968838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.968838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:54.968838 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1858/3693] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:54 2022] DELETE /identity/v3/roles/0fa1ac1703434272bc2522c5963c0d55 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:54.972653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:54.986277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0fc1-cdd5-4f0f-9a3b-c7b5cb83b2f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:55.054051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:55.055079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:55.055464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:55.055803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/771775dbefc44213a1a9e073be38223f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:55.057135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=771775dbefc44213a1a9e073be38223f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:55.059209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:55.118696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:55.143807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771775dbefc44213a1a9e073be38223f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.144660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771775dbefc44213a1a9e073be38223f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.162039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771775dbefc44213a1a9e073be38223f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.163193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771775dbefc44213a1a9e073be38223f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.209293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771775dbefc44213a1a9e073be38223f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.238578 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1836/3694] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:54 2022] DELETE /identity/v3/users/771775dbefc44213a1a9e073be38223f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:55.240820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:55.242350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:55.266154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9f9b-790b-4f46-bff4-675fcbf5069a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:55.341416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:55.342432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:55.342816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:55.343465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/dd87008b4e1d426c83a7f68acac7f14b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:55.344686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd87008b4e1d426c83a7f68acac7f14b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:55.346980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:55.375366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:55.446829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd87008b4e1d426c83a7f68acac7f14b', 'request_id': 'req-f2b98772-8c2f-465c-8a40-8a5dca9af785'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.478940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd87008b4e1d426c83a7f68acac7f14b', 'request_id': 'req-f2b98772-8c2f-465c-8a40-8a5dca9af785'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.499845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd87008b4e1d426c83a7f68acac7f14b', 'request_id': 'req-f2b98772-8c2f-465c-8a40-8a5dca9af785'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.540380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project dd87008b4e1d426c83a7f68acac7f14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:55.542912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.544277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:55.559231 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1859/3695] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:55 2022] DELETE /identity/v3/projects/dd87008b4e1d426c83a7f68acac7f14b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:55.565251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:55.567023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:55.600776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7dab-b77c-4220-aec5-eb05cf977f8b tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:55.681382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:55.682124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:55.682413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:55.682692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:55.683528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:55.686756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:55.734650 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1837/3696] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:02:55 2022] POST /identity/v3/projects => generated 328 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:55.738944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:55.740752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:55.771888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98772-8c2f-465c-8a40-8a5dca9af785 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:55.880990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:55.884747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:55.885068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:55.885358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:55.886190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:55.888391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:55.926603 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1860/3697] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:55 2022] POST /identity/v3/users => generated 416 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:55.930513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:55.946609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0772fb-d286-48c1-9845-6dcfb347399a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:55.954006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:55.954947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:55.955578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:55.956108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:55.957264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:55.959675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:55.997617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1838/3698] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:55 2022] POST /identity/v3/roles => generated 243 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:56.000260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.027748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3abe-bfd3-403d-9019-835e04553148 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.035584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.036548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.036797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.037083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.038032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.040265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.070221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1861/3699] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:55 2022] POST /identity/v3/roles => generated 246 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:56.070764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.097999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c45b7-9851-4619-9119-9c33ddda6550 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.105021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.106912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.107381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.107879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/3e39a75f16634135ab0f37eea11869e0/users/43a4258f2abd49ac84f495e021159ccd/roles/c2c782c212ea4ace900e0be964aa0de4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.127607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e39a75f16634135ab0f37eea11869e0, user_id=43a4258f2abd49ac84f495e021159ccd, role_id=c2c782c212ea4ace900e0be964aa0de4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.130976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.160315 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1839/3700] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:56 2022] PUT /identity/v3/projects/3e39a75f16634135ab0f37eea11869e0/users/43a4258f2abd49ac84f495e021159ccd/roles/c2c782c212ea4ace900e0be964aa0de4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:56.165203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.177293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d315f4-8e1c-433e-8f16-d47b47593c86 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.279021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.280273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.280728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.281124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/3e39a75f16634135ab0f37eea11869e0/users/43a4258f2abd49ac84f495e021159ccd/roles/fac18236f858488d8d6aaa8c4ab83ad7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.284419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3e39a75f16634135ab0f37eea11869e0, user_id=43a4258f2abd49ac84f495e021159ccd, role_id=fac18236f858488d8d6aaa8c4ab83ad7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.288726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c6260-d2ff-4e00-ae13-1523ce209d31 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.311722 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1862/3701] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:56 2022] PUT /identity/v3/projects/3e39a75f16634135ab0f37eea11869e0/users/43a4258f2abd49ac84f495e021159ccd/roles/fac18236f858488d8d6aaa8c4ab83ad7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:56.315614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.331173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f1bc-c8a4-4ae9-bca1-a433453aa834 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.410838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:56.421118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.421904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.422408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.422695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.423695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.427395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac2fb4-126c-4023-bf61-8a33bb916cf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.467936 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1840/3702] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:56 2022] GET /identity/v3/users => generated 8619 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:02:56.472847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.473028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.473297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.535229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:56.562414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] MFA Rules not processed for user `43a4258f2abd49ac84f495e021159ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:56.576133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:56.715636 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1863/3703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:56.717045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.717506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.717649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.750711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] MFA Rules not processed for user `43a4258f2abd49ac84f495e021159ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:56.752561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:56.765291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1841/3704] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:56.766246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.785810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550e25a-8f7e-48b7-8979-bec029670440 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.795572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43a4258f2abd49ac84f495e021159ccd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e39a75f16634135ab0f37eea11869e0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-413192483', 'tempest-DelegatedRole-892058705'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.796832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.797373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.797885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.799091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] RBAC: Authorizing `identity:create_trust()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.801431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7d457b5d-a367-4041-882c-76efdd0deba2 tempest-TrustsV3TestJSON-876757706 tempest-user-1541158639] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jun 04 21:02:56.902563 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jun 04 21:02:56.903640 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 04 21:02:56.904654 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:56.907782 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1864/3705] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:02:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 142 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 04 21:02:56.911855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:56.920103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.920397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.920664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.924807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb67199-9780-42f9-b556-b150cee6c999 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:56.930619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:56.931560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:56.931825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:56.932102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/fac18236f858488d8d6aaa8c4ab83ad7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:56.933802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fac18236f858488d8d6aaa8c4ab83ad7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:56.936187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:56.960748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:56.962302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:56.992091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role fac18236f858488d8d6aaa8c4ab83ad7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:56.992371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:56.993160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:56.996295 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1842/3706] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:56 2022] DELETE /identity/v3/roles/fac18236f858488d8d6aaa8c4ab83ad7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:57.000606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.002363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.040487 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1865/3707] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:57.057619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.060173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.096578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fa5f1-e50a-4f04-85cd-d48ee8236100 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:57.102686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:57.104013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:57.104690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:57.105287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/c2c782c212ea4ace900e0be964aa0de4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:57.107220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c2c782c212ea4ace900e0be964aa0de4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:57.109139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:57.116664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:57.159933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44947-a6c3-4a62-b789-a144d58ec9cc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:57.170770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role c2c782c212ea4ace900e0be964aa0de4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:57.172680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.174289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.178087 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1843/3708] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:56 2022] DELETE /identity/v3/roles/c2c782c212ea4ace900e0be964aa0de4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:02:57.183643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.185854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.257471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:57.258162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:57.258513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:57.258770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:57.264330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.291668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c4dd6-2603-447f-a6c6-25324ddcaba3 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:57.297938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:57.298839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:57.299125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:57.300038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/43a4258f2abd49ac84f495e021159ccd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:57.301421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=43a4258f2abd49ac84f495e021159ccd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:57.304844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:57.323601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:57.356154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:57.359118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:57.375000 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1866/3709] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:57.377756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a4258f2abd49ac84f495e021159ccd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.379309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a4258f2abd49ac84f495e021159ccd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.400319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a4258f2abd49ac84f495e021159ccd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.402491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a4258f2abd49ac84f495e021159ccd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.433548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a4258f2abd49ac84f495e021159ccd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.460398 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1844/3710] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:57 2022] DELETE /identity/v3/users/43a4258f2abd49ac84f495e021159ccd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:57.464609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.480487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb59424-7e50-4039-9ac1-b7709990a591 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:57.564962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:57.566175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:57.566545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:57.566975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/3e39a75f16634135ab0f37eea11869e0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:57.568996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e39a75f16634135ab0f37eea11869e0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:57.572362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:57.609146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:57.651287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e39a75f16634135ab0f37eea11869e0', 'request_id': 'req-b3adbab5-fe97-49de-ac7a-915249a357af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.658678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e39a75f16634135ab0f37eea11869e0', 'request_id': 'req-b3adbab5-fe97-49de-ac7a-915249a357af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.666303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e39a75f16634135ab0f37eea11869e0', 'request_id': 'req-b3adbab5-fe97-49de-ac7a-915249a357af'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.689612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project 3e39a75f16634135ab0f37eea11869e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:57.689938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.691189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:57.693618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1867/3711] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:57 2022] DELETE /identity/v3/projects/3e39a75f16634135ab0f37eea11869e0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:57.703648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.706631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.729171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e794db-a5a4-474f-a12b-299c45945d7a tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:57.831544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:57.832393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:57.833165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:57.835002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:57.835874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:57.838188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:57.913720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1845/3712] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:02:57 2022] POST /identity/v3/projects => generated 329 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:57.918232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:57.919792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:57.935124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbab5-fe97-49de-ac7a-915249a357af tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.009762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.011107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.011570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.012112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.012987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.015397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.047858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1868/3713] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:02:57 2022] POST /identity/v3/users => generated 413 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:58.049766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.062388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff445931-e831-4cbe-a365-f31cd3c747f2 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.068234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.069134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.070111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.070487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.071387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.073722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.095633 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1846/3714] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/roles => generated 244 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:02:58.096291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.107635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8004bd-69e2-4abe-9434-54fd79709b71 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.112202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.112871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.113158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.113436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.114306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.115968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.133086 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1869/3715] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/roles => generated 247 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:58.137206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.149200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66125776-af6a-4dca-9e6f-e9901cea53da tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.153407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.154311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.154588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.154859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/29f1746f84e14844af5b7fcbc90a29e1/users/fef102f95ae24ed0b21fa96f5579d556/roles/acc7de9b1855454183c1b564ab71c647` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.171597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29f1746f84e14844af5b7fcbc90a29e1, user_id=fef102f95ae24ed0b21fa96f5579d556, role_id=acc7de9b1855454183c1b564ab71c647)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.174315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0c41f-1680-437a-bfad-56833f2aec90 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.193097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1847/3716] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:58 2022] PUT /identity/v3/projects/29f1746f84e14844af5b7fcbc90a29e1/users/fef102f95ae24ed0b21fa96f5579d556/roles/acc7de9b1855454183c1b564ab71c647 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:58.194074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.209105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17deb96-9dac-412e-a75a-65952d51f195 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.292322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.293645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.293944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.294224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/29f1746f84e14844af5b7fcbc90a29e1/users/fef102f95ae24ed0b21fa96f5579d556/roles/bf2062bac24a44e28406cb109bf53206` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.298324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=29f1746f84e14844af5b7fcbc90a29e1, user_id=fef102f95ae24ed0b21fa96f5579d556, role_id=bf2062bac24a44e28406cb109bf53206)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.301230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5a80-6bc7-472c-a15a-b1fceb0408d7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.301416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.301797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5a80-6bc7-472c-a15a-b1fceb0408d7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.302534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5a80-6bc7-472c-a15a-b1fceb0408d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.330697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1870/3717] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:02:58 2022] PUT /identity/v3/projects/29f1746f84e14844af5b7fcbc90a29e1/users/fef102f95ae24ed0b21fa96f5579d556/roles/bf2062bac24a44e28406cb109bf53206 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:58.332368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.335148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-edbf5a80-6bc7-472c-a15a-b1fceb0408d7 None None] MFA Rules not processed for user `d96f5288364449e3af2f39c71a8c3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:58.336404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-edbf5a80-6bc7-472c-a15a-b1fceb0408d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:58.366461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:58.415000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:58.447674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86479cf3-c1b5-4a99-9f77-96c3b17f0396 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.455086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.456064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.456432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.456780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.459681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.463192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6154e-d5a9-4917-a66f-2fed60479816 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.482844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1848/3718] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:02:58.508197 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1871/3719] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:02:58 2022] GET /identity/v3/users => generated 8616 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:02:58.513753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.514160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.515107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.560984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] MFA Rules not processed for user `fef102f95ae24ed0b21fa96f5579d556`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:58.562510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:58.629143 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1849/3720] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:58.713333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.713858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.714023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.736053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] MFA Rules not processed for user `fef102f95ae24ed0b21fa96f5579d556`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:58.737267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:58.746450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1872/3721] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:58.750697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.761296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db748-ab36-46c3-8edf-a9153e4f9151 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.766774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.767494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.767883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.768234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.769077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:create_trust()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.770380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.859587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1850/3722] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:02:58 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:02:58.862998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.874515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8feac0-9243-4e51-a2bb-7430d2d11f5c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.879121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.880050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.880573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.880829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.889001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:get_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.890559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.905772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1873/3723] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:58 2022] GET /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de => generated 834 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:02:58.907199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.922557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85881ca2-b3fd-4cc5-869d-c95a61c5a33c tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.929957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.930902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.931307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.931720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.939647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.941179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.951609 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1851/3724] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:02:58 2022] GET /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:58.956139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:58.968962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2beaa-2c10-46f3-a3b4-b3b02a461420 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:58.973713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:58.974810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:58.975101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:58.975380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/acc7de9b1855454183c1b564ab71c647` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:58.983139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de, role_id=acc7de9b1855454183c1b564ab71c647)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:58.984899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:58.995563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1874/3725] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:02:58 2022] GET /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/acc7de9b1855454183c1b564ab71c647 => generated 244 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:02:58.998258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.019087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df267d-96fa-497a-8beb-a3ee9cbe6a0b tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.025315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.031755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.031755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.031755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/acc7de9b1855454183c1b564ab71c647` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.045247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de, role_id=acc7de9b1855454183c1b564ab71c647)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.046732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.054566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1852/3726] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:02:58 2022] HEAD /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/acc7de9b1855454183c1b564ab71c647 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:02:59.059196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.073432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac801-7250-4424-87dc-85f5a6ff4ac8 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.087463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.088703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.089138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.089594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/bf2062bac24a44e28406cb109bf53206` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.097168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de, role_id=bf2062bac24a44e28406cb109bf53206)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.098873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Could not find role: bf2062bac24a44e28406cb109bf53206.: keystone.exception.RoleNotFound: Could not find role: bf2062bac24a44e28406cb109bf53206. Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:02:59.115028 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:02:59.116050 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bf2062bac24a44e28406cb109bf53206. Jun 04 21:02:59.116050 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:02:59.118007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1875/3727] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:02:59 2022] GET /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/bf2062bac24a44e28406cb109bf53206 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:59.122299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.133755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870c11-db07-4f1b-9ff9-3038ddc127b4 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.138642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.139645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.139886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.140145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/bf2062bac24a44e28406cb109bf53206` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.148411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:59.150951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de, role_id=bf2062bac24a44e28406cb109bf53206)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.152812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Could not find role: bf2062bac24a44e28406cb109bf53206.: keystone.exception.RoleNotFound: Could not find role: bf2062bac24a44e28406cb109bf53206. Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:02:59.177496 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:02:59.178623 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bf2062bac24a44e28406cb109bf53206. Jun 04 21:02:59.178623 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:59.183246 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1853/3728] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:02:59 2022] HEAD /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de/roles/bf2062bac24a44e28406cb109bf53206 => generated 0 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 04 21:02:59.184598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.195817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c3bbf-a8ed-4fd5-b3f1-b7ceee2c0019 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.201276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.202189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.202530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.202868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.211087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorizing `identity:delete_trust(trust_id=b4c46650eebc4e5d8b029458f29c86de)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.212713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.233569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b4c46650eebc4e5d8b029458f29c86de', 'request_id': 'req-7e3c88b2-2691-4a28-9d4f-809005739593'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.234591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b4c46650eebc4e5d8b029458f29c86de', 'request_id': 'req-7e3c88b2-2691-4a28-9d4f-809005739593'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.235683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b4c46650eebc4e5d8b029458f29c86de', 'request_id': 'req-7e3c88b2-2691-4a28-9d4f-809005739593'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.252568 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1876/3729] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:02:59 2022] DELETE /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:59.257565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.259957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.276424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f512fb-42f2-482d-9a02-4e2ae95a3777 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.281417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fef102f95ae24ed0b21fa96f5579d556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f1746f84e14844af5b7fcbc90a29e1', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1911862386', 'tempest-NotDelegatedRole-1525231710'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.282269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.282550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.282823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] PATH_INFO: `/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Could not find trust: b4c46650eebc4e5d8b029458f29c86de.: keystone.exception.TrustNotFound: Could not find trust: b4c46650eebc4e5d8b029458f29c86de. Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 04 21:02:59.298942 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b4c46650eebc4e5d8b029458f29c86de. Jun 04 21:02:59.300051 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:02:59.301072 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1854/3730] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:02:59 2022] GET /identity/v3/OS-TRUST/trusts/b4c46650eebc4e5d8b029458f29c86de => generated 111 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:02:59.304446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.306143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.327547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c88b2-2691-4a28-9d4f-809005739593 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.334755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.336416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.337110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.338184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/bf2062bac24a44e28406cb109bf53206` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.340290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf2062bac24a44e28406cb109bf53206)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.342756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.400951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role bf2062bac24a44e28406cb109bf53206 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:59.401288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.401961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.407932 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1877/3731] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:59 2022] DELETE /identity/v3/roles/bf2062bac24a44e28406cb109bf53206 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:59.409036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.411021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.431266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478161-173b-4f76-b9ff-533126284074 tempest-TrustsV3TestJSON-1277018589 tempest-user-294353596] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.497882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.499118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.499257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.499692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/acc7de9b1855454183c1b564ab71c647` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.501297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=acc7de9b1855454183c1b564ab71c647)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.502954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.579776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role acc7de9b1855454183c1b564ab71c647 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:02:59.580112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.580834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f7114b8c-52d7-4d58-a939-fc2059c13ae9 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.587618 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1855/3732] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:59 2022] DELETE /identity/v3/roles/acc7de9b1855454183c1b564ab71c647 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:59.589858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.605663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9c81-6bc1-400b-918a-f87940bd59e4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.688147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:59.713142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.714577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.714888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.737811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.738692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.739027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.739305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/fef102f95ae24ed0b21fa96f5579d556` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.741233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fef102f95ae24ed0b21fa96f5579d556)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.742171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:02:59.743482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.744313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.802269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef102f95ae24ed0b21fa96f5579d556'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.812403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef102f95ae24ed0b21fa96f5579d556'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.813159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef102f95ae24ed0b21fa96f5579d556'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.813939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef102f95ae24ed0b21fa96f5579d556'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.835142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef102f95ae24ed0b21fa96f5579d556'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:02:59.851413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1856/3733] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:02:59.857166 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1878/3734] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:02:59 2022] DELETE /identity/v3/users/fef102f95ae24ed0b21fa96f5579d556 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:02:59.857360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.859228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.868407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:02:59.873140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:02:59.883454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a028-2e63-41a1-81e6-f754524089d9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.953763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:59.973870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.974832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.975177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.975464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/29f1746f84e14844af5b7fcbc90a29e1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:02:59.977494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29f1746f84e14844af5b7fcbc90a29e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:02:59.979641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:02:59.985406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d6580-0eb9-4ab5-bdca-e073b4920f63 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:02:59.993887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:02:59.994896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:02:59.995364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:02:59.995809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.057592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f1746f84e14844af5b7fcbc90a29e1', 'request_id': 'req-58480116-42c9-4362-9047-9f0c29d0bf1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:00.065705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f1746f84e14844af5b7fcbc90a29e1', 'request_id': 'req-58480116-42c9-4362-9047-9f0c29d0bf1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:00.070547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:00.072845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f1746f84e14844af5b7fcbc90a29e1', 'request_id': 'req-58480116-42c9-4362-9047-9f0c29d0bf1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:00.073935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.076002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.092635 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1879/3735] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:02:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:00.094668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project 29f1746f84e14844af5b7fcbc90a29e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:00.095175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:00.096688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:00.097764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1857/3736] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:59 2022] DELETE /identity/v3/projects/29f1746f84e14844af5b7fcbc90a29e1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:00.104409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.129145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7382467-fd0b-4a82-ae0b-5bd3ca465749 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.217577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.218526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.218701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.218986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.219721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.221738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.255734 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1880/3737] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:03:00 2022] POST /identity/v3/projects => generated 329 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:00.258360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.260348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:00.274893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480116-42c9-4362-9047-9f0c29d0bf1c tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.351497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.352219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.352505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.352789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.353506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.355643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.391457 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1858/3738] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:00 2022] POST /identity/v3/users => generated 416 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:00.396213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.407728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de5225-d343-46e0-a09f-19fac008580e tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.413712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.415295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.415626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.415908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.417224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.418853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.446749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1881/3739] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:00 2022] POST /identity/v3/roles => generated 244 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:00.451184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.463254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f52bd-1962-4679-8c3d-86fa93b95bf5 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.480497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.481916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.482345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.482944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.484340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.486513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.534000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1859/3740] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:00 2022] POST /identity/v3/roles => generated 246 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:00.535132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.548809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55066640-cd90-4f48-a922-834fcb8f1e07 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.556026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.557491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.558031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.558471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/869d937cc32740fe892af2cbe2060fec/users/52080c53058c418396cf1bd365a95ef4/roles/29b5432c36ee4039b1c5ef565e05e810` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.597390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=869d937cc32740fe892af2cbe2060fec, user_id=52080c53058c418396cf1bd365a95ef4, role_id=29b5432c36ee4039b1c5ef565e05e810)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.600696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.637385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1882/3741] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:00 2022] PUT /identity/v3/projects/869d937cc32740fe892af2cbe2060fec/users/52080c53058c418396cf1bd365a95ef4/roles/29b5432c36ee4039b1c5ef565e05e810 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:00.639281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.664392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dccf-09bd-4204-909e-27a1caa3f2e1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.804253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.805442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.805795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.806148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/869d937cc32740fe892af2cbe2060fec/users/52080c53058c418396cf1bd365a95ef4/roles/65ab587a4a4a4fb0a57a0062360e3513` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.812832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:create_grant(project_id=869d937cc32740fe892af2cbe2060fec, user_id=52080c53058c418396cf1bd365a95ef4, role_id=65ab587a4a4a4fb0a57a0062360e3513)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.818116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8e8ee-fc2c-49ea-ad63-d85d3041c7f4 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:00.823075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:00.871933 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1860/3742] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:00 2022] PUT /identity/v3/projects/869d937cc32740fe892af2cbe2060fec/users/52080c53058c418396cf1bd365a95ef4/roles/65ab587a4a4a4fb0a57a0062360e3513 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:00.873387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:00.890289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c6bf-4b5e-4311-a522-00b5dbed52bc tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:00.975011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:00.976013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:00.976458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:00.976886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:00.978240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:00.980582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93b8de-0b7d-413d-b6f4-02431508fbed tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.031085 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1883/3743] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:00 2022] GET /identity/v3/users => generated 8619 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:01.036477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1571-ebe6-4bcd-aab4-d4562531e0d1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.036780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1571-ebe6-4bcd-aab4-d4562531e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.037168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef1571-ebe6-4bcd-aab4-d4562531e0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.109722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1ef1571-ebe6-4bcd-aab4-d4562531e0d1 None None] MFA Rules not processed for user `52080c53058c418396cf1bd365a95ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:01.115081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1ef1571-ebe6-4bcd-aab4-d4562531e0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:01.325256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.325539 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1861/3744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:01.326051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.326476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.361417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] MFA Rules not processed for user `52080c53058c418396cf1bd365a95ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:01.362715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:01.376445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.377075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.377494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.386200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1884/3745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:01.387842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.405740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c337f73-bd1b-41ca-8010-4798a6fb956e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.423788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:01.426134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:01.437116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.439181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.440662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.443388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.449831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:create_trust()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.451422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.556975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:01.582898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1862/3746] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:01.594945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.596633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:01.672458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1885/3747] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:03:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:01.676564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.693912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f7e1a-d4bb-4dcf-ba1a-469d8ef3c294 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.701815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.702980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.703411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.704726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.715963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:get_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.721222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.744782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bbcdb-8089-4385-b154-19fa991fe390 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.745297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1886/3748] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:03:01 2022] GET /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389 => generated 835 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:01.748771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.751821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.752648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.752963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.753247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.765725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.766149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a05e5-595b-4fd0-965a-062f36919e1a tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.772465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.773602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.774579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.775007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.775429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.785646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.788279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.797666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1863/3749] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:03:01.809331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1887/3750] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:03:01 2022] GET /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles => generated 371 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:01.813265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.823369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:01.837110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d801b-c5b2-4f92-be85-2b817ef8a6d5 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.841950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.848214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.848595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.849115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/29b5432c36ee4039b1c5ef565e05e810` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.863253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389, role_id=29b5432c36ee4039b1c5ef565e05e810)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.868307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.882036 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1864/3751] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:03:01 2022] GET /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/29b5432c36ee4039b1c5ef565e05e810 => generated 244 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:01.886337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.899734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d649-ba82-46b0-b999-1d23a1e6a548 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.912570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.913788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.914380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.914806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/29b5432c36ee4039b1c5ef565e05e810` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.922545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389, role_id=29b5432c36ee4039b1c5ef565e05e810)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:01.924561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:01.958020 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1888/3752] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:03:01 2022] HEAD /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/29b5432c36ee4039b1c5ef565e05e810 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 04 21:03:01.963123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:01.975618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdec41-ba84-4e0a-aa61-499030531345 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:01.980085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:01.981423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:01.982130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:01.982416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/65ab587a4a4a4fb0a57a0062360e3513` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:01.996708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389, role_id=65ab587a4a4a4fb0a57a0062360e3513)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.001349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Could not find role: 65ab587a4a4a4fb0a57a0062360e3513.: keystone.exception.RoleNotFound: Could not find role: 65ab587a4a4a4fb0a57a0062360e3513. Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:03:02.030690 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:03:02.031661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 65ab587a4a4a4fb0a57a0062360e3513. Jun 04 21:03:02.031661 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:02.032093 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1865/3753] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:03:01 2022] GET /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/65ab587a4a4a4fb0a57a0062360e3513 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:03:02.037178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.053770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2edeb9-bf20-44ca-a867-98ac0df961cf tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.063320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.064606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.064943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.065485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/65ab587a4a4a4fb0a57a0062360e3513` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.077959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389, role_id=65ab587a4a4a4fb0a57a0062360e3513)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.079843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Could not find role: 65ab587a4a4a4fb0a57a0062360e3513.: keystone.exception.RoleNotFound: Could not find role: 65ab587a4a4a4fb0a57a0062360e3513. Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 04 21:03:02.118378 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:03:02.119386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 65ab587a4a4a4fb0a57a0062360e3513. Jun 04 21:03:02.119386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:03:02.124975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1889/3754] 10.222.0.18 () {58 vars in 1368 bytes} [Sat Jun 4 21:03:02 2022] HEAD /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389/roles/65ab587a4a4a4fb0a57a0062360e3513 => generated 0 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:03:02.126977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.146448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12e00-7e53-4e2e-976a-f04d1dce818f tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.169490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.170391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.170755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.171111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.192123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorizing `identity:delete_trust(trust_id=1278bf259db042d8b27ada0e4b9e0389)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.194171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.242201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1278bf259db042d8b27ada0e4b9e0389', 'request_id': 'req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.243002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1278bf259db042d8b27ada0e4b9e0389', 'request_id': 'req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.243686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1278bf259db042d8b27ada0e4b9e0389', 'request_id': 'req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.265845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1866/3755] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:03:02 2022] DELETE /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:02.272068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.273913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:02.294505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465999-098f-4afa-a6b2-8ef86399bfe2 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.303733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52080c53058c418396cf1bd365a95ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d937cc32740fe892af2cbe2060fec', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-656023289', 'tempest-DelegatedRole-1657446747'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.304748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.305179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.305556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] PATH_INFO: `/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Could not find trust: 1278bf259db042d8b27ada0e4b9e0389.: keystone.exception.TrustNotFound: Could not find trust: 1278bf259db042d8b27ada0e4b9e0389. Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 04 21:03:02.324518 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1278bf259db042d8b27ada0e4b9e0389. Jun 04 21:03:02.325698 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:03:02.332088 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1890/3756] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:03:02 2022] GET /identity/v3/OS-TRUST/trusts/1278bf259db042d8b27ada0e4b9e0389 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:03:02.332988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.334889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:02.356015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed2ba3-d9c1-4c93-a45d-43751b8a5e64 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.389542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.390661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.391008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.391278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/65ab587a4a4a4fb0a57a0062360e3513` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.399534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=65ab587a4a4a4fb0a57a0062360e3513)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.402233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.495456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 65ab587a4a4a4fb0a57a0062360e3513 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:02.495988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.497147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.501055 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1867/3757] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:02 2022] DELETE /identity/v3/roles/65ab587a4a4a4fb0a57a0062360e3513 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:02.505189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.507227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:02.543250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eddf0f-7e74-4b18-bdd8-9c16b6e5c4c6 tempest-TrustsV3TestJSON-1837917453 tempest-user-2081081332] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.652502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.653565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.654083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.654568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/roles/29b5432c36ee4039b1c5ef565e05e810` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.656571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_role(role_id=29b5432c36ee4039b1c5ef565e05e810)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.658470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.730468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invalidating the token cache because role 29b5432c36ee4039b1c5ef565e05e810 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:02.731155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.733479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.738033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1891/3758] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:02 2022] DELETE /identity/v3/roles/29b5432c36ee4039b1c5ef565e05e810 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:02.743670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:02.759192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b2663-6425-4859-82c5-f3a669300fa1 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:02.860701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:02.862480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:02.862840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:02.863201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/users/52080c53058c418396cf1bd365a95ef4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:02.864772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_user(user_id=52080c53058c418396cf1bd365a95ef4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:02.871311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:02.961552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52080c53058c418396cf1bd365a95ef4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.963032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52080c53058c418396cf1bd365a95ef4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.965803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:02.976048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52080c53058c418396cf1bd365a95ef4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:02.976798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52080c53058c418396cf1bd365a95ef4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.007077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52080c53058c418396cf1bd365a95ef4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.038632 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1868/3759] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:02 2022] DELETE /identity/v3/users/52080c53058c418396cf1bd365a95ef4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:03.043715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:03.050231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:03.069182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b5b58-6355-4ea3-a2f7-b374e29566a7 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:03.083059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:03.212972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0938e242ae40fd825fd0210633a8ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfe4e1f143e4a749e1ac7b014ad7792', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:03.213869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:03.214155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:03.214459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] PATH_INFO: `/v3/projects/869d937cc32740fe892af2cbe2060fec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:03.215996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=869d937cc32740fe892af2cbe2060fec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:03.219185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:03.334197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869d937cc32740fe892af2cbe2060fec', 'request_id': 'req-411403e0-d315-432c-a8b0-b3b3d415e9b8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.344068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869d937cc32740fe892af2cbe2060fec', 'request_id': 'req-411403e0-d315-432c-a8b0-b3b3d415e9b8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.353359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869d937cc32740fe892af2cbe2060fec', 'request_id': 'req-411403e0-d315-432c-a8b0-b3b3d415e9b8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.387489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] The token cache is being invalidate because project 869d937cc32740fe892af2cbe2060fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:03.387927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.391011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-411403e0-d315-432c-a8b0-b3b3d415e9b8 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.393134 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1892/3760] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:03 2022] DELETE /identity/v3/projects/869d937cc32740fe892af2cbe2060fec => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:03.401086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:03.403143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:03.597173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a20d35-7423-44ac-82f6-c7797f50ebb6 tempest-TrustsV3TestJSON-1122034659 tempest-TrustsV3TestJSON-1122034659-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:03.741381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:03.742465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:03.742853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:03.743234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] PATH_INFO: `/v3/users/6f47d49078f74c9b90bbca39da7f1255` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:03.744605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f47d49078f74c9b90bbca39da7f1255)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:03.746738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:03.840493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f47d49078f74c9b90bbca39da7f1255'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.841889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f47d49078f74c9b90bbca39da7f1255'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.851172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f47d49078f74c9b90bbca39da7f1255'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.851946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f47d49078f74c9b90bbca39da7f1255'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.870035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f47d49078f74c9b90bbca39da7f1255'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:03.872914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:03.901748 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1869/3761] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:03 2022] DELETE /identity/v3/users/6f47d49078f74c9b90bbca39da7f1255 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:03.903411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:03.903820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:03.904101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:03.929609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:03.930857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:04.018271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1893/3762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:04.028725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:04.032906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:04.108359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014334-e811-44ed-839f-f7434c1c5813 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:04.112411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:04.113129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:04.113417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:04.113697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:04.126168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:04.127673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:04.140624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1870/3763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:04.268865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:04.270707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:04.340201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:04.492564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7116d-87f4-43bd-94e9-45e8f3fdd8c6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:04.509910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:04.512979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:04.514071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:04.515150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:04.519453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:04.564398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:04.571790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:04.616268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1894/3764] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:04.698998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:04.700713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:04.726728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0bbc3-5bd5-4185-80c2-6e92b7f84783 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:04.740240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:04.741350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:04.741787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:04.742211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] PATH_INFO: `/v3/projects/1a321433614445d981235c1636f67323` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:04.745323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a321433614445d981235c1636f67323)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:04.752139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:04.873336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a321433614445d981235c1636f67323', 'request_id': 'req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:04.897496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a321433614445d981235c1636f67323', 'request_id': 'req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:04.907067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a321433614445d981235c1636f67323', 'request_id': 'req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:04.928816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] The token cache is being invalidate because project 1a321433614445d981235c1636f67323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:04.929316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:04.930126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:04.932929 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1871/3765] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:04 2022] DELETE /identity/v3/projects/1a321433614445d981235c1636f67323 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:04.936696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:04.972516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32b9f-e2ca-45a4-bbca-7a96065a2b87 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:05.075275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:05.077439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:05.077971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:05.078592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] PATH_INFO: `/v3/users/ae0938e242ae40fd825fd0210633a8ec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:05.081020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0938e242ae40fd825fd0210633a8ec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:05.084409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:05.175566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0938e242ae40fd825fd0210633a8ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:05.186360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0938e242ae40fd825fd0210633a8ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:05.188202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0938e242ae40fd825fd0210633a8ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:05.190341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0938e242ae40fd825fd0210633a8ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:05.208551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-04f268f6-9f5c-45e3-a61c-995fcc196e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0938e242ae40fd825fd0210633a8ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:05.246143 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1895/3766] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:04 2022] DELETE /identity/v3/users/ae0938e242ae40fd825fd0210633a8ec => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:05.453047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:05.454272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:05.594618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:05.595171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:05.595263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:05.631084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:05.634584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:05.637370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4b4c-bbe8-4ca2-8c07-5cd54b4094a9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:05.666385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:05.681559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:05.774816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:05.775435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:05.776013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:05.776641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:05.779054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:05.797840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:05.803981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74fc08-447a-4422-bfad-4d66ba152027 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:05.804160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1896/3767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:05.804160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:05.804160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:05.814541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1872/3768] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:05.901401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177059-e9cf-4496-a238-667b13ec5587 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:05.908802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:05.910016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:05.910441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:05.911088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] PATH_INFO: `/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:05.913613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfe4e1f143e4a749e1ac7b014ad7792)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:05.916707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:05.988289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfe4e1f143e4a749e1ac7b014ad7792', 'request_id': 'req-1dadc391-474c-414e-ba08-b7f16dcb2442'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:06.028246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfe4e1f143e4a749e1ac7b014ad7792', 'request_id': 'req-1dadc391-474c-414e-ba08-b7f16dcb2442'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:06.050871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfe4e1f143e4a749e1ac7b014ad7792', 'request_id': 'req-1dadc391-474c-414e-ba08-b7f16dcb2442'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:06.118312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] The token cache is being invalidate because project 3bfe4e1f143e4a749e1ac7b014ad7792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:06.118661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:06.120263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1dadc391-474c-414e-ba08-b7f16dcb2442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:06.122500 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1897/3769] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:05 2022] DELETE /identity/v3/projects/3bfe4e1f143e4a749e1ac7b014ad7792 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:06.128026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.128656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.129148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.181850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:06.184142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:06.283887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1873/3770] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:06.292483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.292956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.293400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.307870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.309450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:06.330312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:06.331006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:06.349483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1898/3771] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:06.353345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.412986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a1790-0942-4ac0-9a65-49199e369463 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.422501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e609b-ccb8-4575-a178-b45cfa413bfe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.429750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.430907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.431271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.431694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.432120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.433125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.433567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.434089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.434683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:06.435615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:06.439962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.442093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:06.449575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.454307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:06.474613 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1899/3772] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:06.481379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.484686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1874/3773] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:03:06.500608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412505-e4ce-4fbf-a714-c2801dcf0ee5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.508753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.509845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.510394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.510950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.512384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.515081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:06.598017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1900/3774] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:06 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:06.603080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.624535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df381c-ed85-423a-bbd8-1e9b8fd07792 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.703062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:06.818931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.819747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.820093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.820668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.821401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.824516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:06.863185 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1875/3775] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:06 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:06.867740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.902646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7475099-519c-4dc1-86f8-deb93d1e48ac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.912907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.914679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.915720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.917155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.919373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.928411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:06.935822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:06.966577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:06.966829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1901/3776] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:06.983887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e337b-1dc2-46ae-bbd0-abd4bb59c891 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:06.994975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:06.996618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:06.996927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:06.997199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:06.998078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:06.999773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774753-457c-43c0-a092-b974bb2038ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.018161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1876/3777] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:07.023217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.034887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f017ae-59ed-4c27-8d17-38a7c6f35435 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.040653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.041633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.041978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.042963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] PATH_INFO: `/v3/projects/d909343bbbb14e8e955d0ce0925fc4dd/users/e2fd65bf17d045d5900ded453f91149f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.063219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d909343bbbb14e8e955d0ce0925fc4dd, user_id=e2fd65bf17d045d5900ded453f91149f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.066138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.086493 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1902/3778] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:07 2022] PUT /identity/v3/projects/d909343bbbb14e8e955d0ce0925fc4dd/users/e2fd65bf17d045d5900ded453f91149f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:07.098048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.098786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.099399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.140764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] MFA Rules not processed for user `e2fd65bf17d045d5900ded453f91149f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:07.142638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:07.256610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1877/3779] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:07.259403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.278299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da655752-029f-4c12-bf3c-efc925e7fe5f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.287010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.288167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.288528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.288894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.289640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.291970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.335449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1903/3780] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Jun 4 21:03:07 2022] POST /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:07.340003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.354563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04d91-f335-4548-aa82-6421bc2f892b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.388456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.389732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.390172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.390607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/d479733b387947efa4df51b3a22f1fc7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.393205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=d479733b387947efa4df51b3a22f1fc7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.400594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.446720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1878/3781] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Jun 4 21:03:07 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/d479733b387947efa4df51b3a22f1fc7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:07.447588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.460916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca3a7f-0d3d-42f3-bd3f-42f7d6873054 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.472263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.472472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.472663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.472946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.478682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.480376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.525449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1904/3782] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Jun 4 21:03:07 2022] POST /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:07.530046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.545824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9a74b-82af-440c-a6ab-71ed5d7071cb tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.556487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.559352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.559765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.560295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/36a7989f50be47098da1cb4f549d55b2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.566367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=36a7989f50be47098da1cb4f549d55b2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.572743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.633951 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1879/3783] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Jun 4 21:03:07 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/36a7989f50be47098da1cb4f549d55b2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:07.638190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.650625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a26ec-6e42-431f-94cb-189b3c168939 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.663473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.666409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.666409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.666681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/36a7989f50be47098da1cb4f549d55b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Could not find credential: 9d29bbfdaa25480bc5417b78e7ad0ee3695a72441b632861a14671369bd96041.: keystone.exception.CredentialNotFound: Could not find credential: 9d29bbfdaa25480bc5417b78e7ad0ee3695a72441b632861a14671369bd96041. Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jun 04 21:03:07.729549 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:03:07.730562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 9d29bbfdaa25480bc5417b78e7ad0ee3695a72441b632861a14671369bd96041. Jun 04 21:03:07.731660 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:03:07.735355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1905/3784] 10.222.0.18 () {58 vars in 1376 bytes} [Sat Jun 4 21:03:07 2022] GET /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/36a7989f50be47098da1cb4f549d55b2 => generated 148 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:03:07.742343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.754287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbf90-18c6-4bd7-927a-1902ff82d5e8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.761214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.763056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.763662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.764180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.765089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.766831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.798922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1880/3785] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Jun 4 21:03:07 2022] POST /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:07.803680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.820593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e779f5-5a1c-4429-8482-d6504a0da765 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.827422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.828718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.829049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.829265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.830265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.834911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.880727 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1906/3786] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Jun 4 21:03:07 2022] POST /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:07.884292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.902692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896abf-495c-4616-80a2-ca94889c5529 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.924650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.926709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.927990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.929501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:07.933272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:07.936068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:07.966625 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1881/3787] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 21:03:07 2022] GET /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 865 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:07.970027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:07.984360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77456a-08e5-4a5d-8ffe-bc88fe4723c1 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:07.992835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:07.994063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:07.996514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:07.996514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/939868bdd8544916bb634c7e3d7d1959` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.000001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=939868bdd8544916bb634c7e3d7d1959)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.001624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.025955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.030346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:08.037236 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1907/3788] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Jun 4 21:03:07 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/939868bdd8544916bb634c7e3d7d1959 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:08.041880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.057610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cefcd-38eb-4c91-85d7-587db1c15929 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.064573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.065541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.066133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.066324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/a4dc73dcc9574e6fbe0de1da422ddb24` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.069310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=a4dc73dcc9574e6fbe0de1da422ddb24)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.071152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.110218 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1908/3789] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Jun 4 21:03:08 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/a4dc73dcc9574e6fbe0de1da422ddb24 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:08.115300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.131174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e397442-413d-4647-8315-4d43b2c9ccb3 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.138984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.139955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.140515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.140814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.141675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.143700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.160425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:08.210133 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1909/3790] 10.222.0.18 () {60 vars in 1298 bytes} [Sat Jun 4 21:03:08 2022] POST /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2 => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:08.217299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b0827-0188-4c92-bcb9-3a5c6fdcfda8 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.219045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.234067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1f730-bb3c-4a70-a594-29c95af5e67f tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.235901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.236635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.237070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.237440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.240457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:08.256082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.257154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.257530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.257910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/71a55ada00484c02a7856f702a08ecf3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.262566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=71a55ada00484c02a7856f702a08ecf3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.264313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.268163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.276571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.277087 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1910/3791] 10.222.0.18 () {58 vars in 1376 bytes} [Sat Jun 4 21:03:08 2022] GET /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/71a55ada00484c02a7856f702a08ecf3 => generated 367 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:08.277957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.292411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1882/3792] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:08.339682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022ebf-cc6c-4d9e-bde4-52b78f279352 tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.361358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fd65bf17d045d5900ded453f91149f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd909343bbbb14e8e955d0ce0925fc4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.370827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.378593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.379113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/71a55ada00484c02a7856f702a08ecf3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.383614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e2fd65bf17d045d5900ded453f91149f, credential_id=71a55ada00484c02a7856f702a08ecf3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.385029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231895d6-8bdd-4781-8484-d327d1558bfc tempest-EC2CredentialsTest-1717849429 tempest-EC2CredentialsTest-1717849429-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.464759 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1911/3793] 10.222.0.18 () {58 vars in 1379 bytes} [Sat Jun 4 21:03:08 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f/credentials/OS-EC2/71a55ada00484c02a7856f702a08ecf3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:08.470739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:08.666670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1514-a7b8-434b-8d7f-02612be04fd4 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:08.680890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:08.681912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.682202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.682483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] PATH_INFO: `/v3/users/e2fd65bf17d045d5900ded453f91149f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.685919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fd65bf17d045d5900ded453f91149f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:08.691022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:08.828089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fd65bf17d045d5900ded453f91149f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:08.829425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fd65bf17d045d5900ded453f91149f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:08.844486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fd65bf17d045d5900ded453f91149f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:08.845818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fd65bf17d045d5900ded453f91149f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:08.872568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fd65bf17d045d5900ded453f91149f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:08.922063 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1883/3794] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:08 2022] DELETE /identity/v3/users/e2fd65bf17d045d5900ded453f91149f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:08.926827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:08.929387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:08.929748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:08.981313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:08.985611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:09.143002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1912/3795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:09.155096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:09.158206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:09.278980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707d592-4775-43c4-a816-804d0336f31a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:09.299109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:09.300729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:09.302569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:09.303447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:09.329120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:09.331488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac83389-3bca-4e80-a0b8-ba99e2dd0265 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:09.341648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:09.361297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1884/3796] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:09.892765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:09.894657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:09.925562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dc412-689a-4e65-9926-ee00572b1e68 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:09.932265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:09.933805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:09.934265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:09.934865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] PATH_INFO: `/v3/projects/d909343bbbb14e8e955d0ce0925fc4dd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:09.936741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d909343bbbb14e8e955d0ce0925fc4dd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:09.948949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:09.996420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:10.089280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd909343bbbb14e8e955d0ce0925fc4dd', 'request_id': 'req-fa496576-22ae-448f-ba7a-a722f5be6b09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:10.096807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd909343bbbb14e8e955d0ce0925fc4dd', 'request_id': 'req-fa496576-22ae-448f-ba7a-a722f5be6b09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:10.104460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd909343bbbb14e8e955d0ce0925fc4dd', 'request_id': 'req-fa496576-22ae-448f-ba7a-a722f5be6b09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:10.127047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] The token cache is being invalidate because project d909343bbbb14e8e955d0ce0925fc4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:10.127853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:10.128761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fa496576-22ae-448f-ba7a-a722f5be6b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:10.133025 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1913/3797] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:09 2022] DELETE /identity/v3/projects/d909343bbbb14e8e955d0ce0925fc4dd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:10.138235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.139253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.139828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.173868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:10.175423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:10.269523 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1885/3798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:10.278453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.278847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.279604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.348103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:10.350485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:10.374407 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1914/3799] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:10.375955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.392290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2358-5247-42d3-bd35-a04ff20f2de8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.406288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.408271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.410129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.410618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.412192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:10.415677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:10.417643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:10.442226 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1886/3800] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:10.446599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.458404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d82f-2e9f-40f8-bfca-cba31d7256ab None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.464626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.465576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.466166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.466620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.467689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:10.469861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:10.549847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1915/3801] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:10 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:10.552368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.569061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f08d-9cd9-4c79-8157-4d770d40fe62 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.665550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.666165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.666714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.667160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.668058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:10.670165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:10.704679 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1887/3802] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:10 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:10.705524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.722115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26ce20-e222-40fa-95c8-dccc8dae1705 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.736541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.737742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.738119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.738482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.742316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:10.752283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:10.778018 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1916/3803] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:10.781963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.803123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b52ff5-01fe-415a-80a0-03b0823dd58f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.816553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.817737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.818540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.818916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:10.820157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:10.822730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7b5e3-c478-45b2-9dc3-08fce80c0a9f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:10.846736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1888/3804] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:10.847896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:10.887052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c6a-3c7a-45d2-b322-0ae59b5aea19 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:10.906726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:10.909369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:10.909660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:10.909961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] PATH_INFO: `/v3/projects/07d81d99e089418089ccb9769a482fd5/users/c2b9453a69154f7a9e6635a433b31f8c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:11.003821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d81d99e089418089ccb9769a482fd5, user_id=c2b9453a69154f7a9e6635a433b31f8c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:11.019372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:11.066869 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1917/3805] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:10 2022] PUT /identity/v3/projects/07d81d99e089418089ccb9769a482fd5/users/c2b9453a69154f7a9e6635a433b31f8c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:11.084159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0459cb-703e-4dac-b9eb-a528bf464518 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:11.084598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0459cb-703e-4dac-b9eb-a528bf464518 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:11.085085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0459cb-703e-4dac-b9eb-a528bf464518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:11.143756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ff0459cb-703e-4dac-b9eb-a528bf464518 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:11.147103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ff0459cb-703e-4dac-b9eb-a528bf464518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:11.335017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:11.389759 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1889/3806] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:11.390990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:11.433437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc90b-0481-4306-8680-2ade37863b86 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:11.453584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69117a1-9c94-47e0-b8f1-17965205c98b tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:11.454482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69117a1-9c94-47e0-b8f1-17965205c98b tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:11.454766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69117a1-9c94-47e0-b8f1-17965205c98b tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:11.455056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69117a1-9c94-47e0-b8f1-17965205c98b tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:11.589786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b69117a1-9c94-47e0-b8f1-17965205c98b tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:11.616246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1918/3807] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:11 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:12.624378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:12.630066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:12.630066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:12.700163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:12.702316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:12.721778 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1890/3808] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:12 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:12.724847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:12.725380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:12.725775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:12.792964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:12.796193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:12.823677 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1919/3809] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:12.828103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:12.860645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123e2b5-f28b-4de9-b347-3a0b05ec4c66 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:12.886432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:12.893925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:12.894684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:12.895644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:13.062977 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 04 21:03:13.063961 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:13.069693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1891/3810] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:12 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 188 bytes in 237 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:03:13.069782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:13.099838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c137b-4e18-433d-8058-d2352c62d638 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:13.109097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:13.111252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:13.111805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:13.114948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:13.236255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 04 21:03:13.237179 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:03:13.239905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1920/3811] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:13 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 188 bytes in 171 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:03:13.244391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:13.263338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136671a-3478-4659-81cb-9ba17b288540 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:13.269114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:13.270538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:13.270538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:13.270936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:13.356968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.372577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1892/3812] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:13 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:13.612955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:13.615066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:13.678664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:13.739137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba1a6d-36f4-4648-9c6a-25dfe759d4ee tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:13.752700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:13.753853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:13.754331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:13.754756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] PATH_INFO: `/v3/users/b865a42bb19745bc84c5138c90162e30` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:13.757317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b865a42bb19745bc84c5138c90162e30)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:13.759472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:13.879270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b865a42bb19745bc84c5138c90162e30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.890722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b865a42bb19745bc84c5138c90162e30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.891933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b865a42bb19745bc84c5138c90162e30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.892972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b865a42bb19745bc84c5138c90162e30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.909892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da0ce758-1362-41e9-9037-9e6f7fd9ddaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b865a42bb19745bc84c5138c90162e30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:13.945097 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1921/3813] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:13 2022] DELETE /identity/v3/users/b865a42bb19745bc84c5138c90162e30 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:14.312722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:14.314953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:14.377691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bdbc-47d0-4123-b9a2-5e34192c637d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:14.378009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bdbc-47d0-4123-b9a2-5e34192c637d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:14.378251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bdbc-47d0-4123-b9a2-5e34192c637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:14.399656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8285a6-92ca-40e7-b825-4b0ce8eed7ab tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:14.418454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-af61bdbc-47d0-4123-b9a2-5e34192c637d None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:14.419548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-af61bdbc-47d0-4123-b9a2-5e34192c637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:14.439222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1922/3814] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:14 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:14.440635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:14.440922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:14.454287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:14.487732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:14.489149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:14.593031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:14.594042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:14.594209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:14.594444 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1923/3815] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:14.594561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] PATH_INFO: `/v3/projects/01083c40e40446e581220f68d579105d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:14.595454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:14.608904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9d9a-c216-45bd-8362-d49172638cb2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:14.614090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce8806-375d-4cbf-8e3d-8ea47dbb7bd7 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:14.616109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8806-375d-4cbf-8e3d-8ea47dbb7bd7 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:14.616448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8806-375d-4cbf-8e3d-8ea47dbb7bd7 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:14.617043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce8806-375d-4cbf-8e3d-8ea47dbb7bd7 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:14.618905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01083c40e40446e581220f68d579105d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:14.627166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:14.687093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67ce8806-375d-4cbf-8e3d-8ea47dbb7bd7 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.708212 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1924/3816] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:14 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:14.752581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01083c40e40446e581220f68d579105d', 'request_id': 'req-c90474cb-756d-4f04-8211-99ae96d08354'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.768162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01083c40e40446e581220f68d579105d', 'request_id': 'req-c90474cb-756d-4f04-8211-99ae96d08354'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.780674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01083c40e40446e581220f68d579105d', 'request_id': 'req-c90474cb-756d-4f04-8211-99ae96d08354'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.807138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] The token cache is being invalidate because project 01083c40e40446e581220f68d579105d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:14.807138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.810143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c90474cb-756d-4f04-8211-99ae96d08354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:14.812041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1893/3817] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:14 2022] DELETE /identity/v3/projects/01083c40e40446e581220f68d579105d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:14.817761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:14.818478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:14.818602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:14.846454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:14.848221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:14.869325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:15.052115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.052413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.052700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.060687 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1925/3818] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:15.085614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:15.087293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:15.110077 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1894/3819] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:15.110312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.129073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc153a-3ff6-4bf8-8c6f-1b29caa107e7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.137621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.138328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.139187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.139484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.140283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:15.140707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.142885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.170530 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1926/3820] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:15.176275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.190954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0572-24fd-401b-9db5-7a85cf5dd35b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.208725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.209774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.213124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.213512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.214383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.223430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.265343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:15.292756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1895/3821] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:15.296510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.312279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8493e-c779-43f7-8f5f-25523b6a1ede admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.454361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.455126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.455414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.455847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.456563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.458865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.497472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1927/3822] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:15.501628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.517470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a311d-52b4-4244-be4c-a85da98a4ab6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.526683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.527941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.528476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.529089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.530367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.532574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.556695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1896/3823] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:15.560852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.578354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b74609-bd1e-4c22-bc1b-d0f423de8261 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.592593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.593449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.593855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.594231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.595177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.598149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a765ed-14a7-4353-9854-f2457c492d86 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.624180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:15.625355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1928/3824] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:15.641464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172e1b-8f03-4385-8389-8a5f87e8014e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:15.654199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:15.656492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.657613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.658147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] PATH_INFO: `/v3/projects/54d9ccdbd9754f61ab39f91d928842fb/users/056d2db6425347eabfc1d1cb7802db75/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.697315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d9ccdbd9754f61ab39f91d928842fb, user_id=056d2db6425347eabfc1d1cb7802db75, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:15.703001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626739e-3c7f-48f7-9400-147a1098aed2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:15.713972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b4ad-1bc2-4cb3-9d24-e4526d3c2a5b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.715770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b4ad-1bc2-4cb3-9d24-e4526d3c2a5b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.716179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390b4ad-1bc2-4cb3-9d24-e4526d3c2a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.761142 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1897/3825] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:15 2022] PUT /identity/v3/projects/54d9ccdbd9754f61ab39f91d928842fb/users/056d2db6425347eabfc1d1cb7802db75/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:15.761853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9390b4ad-1bc2-4cb3-9d24-e4526d3c2a5b None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:15.764462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9390b4ad-1bc2-4cb3-9d24-e4526d3c2a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:15.765066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4d04-a04f-49ce-a9b4-274cbaa67567 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.766961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4d04-a04f-49ce-a9b4-274cbaa67567 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.767316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d4d04-a04f-49ce-a9b4-274cbaa67567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.770307 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1929/3826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:15.777999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:15.777999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:15.777999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:15.834435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-db6d4d04-a04f-49ce-a9b4-274cbaa67567 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:15.836060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db6d4d04-a04f-49ce-a9b4-274cbaa67567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:15.838633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:15.840768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:15.990498 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1930/3827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:15.994892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:16.016261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520889-de53-439f-95f7-0f0d6f2542d5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:16.041252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:16.042199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:16.042445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:16.042724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:16.119250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:16.137590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:16.163391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1931/3828] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:16.205681 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1898/3829] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:16.219084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:16.220877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:16.326542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f8f1-dbc6-4626-b223-46cac48ff2e9 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:16.333124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:16.333430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:16.333716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:16.333994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:16.352401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:16.354982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4829802-942f-4b5b-a2cc-0da10d385f94 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:16.400380 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1932/3830] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:17.169631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:17.170732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:17.171201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:17.227715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:17.231440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:17.244264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bf29c-57cf-4f58-bbe2-fb34f70b21f9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:17.244852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bf29c-57cf-4f58-bbe2-fb34f70b21f9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:17.244852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bf29c-57cf-4f58-bbe2-fb34f70b21f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:17.248850 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1899/3831] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:17 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:17.278377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-da9bf29c-57cf-4f58-bbe2-fb34f70b21f9 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:17.279888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da9bf29c-57cf-4f58-bbe2-fb34f70b21f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:17.288745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1933/3832] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:17.293260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:17.305411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0803acc-932d-4f4a-ae17-f841a7d54464 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:17.313397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb983a-a2c9-4246-aa80-ac2161481101 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:17.315285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb983a-a2c9-4246-aa80-ac2161481101 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:17.315285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb983a-a2c9-4246-aa80-ac2161481101 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:17.315725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb983a-a2c9-4246-aa80-ac2161481101 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:17.400213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2cb983a-a2c9-4246-aa80-ac2161481101 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:17.419135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1900/3833] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:17 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:18.423664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093100-ad64-492d-8d4a-470a2e98e319 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:18.424239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093100-ad64-492d-8d4a-470a2e98e319 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:18.424239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093100-ad64-492d-8d4a-470a2e98e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:18.461288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-05093100-ad64-492d-8d4a-470a2e98e319 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:18.463793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-05093100-ad64-492d-8d4a-470a2e98e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:18.468351 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1934/3834] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:18 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 21:03:19.476166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779daa2-67ea-4418-8965-141f0736c953 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:19.479986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779daa2-67ea-4418-8965-141f0736c953 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:19.480617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779daa2-67ea-4418-8965-141f0736c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:19.510061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3779daa2-67ea-4418-8965-141f0736c953 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:19.524243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3779daa2-67ea-4418-8965-141f0736c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:19.536746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946dd01-7c28-4f25-819b-23683c5264bc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:19.537675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946dd01-7c28-4f25-819b-23683c5264bc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:19.537965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946dd01-7c28-4f25-819b-23683c5264bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:19.538534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1901/3835] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:19.560707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c946dd01-7c28-4f25-819b-23683c5264bc None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:19.562256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c946dd01-7c28-4f25-819b-23683c5264bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:19.570696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1935/3836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:19 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:19.572431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945a2d-2d92-4a28-b8e3-d18ef83c19f0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:19.573005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945a2d-2d92-4a28-b8e3-d18ef83c19f0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:19.573797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945a2d-2d92-4a28-b8e3-d18ef83c19f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:19.699419 ncdv-master-1 devstack@keystone.service[97804]: WARNING keystone.server.flask.application [None req-a3945a2d-2d92-4a28-b8e3-d18ef83c19f0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:03:19.701667 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1902/3837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 131 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Jun 04 21:03:19.706143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:19.706767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:19.707405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:19.778738 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.application [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:03:19.788168 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1936/3838] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 83 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 04 21:03:19.792856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:19.793226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:19.793573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:19.824633 ncdv-master-1 devstack@keystone.service[97804]: WARNING keystone.server.flask.application [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:03:19.828035 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1903/3839] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 36 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 04 21:03:20.270586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:20.272738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:20.312051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848c77-c511-4b17-8e76-7a61d14325ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:20.321349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:20.323809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:20.324240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:20.324601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] PATH_INFO: `/v3/users/425dba3904234fc08c2913a4e299b003` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:20.326988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425dba3904234fc08c2913a4e299b003)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:20.330695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:20.596019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425dba3904234fc08c2913a4e299b003'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:20.620278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425dba3904234fc08c2913a4e299b003'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:20.623957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425dba3904234fc08c2913a4e299b003'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:20.624870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425dba3904234fc08c2913a4e299b003'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:20.667107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c57deaa-d172-423f-84fb-18b172b5e442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425dba3904234fc08c2913a4e299b003'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:20.700390 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1937/3840] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:20 2022] DELETE /identity/v3/users/425dba3904234fc08c2913a4e299b003 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:21.176823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:21.179398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:21.282185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:21.315851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ad978-da41-4a43-97f7-5aa7725c7016 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:21.324144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:21.325857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:21.326364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:21.326647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] PATH_INFO: `/v3/projects/c13a926a61e0412c8eae94528aeb0a4e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:21.339042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13a926a61e0412c8eae94528aeb0a4e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:21.341957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:21.425617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13a926a61e0412c8eae94528aeb0a4e', 'request_id': 'req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:21.445089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13a926a61e0412c8eae94528aeb0a4e', 'request_id': 'req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:21.460320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13a926a61e0412c8eae94528aeb0a4e', 'request_id': 'req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:21.498706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] The token cache is being invalidate because project c13a926a61e0412c8eae94528aeb0a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:21.499218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:21.500678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72576c85-ebe0-45a7-9a79-4ad2c6574d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:21.502995 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1904/3841] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:21 2022] DELETE /identity/v3/projects/c13a926a61e0412c8eae94528aeb0a4e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:21.509636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:21.510982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:21.511491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:21.539829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:21.544916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:21.592455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=11,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:21.668109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1938/3842] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:21.679543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:21.679987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:21.680343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:21.714238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:21.716839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:21.768708 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1905/3843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:21.770188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:21.786336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4e139-5c40-4df5-b0ae-e3dd88062b02 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:21.796235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:21.797549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:21.797856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:21.798533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:21.798882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:21.799469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:21.806287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:21.839099 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1939/3844] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:21.845175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:21.855287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3c7da-15be-4ec9-9f4c-6371ca50364b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:21.873658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:21.876216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:21.876497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:21.876775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:21.877504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:21.881344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:21.942600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1906/3845] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:21 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:21.949931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:21.966001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcc2f-a7ec-44a8-8b7b-62fce825cd8a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.080402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.081680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.082296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.082767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.083935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.087077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.134359 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1940/3846] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:21 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:22.138095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.151765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc769a-2ce2-40ec-b7bc-83723b3447e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.167606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.168465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.168970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.169354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.170591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.172912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.188760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1907/3847] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:22.192955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.205298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b7c10-a63b-4e73-8fb9-aa99ace64c54 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.210629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.211341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.211664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.211947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.212901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.214938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb462c8-f4e3-449b-adff-42538640374e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.229583 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1941/3848] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:22.231420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.246866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d93b71-2c08-4bb3-b90c-747e858cc4fb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.252630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.253792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.254529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.254529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] PATH_INFO: `/v3/projects/034695c0a3fa43cb926e0538d8100713/users/a6076a6f647c4adfb4701a33dc8fe6fb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.273027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=034695c0a3fa43cb926e0538d8100713, user_id=a6076a6f647c4adfb4701a33dc8fe6fb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.275759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.309152 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1908/3849] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:22 2022] PUT /identity/v3/projects/034695c0a3fa43cb926e0538d8100713/users/a6076a6f647c4adfb4701a33dc8fe6fb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:22.318690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.319303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.319798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.350259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] MFA Rules not processed for user `a6076a6f647c4adfb4701a33dc8fe6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:22.351623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:22.476433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1942/3850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:22.476758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.579151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7149b6-73bc-4307-8658-9b79233b3b6f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.588820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.590698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.591849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.592151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.593403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.598338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.624052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:22.656758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1909/3851] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:22 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:22.661908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.675649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf189b-7cf4-4c34-86f5-abd0526f9ba3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.706142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:22.808589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.809284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.809565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.809840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.810544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.812762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.845404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1943/3852] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:22 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:22.849729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.861640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd63b-4785-4e71-9a59-1e6e5b887f40 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.867453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.868340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.869365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.869652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.870411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.873381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.887448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1910/3853] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:22.891934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.907613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b318-050f-4aab-afbc-1222da2f2918 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:22.913373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:22.914297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:22.914776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:22.915346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] PATH_INFO: `/v3/projects/307d26ef9c5f4de998db4f376c7f698d/users/d74d31941534450ba2e2e445316cfc2c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:22.934897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307d26ef9c5f4de998db4f376c7f698d, user_id=d74d31941534450ba2e2e445316cfc2c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:22.938337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:22.957188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1944/3854] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:22 2022] PUT /identity/v3/projects/307d26ef9c5f4de998db4f376c7f698d/users/d74d31941534450ba2e2e445316cfc2c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:22.961636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:22.973068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934df49-9307-4a9e-8d8b-f6803a476c0d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.050807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.052245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.052537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.053284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.053543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.055309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc0750-26b2-4c02-a84f-5c4980e0fbc3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.071952 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1911/3855] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:23.072396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.094811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e4fa-73d1-42f6-865f-39f692d07b12 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.109710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0625cf-2ac4-4618-886e-7cb3d1dadb4a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.110000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0625cf-2ac4-4618-886e-7cb3d1dadb4a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.110280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0625cf-2ac4-4618-886e-7cb3d1dadb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.115742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.116973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.117516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.117934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] PATH_INFO: `/v3/projects/307d26ef9c5f4de998db4f376c7f698d/users/d74d31941534450ba2e2e445316cfc2c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.121292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=307d26ef9c5f4de998db4f376c7f698d, user_id=d74d31941534450ba2e2e445316cfc2c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.125706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3904a1-c8a7-4cc5-b20e-0469f251132c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.145264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cb0625cf-2ac4-4618-886e-7cb3d1dadb4a None None] MFA Rules not processed for user `056d2db6425347eabfc1d1cb7802db75`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:23.147448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb0625cf-2ac4-4618-886e-7cb3d1dadb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:23.151909 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1945/3856] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:23 2022] PUT /identity/v3/projects/307d26ef9c5f4de998db4f376c7f698d/users/d74d31941534450ba2e2e445316cfc2c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:23.153556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.154478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.154478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.195754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] MFA Rules not processed for user `d74d31941534450ba2e2e445316cfc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:23.197354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:23.300066 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1912/3857] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:23.314330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.315569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.315865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.367088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] MFA Rules not processed for user `056d2db6425347eabfc1d1cb7802db75`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:23.368506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:23.380440 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1946/3858] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:23.385176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.393028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1913/3859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:23.408045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d788-d4b7-461b-b9fc-0137c43eb980 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.415208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.416648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.416944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.417298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.418066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.419745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.448482 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1947/3860] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/services => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:23.449331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.470711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0b599-e331-4489-b867-29949a4345f5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.503035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.503764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.504140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.504486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.505567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.506858 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:23.506858 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:23.506858 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:23.508918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: 'False' Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise error Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'False' Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.531755 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:03:23.533482 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'False' Jun 04 21:03:23.534707 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.535819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1914/3861] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/endpoints => generated 283 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 04 21:03:23.540899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.543055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:23.552574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.579382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962948-6138-4156-a9ec-2e3bce737186 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.591838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.592775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.593540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.597043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.598006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.599768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: 'True' Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise error Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'True' Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.615612 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:03:23.617350 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'True' Jun 04 21:03:23.618473 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.619758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1915/3862] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/endpoints => generated 281 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:03:23.625176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.653291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:23.663130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3733a-c379-4da2-be87-b00826848d27 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.670904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.672060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.673419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.673928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.675987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.678520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.710744 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-723929370. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:03:23.710744 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:03:23.710744 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:23.721882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235141e0-94d8-4a96-aa2f-935736165cf4 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.746930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.748058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.748499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.748921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.764538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.766770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.800011 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1948/3863] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:23 2022] GET /identity/v3/auth/tokens => generated 3573 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:23.802248 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1916/3864] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:03:23 2022] POST /identity/v3/endpoints => generated 358 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:23.807238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.841844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67cdc-60eb-4306-8fc8-cb770a257d23 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.862923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.864054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.864507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.864851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/regions/tempest-region-723929370` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.865589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-723929370)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.866841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.870103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1949/3865] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:03:23 2022] GET /identity/v3/regions/tempest-region-723929370 => generated 178 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:23.873444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.881636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:23.887169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddc4c-dbff-4ef3-abac-19cb06093b25 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.893191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.894074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.894363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.894770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints/9fe1f636420947fb9caa1dd00ade30fe` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.903459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=9fe1f636420947fb9caa1dd00ade30fe)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.904971 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:23.904971 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:23.904971 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:23.905887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: 'False' Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise error Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'False' Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.917157 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:03:23.918956 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'False' Jun 04 21:03:23.920151 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:23.922039 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1917/3866] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Jun 4 21:03:23 2022] PATCH /identity/v3/endpoints/9fe1f636420947fb9caa1dd00ade30fe => generated 283 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:03:23.923106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:23.934906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeeec4-01c9-4a92-bc99-6aafba68161b tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:23.945029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:23.946078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:23.946455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:23.946874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints/9fe1f636420947fb9caa1dd00ade30fe` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:23.949157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9fe1f636420947fb9caa1dd00ade30fe)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:23.950683 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:23.950683 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:23.950683 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:23.951888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:23.967029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9fe1f636420947fb9caa1dd00ade30fe', 'request_id': 'req-66f80247-cd4e-4317-adf5-fad8638fc66c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:23.987201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1950/3867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:23 2022] DELETE /identity/v3/endpoints/9fe1f636420947fb9caa1dd00ade30fe => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:23.991662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.013928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a900a83-c733-4267-8218-b83660228965 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.034196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.035042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.035392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.035751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/regions/tempest-region-723929370` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.036422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-723929370)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.038027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.061289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1918/3868] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:03:23 2022] DELETE /identity/v3/regions/tempest-region-723929370 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:24.066567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.078921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80247-cd4e-4317-adf5-fad8638fc66c tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.100643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.101446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.101801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.102155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.103052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.104389 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:24.104389 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:24.104389 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:24.105445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.126146 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2032134341. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:03:24.126146 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:03:24.126146 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:24.161759 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1951/3869] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:03:24 2022] POST /identity/v3/endpoints => generated 360 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:24.165502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.218873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f1fc-484f-4266-9e49-2e5221dcf5ee tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.242936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.244936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:24.260575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.261531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.261862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.262148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/regions/tempest-region-2032134341` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.262820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2032134341)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.264931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.271234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1919/3870] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:03:24 2022] GET /identity/v3/regions/tempest-region-2032134341 => generated 180 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:24.273152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.292993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be160-7b70-44e4-9269-be3d930387b7 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.299785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.301017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.301676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.301676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints/2ad52b74eda24072ab559e35e77b5b4c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.313593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2ad52b74eda24072ab559e35e77b5b4c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.315253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: On instance['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: 'True' Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise error Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'True' Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.326552 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:03:24.328373 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['enabled']: Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application 'True' Jun 04 21:03:24.329631 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:24.331177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1920/3871] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Jun 4 21:03:24 2022] PATCH /identity/v3/endpoints/2ad52b74eda24072ab559e35e77b5b4c => generated 281 bytes in 59 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:03:24.332245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.344365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e669f-b417-4922-8eac-92570b5aa1aa tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.352368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.353687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.354150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.354571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/endpoints/2ad52b74eda24072ab559e35e77b5b4c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.356548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2ad52b74eda24072ab559e35e77b5b4c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.358140 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:24.358140 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:24.358140 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:24.359548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.376399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fad8-c3bb-4f62-94da-2ff788f90d37 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.383152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.383822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.384116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.384411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.386734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:24.386932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2ad52b74eda24072ab559e35e77b5b4c', 'request_id': 'req-e82a4ef3-3387-4783-93f1-5e41d1a54489'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.403123 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1921/3872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:24 2022] DELETE /identity/v3/endpoints/2ad52b74eda24072ab559e35e77b5b4c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:24.403965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.405905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.408293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.419414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1952/3873] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:24 2022] GET /identity/v3/auth/tokens => generated 3426 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:03:24.442207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a4ef3-3387-4783-93f1-5e41d1a54489 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.449979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.451199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.451683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.452714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/regions/tempest-region-2032134341` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.452898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2032134341)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.454917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.471478 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2032134341. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:03:24.471478 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:03:24.471478 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:24.479208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1922/3874] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 21:03:24 2022] DELETE /identity/v3/regions/tempest-region-2032134341 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:24.483871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.514564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b6e5-97ad-40f1-b833-c1be461f4f17 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.531851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:24.543369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74d31941534450ba2e2e445316cfc2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307d26ef9c5f4de998db4f376c7f698d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.544560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.545055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.547259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] PATH_INFO: `/v3/services/544fab32339a4bbdb2804a787e2b3228` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.548048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorizing `identity:delete_service(service_id=544fab32339a4bbdb2804a787e2b3228)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.550049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52099020-7c6b-4fe8-bd13-2ffd334fc4dc tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.591553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1953/3875] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:24 2022] DELETE /identity/v3/services/544fab32339a4bbdb2804a787e2b3228 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:24.593966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:24.724224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f7a9-950d-4427-b58e-e538554cdd78 tempest-EndpointsNegativeTestJSON-249294137 tempest-EndpointsNegativeTestJSON-249294137-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:24.752388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:24.753635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.754053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.757074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] PATH_INFO: `/v3/users/a6076a6f647c4adfb4701a33dc8fe6fb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.757074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6076a6f647c4adfb4701a33dc8fe6fb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:24.759480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:24.836326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:24.853312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6076a6f647c4adfb4701a33dc8fe6fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.854320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6076a6f647c4adfb4701a33dc8fe6fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.868187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6076a6f647c4adfb4701a33dc8fe6fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.869346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6076a6f647c4adfb4701a33dc8fe6fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.888917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6076a6f647c4adfb4701a33dc8fe6fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:24.921521 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1923/3876] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:24 2022] DELETE /identity/v3/users/a6076a6f647c4adfb4701a33dc8fe6fb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:24.926259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:24.926876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:24.927609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:24.948803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:24.950002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:25.061344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1954/3877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:25.073192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:25.075298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:25.199394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b0b2-bbbd-401d-88a8-2ad4702fbd87 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:25.204235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:25.205106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:25.205399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:25.205851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:25.231072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:25.233611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c48cc-0bff-411d-a561-7decfa168b3f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:25.258939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1924/3878] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:03:25.764946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:25.766840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:25.773879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:25.774486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:25.774705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:25.780012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957afd0-cdb0-47e9-8d74-ec9f6876a2d4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:25.789871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:25.789871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:25.789871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:25.789871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] PATH_INFO: `/v3/projects/034695c0a3fa43cb926e0538d8100713` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:25.791601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=034695c0a3fa43cb926e0538d8100713)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:25.794047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:25.813160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] MFA Rules not processed for user `5b4c3539c5534d2c844944f9be3f9963`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:25.815158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:25.879170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034695c0a3fa43cb926e0538d8100713', 'request_id': 'req-dbe6e248-3290-48fc-b331-b938e9c2bb18'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:25.889877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034695c0a3fa43cb926e0538d8100713', 'request_id': 'req-dbe6e248-3290-48fc-b331-b938e9c2bb18'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:25.909759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034695c0a3fa43cb926e0538d8100713', 'request_id': 'req-dbe6e248-3290-48fc-b331-b938e9c2bb18'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:25.911924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1925/3879] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:25.964150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] The token cache is being invalidate because project 034695c0a3fa43cb926e0538d8100713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:25.964680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:25.965397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dbe6e248-3290-48fc-b331-b938e9c2bb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:25.980160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1955/3880] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:25 2022] DELETE /identity/v3/projects/034695c0a3fa43cb926e0538d8100713 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:25.984548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:26.008681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab93d-1298-491e-99bd-6b729ec16202 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:26.078316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:26.102767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:26.103897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:26.104187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:26.104470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] PATH_INFO: `/v3/users/d74d31941534450ba2e2e445316cfc2c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:26.105747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74d31941534450ba2e2e445316cfc2c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:26.107857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:26.200788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:26.201130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:26.201359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:26.201978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74d31941534450ba2e2e445316cfc2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:26.202781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74d31941534450ba2e2e445316cfc2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:26.215594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74d31941534450ba2e2e445316cfc2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:26.216532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74d31941534450ba2e2e445316cfc2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:26.230940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:26.232688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:26.234163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74d31941534450ba2e2e445316cfc2c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:26.261697 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1926/3881] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:25 2022] DELETE /identity/v3/users/d74d31941534450ba2e2e445316cfc2c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:26.410675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:26.442842 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1956/3882] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:26.446867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:26.448038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:26.773114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c61f2-ef23-4761-9deb-19b5361c640b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:26.797099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:26.797794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:26.804602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:26.804602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:26.879652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:26.881905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:26.909783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fde56-f5b4-4fe5-b4b2-160d4d2145a6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:26.949510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:26.953845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:26.958366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebc14b-2343-4c41-943b-00c0f5f79d5a service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:26.984537 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1927/3883] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:27.000136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.000726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.001179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.050586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:27.054109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:27.071089 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1928/3884] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:03:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:27.078904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:27.079990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.080463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.081321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] PATH_INFO: `/v3/projects/307d26ef9c5f4de998db4f376c7f698d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.084073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=307d26ef9c5f4de998db4f376c7f698d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:27.086806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:27.106501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:27.132856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e466e-0afd-4140-b7f0-477497d7176f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:27.139149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:27.139858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.140130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.140411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.170777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:27.172455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c7af-46d3-4e94-acec-228e6da052ad service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:27.195080 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1929/3885] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:03:27.245025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307d26ef9c5f4de998db4f376c7f698d', 'request_id': 'req-7fe70192-92e0-48dd-8d90-d82b750b5d7f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:27.267252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307d26ef9c5f4de998db4f376c7f698d', 'request_id': 'req-7fe70192-92e0-48dd-8d90-d82b750b5d7f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:27.295882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307d26ef9c5f4de998db4f376c7f698d', 'request_id': 'req-7fe70192-92e0-48dd-8d90-d82b750b5d7f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:27.329420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] The token cache is being invalidate because project 307d26ef9c5f4de998db4f376c7f698d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:27.329420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:27.331909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe70192-92e0-48dd-8d90-d82b750b5d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:27.333839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1957/3886] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:26 2022] DELETE /identity/v3/projects/307d26ef9c5f4de998db4f376c7f698d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:27.340151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.340421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.340710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.380618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:27.387839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:27.548986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1930/3887] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:27.559215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.559736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.560381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.601713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:27.605464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:27.624931 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1958/3888] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:27.626417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:27.653989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b403be-c95b-458d-91c9-ee6da23bf144 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:27.676949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:27.677577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.677853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.678166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.679152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:27.679152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:27.680953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:27.699568 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1931/3889] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:27.702959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:27.713934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b37a79-134e-458e-a7ce-f05ad942ee45 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:27.726286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:27.727318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.727876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.728300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.729916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:27.732213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:27.799386 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1959/3890] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:27 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:27.800673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:27.819587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8021ef-6375-438d-8ce0-c73408a67aa9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:27.912191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:27.912911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:27.913192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:27.913472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:27.914186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:27.916799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:27.981282 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1932/3891] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:27 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:27.985898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:28.047839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495b402-961a-4612-922a-973b35372f3a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:28.074853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:28.075585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:28.075876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:28.076166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:28.087892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:28.101472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:28.143024 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1960/3892] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:28.146949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:28.160883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059cac8-045b-404c-a7e6-9ed20ffc622e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:28.176033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:28.177246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:28.177792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:28.178422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:28.179405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:28.181382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccad90-0551-4047-9157-128bf98f00c1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:28.201502 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1933/3893] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:28.205740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:28.223930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02657b5b-2bf7-45fd-88fe-7db9ec615f5f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:28.229431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:28.230772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:28.231096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:28.231423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] PATH_INFO: `/v3/projects/e2bce96ac387446c96edb220946bb5ac/users/7c9ca659af1f4d73ba71aabf06f39dff/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:28.256476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bce96ac387446c96edb220946bb5ac, user_id=7c9ca659af1f4d73ba71aabf06f39dff, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:28.265127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:28.297772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1961/3894] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:28 2022] PUT /identity/v3/projects/e2bce96ac387446c96edb220946bb5ac/users/7c9ca659af1f4d73ba71aabf06f39dff/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:28.309325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:28.309666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:28.309945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:28.428027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] MFA Rules not processed for user `7c9ca659af1f4d73ba71aabf06f39dff`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:28.429587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:28.538899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:28.745522 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1934/3895] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:28.747186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:28.814628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:28.983408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f31e3-e836-491a-9912-de1591a10426 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.009919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.022663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.023054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.023368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.034290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.042703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:29.155553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1962/3896] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:28 2022] POST /identity/v3/projects => generated 373 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:29.157666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:29.182679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb3803-b2cf-4e6f-8c8e-47364cbfbc5f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.413100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.413725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.414022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.414681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.415398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.420320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:29.475921 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1935/3897] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:29 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:29.476261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:29.495289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54032f8-37fe-4edf-8a91-62d23372e8f2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.507950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.508939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.509524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.509927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.511276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.513058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:29.540377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1963/3898] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:29.542643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:29.559742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f765d7-f6a0-4e37-829a-e7fb7d72102e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.577000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.578435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.578727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.579007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] PATH_INFO: `/v3/projects/299b146df17741c9adfff50a7d7663dd/users/f9b587e98790460c930e6eebc12ffecb/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.628790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299b146df17741c9adfff50a7d7663dd, user_id=f9b587e98790460c930e6eebc12ffecb, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.638433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:29.678557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1936/3899] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:29 2022] PUT /identity/v3/projects/299b146df17741c9adfff50a7d7663dd/users/f9b587e98790460c930e6eebc12ffecb/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:29.679537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:29.708552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc17d7d-e313-490e-8d5b-da3aa238a5ef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.880573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.882911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.885693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.886024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.887053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.892133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2baff1-ae93-45b4-b8aa-5bd880b548fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:29.917956 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1964/3900] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:29.923801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:29.945099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb76c2-0e41-4cd2-b767-279ac6958f21 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:29.967952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:29.969500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:29.969796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:29.970074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] PATH_INFO: `/v3/projects/299b146df17741c9adfff50a7d7663dd/users/f9b587e98790460c930e6eebc12ffecb/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:29.977093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299b146df17741c9adfff50a7d7663dd, user_id=f9b587e98790460c930e6eebc12ffecb, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:29.983788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:30.033435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.033729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.034488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.037447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1937/3901] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:29 2022] PUT /identity/v3/projects/299b146df17741c9adfff50a7d7663dd/users/f9b587e98790460c930e6eebc12ffecb/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:30.073796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] MFA Rules not processed for user `f9b587e98790460c930e6eebc12ffecb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:30.075312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:30.247445 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1965/3902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:30.252950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:30.273455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c47b1-5569-4ffb-afab-deeb166f17d7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:30.289108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:30.290195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.290618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.291054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.291960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:30.294616 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:30.294616 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:30.294616 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:30.296823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:30.345614 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1938/3903] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/domains => generated 277 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:30.345985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:30.367229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc6fda-f950-41eb-8329-68016fa0b90a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:30.481363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:30.618419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:30.619588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.619885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.620167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.621414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:30.623500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b397a-5a26-46bb-ba02-bde6412662ce tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:30.706427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1966/3904] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/projects => generated 403 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:30.711532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:30.732493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826439-8dbc-4b67-a886-2b3a2f971785 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:30.839943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.840159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.840423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.880741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:30.881538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.881696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.882416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.883647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:30.884689 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:30.884689 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:30.884689 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:30.889186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:30.939569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1939/3905] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/groups => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:30.943883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:30.945809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:30.954501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:30.959499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:30.970314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd10e89-6ad6-4f50-b965-edef9266d7ef tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:30.970899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1967/3906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 21:03:30.978931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:30.981454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:30.994466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:30.995214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:30.995501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:30.995799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:30.996514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:31.002130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:31.081263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1940/3907] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/users => generated 442 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:31.085646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:31.116507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390adbc-c4e5-444b-af42-9aeb58b3dfa1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.154429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.160581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.161282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.161282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:31.167125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:31.175435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:31.247639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1941/3908] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:31 2022] POST /identity/v3/roles => generated 239 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:31.248204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:31.319967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623b0e-c2b3-4004-985b-e2249d47ada0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.338635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699e72d-df2d-48d6-b5b5-ed90531168cb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.345319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.345867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.347238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.347933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:31.359807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.372205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.372709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.373008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:31.387585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=b410a52d39b9457db2e9e668f8654e01)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:31.402467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:31.466704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1942/3909] 10.222.0.18 () {60 vars in 1584 bytes} [Sat Jun 4 21:03:31 2022] PUT /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:31.469118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:31.486902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:31.513042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1968/3910] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:30 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:31.650444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f87c4-52c8-4c47-9787-d6a8345fe413 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.667106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.668018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.668305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.668589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:31.677870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:check_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=b410a52d39b9457db2e9e668f8654e01)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:31.678964 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:31.678964 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:31.678964 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:31.681606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:31.703193 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1943/3911] 10.222.0.18 () {58 vars in 1566 bytes} [Sat Jun 4 21:03:31 2022] HEAD /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:31.707546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:31.726273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0a77-04e4-4b5e-bbf1-19d2b19a65d6 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.739236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.740447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.740908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.741356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:31.746173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=b410a52d39b9457db2e9e668f8654e01)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:31.753305 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:31.753305 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:31.753305 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:31.756334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:31.775007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role b410a52d39b9457db2e9e668f8654e01 was removed from group 4af4094d1347476b87c3af60da9c34ca on project 05ec88f103d94cd98e1ddc9d5a801c7b. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:31.775997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:31.777577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:31.815060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1969/3912] 10.222.0.18 () {58 vars in 1568 bytes} [Sat Jun 4 21:03:31 2022] DELETE /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/groups/4af4094d1347476b87c3af60da9c34ca/roles/b410a52d39b9457db2e9e668f8654e01/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:31.815618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:31.817675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:31.840494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6106d-c5e0-407b-aeb6-699fd54a2b1f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:31.992801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:31.993690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:31.993975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:31.994274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/b410a52d39b9457db2e9e668f8654e01` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.003210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b410a52d39b9457db2e9e668f8654e01)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:32.005494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:32.108088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role b410a52d39b9457db2e9e668f8654e01 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:32.108438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:32.112328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:32.120007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1944/3913] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:31 2022] DELETE /identity/v3/roles/b410a52d39b9457db2e9e668f8654e01 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:32.124959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:32.153771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6528f-8888-47dc-a38c-dfb6becb4d70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:32.223976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:32.430846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:32.434200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.434608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.435086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.449155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:32.451181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b3c19-a884-4176-8658-7ece9bebdd66 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:32.499566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1970/3914] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:32 2022] POST /identity/v3/roles => generated 239 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:32.500886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:32.502667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:32.517518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbeaa0-dcb3-4b47-bd3f-005e09eaaa3a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.517791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbeaa0-dcb3-4b47-bd3f-005e09eaaa3a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.518103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbeaa0-dcb3-4b47-bd3f-005e09eaaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.555877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97deef-8206-4690-99ff-6f84e97d0d26 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:32.568565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:32.569185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.569472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.569757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.570742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-82bbeaa0-dcb3-4b47-bd3f-005e09eaaa3a None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:32.572655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-82bbeaa0-dcb3-4b47-bd3f-005e09eaaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:32.585571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1971/3915] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:32 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:32.591124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4599bc-580c-4436-8160-19485c08ce79 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.591475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4599bc-580c-4436-8160-19485c08ce79 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.591708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4599bc-580c-4436-8160-19485c08ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.602763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed4599bc-580c-4436-8160-19485c08ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:32.640586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=1b7d507f3593457590278e5c8f835e1d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:32.656902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:32.664231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:32.688631 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1945/3916] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Jun 4 21:03:32 2022] PUT /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:32.695554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ed4599bc-580c-4436-8160-19485c08ce79 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jun 04 21:03:32.926452 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:32.928014 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:03:32.929082 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:03:32.931937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0941ce-d7ed-4cbe-bd52-dd71d34c5085 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:32.935953 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1972/3917] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:32 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 21:03:32.938987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73f23e-e105-483b-a91c-bef7a13d51b7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.939268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73f23e-e105-483b-a91c-bef7a13d51b7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.939527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73f23e-e105-483b-a91c-bef7a13d51b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.943057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:32.944108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:32.944523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:32.945041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:32.948634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:check_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=1b7d507f3593457590278e5c8f835e1d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:32.953242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:32.975917 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1946/3918] 10.222.0.18 () {58 vars in 1563 bytes} [Sat Jun 4 21:03:32 2022] HEAD /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:32.979903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:33.005432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145eedc-1768-4d52-8ae8-3262889e4be8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:33.020988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:33.022160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:33.022446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:33.022723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:33.036691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=1b7d507f3593457590278e5c8f835e1d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:33.038479 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:33.038479 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:33.038479 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:33.040657 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.application [None req-8a73f23e-e105-483b-a91c-bef7a13d51b7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:03:33.041969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:33.042965 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1973/3919] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:32 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 106 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 04 21:03:33.047382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:33.047821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:33.048381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:33.068733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 1b7d507f3593457590278e5c8f835e1d was removed from user b7e00727be484ca89cdaabf3170b3f91 on project 05ec88f103d94cd98e1ddc9d5a801c7b. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:33.069020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:33.069792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:33.092361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1947/3920] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Jun 4 21:03:32 2022] DELETE /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/1b7d507f3593457590278e5c8f835e1d/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:33.096651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:33.104897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:33.178412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:33.180782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:33.421387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1974/3921] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:33.447659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:33.485758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e078f6-44b8-40d4-983f-dc06485353c2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:33.504899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:33.505812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:33.510316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:33.511007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:33.538490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cc23-15c7-49d3-9808-71f71fd3c0bd tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:33.556146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:33.557208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:33.557501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:33.557878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/1b7d507f3593457590278e5c8f835e1d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:33.561177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b7d507f3593457590278e5c8f835e1d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:33.562832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:33.678718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 1b7d507f3593457590278e5c8f835e1d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:33.679355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:33.680717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:33.688342 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1948/3922] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:33 2022] DELETE /identity/v3/roles/1b7d507f3593457590278e5c8f835e1d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:33.693895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:33.696152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:33.697913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:33.706611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=3,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:33.728123 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1975/3923] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:33 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:33.850764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:33.947584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56993b-94bc-4fec-af15-78751ed09482 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:33.963583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:33.964217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:33.975280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:33.975709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:33.976544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:33.978207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:34.069534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1949/3924] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:33 2022] POST /identity/v3/roles => generated 240 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:34.074188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:34.094183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441ad4f-a4ee-4b96-b6bd-947a59d26f24 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:34.119111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:34.120962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.121521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.122200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.134931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8eb9b21f32114079ab56c5795044678f, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=edea726e3124435c9e9eeb8a76976715)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:34.138431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:34.178795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1976/3925] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Jun 4 21:03:34 2022] PUT /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:34.184212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:34.202588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d99e-06e6-4a8e-a19b-7389e1351939 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:34.415865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:34.417397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.417612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.417902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.423571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8eb9b21f32114079ab56c5795044678f, group_id=4af4094d1347476b87c3af60da9c34ca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:34.425201 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:34.425201 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:34.425201 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:34.429225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:34.496144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1950/3926] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Jun 4 21:03:34 2022] GET /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/inherited_to_projects => generated 448 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:34.497347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:34.520873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae9e28-27ec-43d7-8550-b2b479a96c39 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:34.541227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:34.544743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.545245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.545539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.558708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8eb9b21f32114079ab56c5795044678f, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=edea726e3124435c9e9eeb8a76976715)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:34.561039 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:34.561039 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:34.561039 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:34.568049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:34.582335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1977/3927] 10.222.0.18 () {58 vars in 1563 bytes} [Sat Jun 4 21:03:34 2022] HEAD /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:34.586797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:34.606350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b734-a5ab-4cdd-a551-077cef8032da tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:34.629478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:34.630816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.631274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.631761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.640452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8eb9b21f32114079ab56c5795044678f, group_id=4af4094d1347476b87c3af60da9c34ca, role_id=edea726e3124435c9e9eeb8a76976715)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:34.643937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:34.688371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role edea726e3124435c9e9eeb8a76976715 was removed from group 4af4094d1347476b87c3af60da9c34ca on domain 8eb9b21f32114079ab56c5795044678f. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:34.688644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:34.691403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c34e69e-6ea5-4359-b4f1-8d1704851a70 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:34.727191 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1951/3928] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Jun 4 21:03:34 2022] DELETE /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/groups/4af4094d1347476b87c3af60da9c34ca/roles/edea726e3124435c9e9eeb8a76976715/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:34.736742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:34.739623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:34.742318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827b-aaaa-4fc8-9b03-6cab1f1b10a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.743276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827b-aaaa-4fc8-9b03-6cab1f1b10a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.743580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a827b-aaaa-4fc8-9b03-6cab1f1b10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.781205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9651-0898-4327-a840-3df1e747acb8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:34.815464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-132a827b-aaaa-4fc8-9b03-6cab1f1b10a6 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:34.816871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-132a827b-aaaa-4fc8-9b03-6cab1f1b10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:34.842298 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1952/3929] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:34 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:34.851334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.851837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.854355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.906749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:34.909873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:34.970526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:34.971961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:34.972513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:34.973069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/edea726e3124435c9e9eeb8a76976715` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:34.977235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=edea726e3124435c9e9eeb8a76976715)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:34.981324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.077302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1953/3930] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:35.078809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.090650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role edea726e3124435c9e9eeb8a76976715 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:35.091358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:35.093500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:35.098446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667c08d-dfbd-470c-96d6-53ffeaba6ad5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.099688 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1978/3931] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:34 2022] DELETE /identity/v3/roles/edea726e3124435c9e9eeb8a76976715 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:35.106069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.109447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:35.253072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:35.287674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.289600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.289889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.290227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.321753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088691e1-781a-4bf4-a0cc-aca0d07ed7d7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.339723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.341633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.351440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.352583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.356885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:35.363761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.424785 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1979/3932] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:35 2022] POST /identity/v3/roles => generated 239 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:35.433283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.470563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:35.477201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30162a41-db40-49d5-b58b-31a34091f27a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.500569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1954/3933] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:35 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:35.501910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.503640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.504390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.504878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.508117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=6e5c19e200f541edb266891008442166)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:35.512537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.533629 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1980/3934] 10.222.0.18 () {60 vars in 1578 bytes} [Sat Jun 4 21:03:35 2022] PUT /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:35.539342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.569956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64a5f6-6711-4f16-ac6a-b4dc347d1f15 tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.774006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.774930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.775247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.775564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.781564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:35.784308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.811275 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1955/3935] 10.222.0.18 () {58 vars in 1460 bytes} [Sat Jun 4 21:03:35 2022] GET /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/inherited_to_projects => generated 446 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:35.815759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.845073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb3b94-80b4-4812-ae21-1179a9c7e991 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.870625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.871544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.871918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.872273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.880916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=6e5c19e200f541edb266891008442166)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:35.885709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.910553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1981/3936] 10.222.0.18 () {58 vars in 1560 bytes} [Sat Jun 4 21:03:35 2022] HEAD /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:35.915182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:35.931611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500cb5-db52-4c09-9b5b-776d9d74b54f tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:35.940752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:35.941870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:35.942309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:35.942609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:35.954275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=6e5c19e200f541edb266891008442166)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:35.957453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:35.973998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 6e5c19e200f541edb266891008442166 was removed from user b7e00727be484ca89cdaabf3170b3f91 on domain 8eb9b21f32114079ab56c5795044678f. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:35.974301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:35.975111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:36.002130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1956/3937] 10.222.0.18 () {58 vars in 1562 bytes} [Sat Jun 4 21:03:35 2022] DELETE /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/6e5c19e200f541edb266891008442166/inherited_to_projects => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:36.010434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:36.013203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:36.042120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f1d-39a4-4ae9-ad25-d82b2ebf5bd7 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:36.086698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:36.201461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:36.202668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.203999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.204474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/6e5c19e200f541edb266891008442166` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.206344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6e5c19e200f541edb266891008442166)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:36.208826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:36.267144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 6e5c19e200f541edb266891008442166 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:36.268828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:36.268828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:36.275179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1982/3938] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:36 2022] DELETE /identity/v3/roles/6e5c19e200f541edb266891008442166 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:36.276369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:36.292693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5781-15ae-4943-9277-65353ded2131 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:36.441102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:36.442087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.442575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.442829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.443791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:36.448074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81e18a-6a71-4c86-809c-aa5f52e71995 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:36.469243 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1957/3939] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:36 2022] POST /identity/v3/roles => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:36.473962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:36.476304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:36.511614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e285d-7016-4c24-b2dc-b89a909acc69 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.511960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e285d-7016-4c24-b2dc-b89a909acc69 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.512293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e285d-7016-4c24-b2dc-b89a909acc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.518331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030127af-6b7b-4f1a-88bc-20482c3e4631 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:36.540844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:36.542527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.542887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.543094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.545569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:36.549082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:36.553860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-519e285d-7016-4c24-b2dc-b89a909acc69 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:36.555097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-519e285d-7016-4c24-b2dc-b89a909acc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:36.579672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1958/3940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:36.590033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.590345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.590628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.648908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1983/3941] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:36 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:36.653754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:36.665429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:36.674173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:36.748744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:36.849856 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1959/3942] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:36.852482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:36.869889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bbe4f-b231-4404-8a90-f80c3e01db7a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:36.879223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4768-a331-4fd8-9bdf-e2ee11f5f2e8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:36.885906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:36.887324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.887654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.892473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/0d5fb9eedcfa40c1b623cab6b6c1228d/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.898250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b9453a69154f7a9e6635a433b31f8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07d81d99e089418089ccb9769a482fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:36.899186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:36.901257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=0d5fb9eedcfa40c1b623cab6b6c1228d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:36.901826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:36.903551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:36.912565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:36.946550 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1984/3943] 10.222.0.18 () {60 vars in 1578 bytes} [Sat Jun 4 21:03:36 2022] PUT /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/0d5fb9eedcfa40c1b623cab6b6c1228d/inherited_to_projects => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:36.948637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.054795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:37.079577 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1960/3944] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:03:36 2022] POST /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c/password => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:37.131033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:37.166908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a29b7-eb03-464c-8499-24911a04b4cb tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:37.174006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:37.177413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:37.178387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:37.178954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:37.180196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=05ec88f103d94cd98e1ddc9d5a801c7b, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:37.180727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:37.182044 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:37.182044 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:37.182044 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:37.184063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:37.283568 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1985/3945] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:36 2022] GET /identity/v3/role_assignments?scope.project.id=05ec88f103d94cd98e1ddc9d5a801c7b&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 648 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:37.289889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.318371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a38a-1e62-4e0c-a1cd-8be1c30c33de tempest-IdentityV3UsersTest-403815291 tempest-IdentityV3UsersTest-403815291-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:37.324158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:37.325992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:37.326369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:37.328599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:37.330480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=c9ce1f4ed6564f49997c3ae688658c39, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:37.330888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:37.333716 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:37.333716 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:37.333716 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:37.339766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:37.468894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.480929 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1961/3946] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:37 2022] GET /identity/v3/role_assignments?scope.project.id=c9ce1f4ed6564f49997c3ae688658c39&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 648 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:37.485447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d716528-3450-42cd-ade4-5e15242ce54e tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:37.494536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:37.495471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:37.495808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:37.496153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/0d5fb9eedcfa40c1b623cab6b6c1228d/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:37.498467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8eb9b21f32114079ab56c5795044678f, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=0d5fb9eedcfa40c1b623cab6b6c1228d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:37.501349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:37.512793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 0d5fb9eedcfa40c1b623cab6b6c1228d was removed from user b7e00727be484ca89cdaabf3170b3f91 on domain 8eb9b21f32114079ab56c5795044678f. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:37.513490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:37.516156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:37.546397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1986/3947] 10.222.0.18 () {58 vars in 1562 bytes} [Sat Jun 4 21:03:37 2022] DELETE /identity/v3/OS-INHERIT/domains/8eb9b21f32114079ab56c5795044678f/users/b7e00727be484ca89cdaabf3170b3f91/roles/0d5fb9eedcfa40c1b623cab6b6c1228d/inherited_to_projects => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:37.551927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.553472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:37.578726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929dd4-784d-42c2-9d43-ff2f24d472c6 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:37.755925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:37.756903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:37.757198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:37.757477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:37.758328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=05ec88f103d94cd98e1ddc9d5a801c7b, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:37.758733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:37.760836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:37.835682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1962/3948] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:37 2022] GET /identity/v3/role_assignments?scope.project.id=05ec88f103d94cd98e1ddc9d5a801c7b&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 228 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:37.839896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.862328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7499b5-8f47-40f2-87c6-e4aaaf753859 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:37.873842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:37.877391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:37.877906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:37.878355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:37.879634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=c9ce1f4ed6564f49997c3ae688658c39, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:37.880301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:37.889728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19311a94-e80a-44ef-9514-89a2236c5d73 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:37.967367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1987/3949] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:37 2022] GET /identity/v3/role_assignments?scope.project.id=c9ce1f4ed6564f49997c3ae688658c39&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 228 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:37.971302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:37.981859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:37.998719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224f95f-7acf-4047-8c64-ff13a9b7b8aa tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:38.014317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:38.015458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.016110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.016856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects/c9ce1f4ed6564f49997c3ae688658c39` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:38.018957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c9ce1f4ed6564f49997c3ae688658c39)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:38.022793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:38.086355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.086355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.087094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:38.128298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:38.130586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:38.132370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ce1f4ed6564f49997c3ae688658c39', 'request_id': 'req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.139045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1988/3950] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:38 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 21:03:38.142526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ce1f4ed6564f49997c3ae688658c39', 'request_id': 'req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.159452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ce1f4ed6564f49997c3ae688658c39', 'request_id': 'req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.188434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] The token cache is being invalidate because project c9ce1f4ed6564f49997c3ae688658c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:38.189306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.191485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.199800 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1963/3951] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:37 2022] DELETE /identity/v3/projects/c9ce1f4ed6564f49997c3ae688658c39 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:38.200258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:38.321020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4941a-d6dc-485d-85f3-832b85a25f7c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:38.333272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:38.334483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.335703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.336547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/0d5fb9eedcfa40c1b623cab6b6c1228d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:38.340336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0d5fb9eedcfa40c1b623cab6b6c1228d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:38.390441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:38.437860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:38.468374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role 0d5fb9eedcfa40c1b623cab6b6c1228d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:38.469236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.470267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:38.473162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1989/3952] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:38 2022] DELETE /identity/v3/roles/0d5fb9eedcfa40c1b623cab6b6c1228d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:38.497262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:38.499254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:38.531374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c92fc-1015-419b-8f12-fedc8ff6a3b0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:38.631032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:38.637869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.638788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.639382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:38.640450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:38.642617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:38.695564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1964/3953] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:38 2022] POST /identity/v3/roles => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:38.709074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:38.712379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:38.736648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c669c-1003-416b-977d-64ace811fd15 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:38.751310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:38.752020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.752316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.752604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:38.753366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:38.755688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:38.823968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1990/3954] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:38 2022] POST /identity/v3/projects => generated 410 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:38.825525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:38.847663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65be6-4d7f-4ab1-940e-9820005b8934 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:38.995757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:38.996816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:38.997202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:38.997626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/d2c2d3e24da749d9b1417568834ebded/inherited_to_projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.002343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:create_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=d2c2d3e24da749d9b1417568834ebded)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:39.005618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e662f6-8e5b-4d5e-9592-c7bbf9a18fc0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:39.037911 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1965/3955] 10.222.0.18 () {60 vars in 1581 bytes} [Sat Jun 4 21:03:38 2022] PUT /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/d2c2d3e24da749d9b1417568834ebded/inherited_to_projects => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:39.040189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:39.051158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7d7-c10d-4c5f-bee1-07783e347da8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:39.142046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.142726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.143976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.194630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] MFA Rules not processed for user `c2b9453a69154f7a9e6635a433b31f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:39.200080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:39.203457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:39.206165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.206982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.207463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.208515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=b6b5cbce5a2345158c48ea4ac43ae1ed, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:39.208833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:39.211927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:39.226173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:39.369228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1966/3956] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:39.382836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:39.383239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:39.385701 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1991/3957] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:39 2022] GET /identity/v3/role_assignments?scope.project.id=b6b5cbce5a2345158c48ea4ac43ae1ed&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 649 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:39.389203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:39.405739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976dc88-1b6a-425c-aab4-d14433093618 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:39.414988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:39.420439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.420999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.421477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/d2c2d3e24da749d9b1417568834ebded/inherited_to_projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.429324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=05ec88f103d94cd98e1ddc9d5a801c7b, user_id=b7e00727be484ca89cdaabf3170b3f91, role_id=d2c2d3e24da749d9b1417568834ebded)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:39.434332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:39.450934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role d2c2d3e24da749d9b1417568834ebded was removed from user b7e00727be484ca89cdaabf3170b3f91 on project 05ec88f103d94cd98e1ddc9d5a801c7b. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:39.451779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.455502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.513424 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1992/3958] 10.222.0.18 () {58 vars in 1565 bytes} [Sat Jun 4 21:03:39 2022] DELETE /identity/v3/OS-INHERIT/projects/05ec88f103d94cd98e1ddc9d5a801c7b/users/b7e00727be484ca89cdaabf3170b3f91/roles/d2c2d3e24da749d9b1417568834ebded/inherited_to_projects => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:39.517932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:39.520862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:39.529612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec4f50-4d4a-4625-8234-1eb4b64dce37 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:39.747599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:39.748755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfc2d2-f638-4857-859a-3675a8af8cf8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:39.749277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.749545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.749898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] PATH_INFO: `/v3/users/c2b9453a69154f7a9e6635a433b31f8c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.751405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b9453a69154f7a9e6635a433b31f8c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:39.753798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:39.775298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:39.776012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.776346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.776714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.781269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Adding query filter params (scope.project.id=b6b5cbce5a2345158c48ea4ac43ae1ed, user.id=b7e00727be484ca89cdaabf3170b3f91) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:39.782218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:39.789290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:39.804297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:39.860713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.864781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.882568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.884684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.912176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:39.919367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44066d66-8427-4de1-80e2-95dfd03bf25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b9453a69154f7a9e6635a433b31f8c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:39.922334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1993/3959] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:39 2022] GET /identity/v3/role_assignments?scope.project.id=b6b5cbce5a2345158c48ea4ac43ae1ed&user.id=b7e00727be484ca89cdaabf3170b3f91&effective => generated 228 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:39.928810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:39.932754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:39.955564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1967/3960] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:39 2022] DELETE /identity/v3/users/c2b9453a69154f7a9e6635a433b31f8c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:39.962709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:39.963272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:39.963906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:39.964331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3573a-2980-4a13-b659-73b6cee618a4 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:39.988237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:39.990437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:40.097755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:40.098986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:40.099329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:40.100241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects/b6b5cbce5a2345158c48ea4ac43ae1ed` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:40.101804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6b5cbce5a2345158c48ea4ac43ae1ed)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:40.104141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:40.123621 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1968/3961] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:40.138460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:40.141145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:40.223630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b5cbce5a2345158c48ea4ac43ae1ed', 'request_id': 'req-7ce2c597-8071-42c7-b1d3-3c698196dbd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.246422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b5cbce5a2345158c48ea4ac43ae1ed', 'request_id': 'req-7ce2c597-8071-42c7-b1d3-3c698196dbd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.255972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b5cbce5a2345158c48ea4ac43ae1ed', 'request_id': 'req-7ce2c597-8071-42c7-b1d3-3c698196dbd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.319728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] The token cache is being invalidate because project b6b5cbce5a2345158c48ea4ac43ae1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:40.320088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.321614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.324082 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1994/3962] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:39 2022] DELETE /identity/v3/projects/b6b5cbce5a2345158c48ea4ac43ae1ed => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:40.333066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335e683-73ee-4400-b5f1-5e2d1406bfa7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:40.334303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:40.345199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:40.486234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:40.488013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:40.500182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:40.512401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:40.515047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:40.525869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2c597-8071-42c7-b1d3-3c698196dbd8 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:40.527785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:40.533299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:40.537984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:40.537984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:40.537984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/roles/d2c2d3e24da749d9b1417568834ebded` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:40.537984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d2c2d3e24da749d9b1417568834ebded)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:40.540982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:40.607490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invalidating the token cache because role d2c2d3e24da749d9b1417568834ebded has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:40.607913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.608878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.611027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1995/3963] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:40 2022] DELETE /identity/v3/roles/d2c2d3e24da749d9b1417568834ebded => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:40.619135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:40.622092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:40.660910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:40.667267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:40.669570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:40.699756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1969/3964] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:40.773827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721c34-2b22-44b4-8958-27f7d9cfe42d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:40.779464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:40.780807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:40.781744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:40.782539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/users/b7e00727be484ca89cdaabf3170b3f91` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:40.785139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b7e00727be484ca89cdaabf3170b3f91)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:40.787824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:40.862115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e00727be484ca89cdaabf3170b3f91'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.874054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e00727be484ca89cdaabf3170b3f91'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.875683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e00727be484ca89cdaabf3170b3f91'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.876630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e00727be484ca89cdaabf3170b3f91'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.893377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e00727be484ca89cdaabf3170b3f91'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:40.919564 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1996/3965] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:40 2022] DELETE /identity/v3/users/b7e00727be484ca89cdaabf3170b3f91 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:40.921194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:40.940225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3540-a2a6-43d2-a631-85ee3aad80b1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:41.149817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:41.151014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:41.151286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:41.151650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/groups/4af4094d1347476b87c3af60da9c34ca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:41.162564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4af4094d1347476b87c3af60da9c34ca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:41.162564 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:41.162564 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:41.162564 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:41.163780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:41.364684 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1970/3966] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:03:40 2022] DELETE /identity/v3/groups/4af4094d1347476b87c3af60da9c34ca => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:41.365608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:41.367256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:41.369596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:41.371706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:41.495757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:41.558500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573fefa-24f7-4961-923c-2f19c5304dd1 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:41.563758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:41.564991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:41.565295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:41.565581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/projects/05ec88f103d94cd98e1ddc9d5a801c7b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:41.567438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05ec88f103d94cd98e1ddc9d5a801c7b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:41.571643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:41.579473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cbc0e-a173-4a26-accd-ee998bcbeb8a tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:41.654049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ec88f103d94cd98e1ddc9d5a801c7b', 'request_id': 'req-0eb3faeb-02a4-4eeb-8158-d480a810da4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.663354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ec88f103d94cd98e1ddc9d5a801c7b', 'request_id': 'req-0eb3faeb-02a4-4eeb-8158-d480a810da4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.665821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:41.673081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ec88f103d94cd98e1ddc9d5a801c7b', 'request_id': 'req-0eb3faeb-02a4-4eeb-8158-d480a810da4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.704225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] The token cache is being invalidate because project 05ec88f103d94cd98e1ddc9d5a801c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:41.708950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.710518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.719340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1971/3967] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:41 2022] DELETE /identity/v3/projects/05ec88f103d94cd98e1ddc9d5a801c7b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:41.720899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:41.728361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:41.736152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:41.738271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:41.746145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:41.746637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] PATH_INFO: `/v3/projects/07d81d99e089418089ccb9769a482fd5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:41.750215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d81d99e089418089ccb9769a482fd5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:41.755423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:41.862067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d81d99e089418089ccb9769a482fd5', 'request_id': 'req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.879663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d81d99e089418089ccb9769a482fd5', 'request_id': 'req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.887416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d81d99e089418089ccb9769a482fd5', 'request_id': 'req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.911552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] The token cache is being invalidate because project 07d81d99e089418089ccb9769a482fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:41.912118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.913355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fd698a0-6b53-41f7-aa56-1e2451b6d6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:41.916073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1997/3968] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:41 2022] DELETE /identity/v3/projects/07d81d99e089418089ccb9769a482fd5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:41.924556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092183e0-e092-47e8-9cf3-9f6c4282bf04 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:41.925131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092183e0-e092-47e8-9cf3-9f6c4282bf04 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:41.925687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092183e0-e092-47e8-9cf3-9f6c4282bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:41.960423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-092183e0-e092-47e8-9cf3-9f6c4282bf04 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:41.963115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-092183e0-e092-47e8-9cf3-9f6c4282bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:41.977008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3faeb-02a4-4eeb-8158-d480a810da4d tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.087105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1998/3969] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:42.098934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.105170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.105613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.148706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:42.150202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:42.165696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 1999/3970] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:42.171405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.178065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:42.183565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b590f-c065-4445-98e9-2a450e181e65 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.184542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.190118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.192411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.194730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/domains/8eb9b21f32114079ab56c5795044678f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.202966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.203690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.204574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.204862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.205751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:42.206136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.206341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8eb9b21f32114079ab56c5795044678f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.207909 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:42.207909 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:42.207909 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:42.208174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.211737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.227330 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2000/3971] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:42.228244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.244878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c028-be6b-42ca-8678-2d9c6d61b5cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.283225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.283999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.284298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.284516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.285253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.285409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.287219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.287357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.353140 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2001/3972] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:42 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:42.357014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.361008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.361201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.363872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:42.370347 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1972/3973] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:03:41 2022] PATCH /identity/v3/domains/8eb9b21f32114079ab56c5795044678f => generated 278 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:42.375577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.379320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:42.476407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:42.485117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659a924-2c26-4a52-ae53-5455c25d6af0 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.504552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70dbc-e85c-47db-aad5-094994f8ac29 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.523373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.524135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.524431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.524721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.525418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.527581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.575343 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2002/3974] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:42 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:42.580801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.589298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b587e98790460c930e6eebc12ffecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '299b146df17741c9adfff50a7d7663dd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.591577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.591877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.592261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] PATH_INFO: `/v3/domains/8eb9b21f32114079ab56c5795044678f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.600872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044246e-c822-4d00-8d80-b9a6b07cc6ec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.617689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.618883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.619182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.619465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.620291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.624443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8eb9b21f32114079ab56c5795044678f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.625037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.625667 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:42.625667 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:42.625667 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:42.626597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.652800 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2003/3975] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:42.659399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.679217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d1c7d-1942-4617-85d1-5378c50bdc4f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:42.693121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:42.694184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:42.694493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:42.694950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] PATH_INFO: `/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740/users/27b248a255a14bdab285be561165c52a/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:42.706435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.732311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8eb9b21f32114079ab56c5795044678f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.739615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efc2342fbdc4ff2b50bafc7f8287740, user_id=27b248a255a14bdab285be561165c52a, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:42.742518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:42.771833 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2004/3976] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:42 2022] PUT /identity/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740/users/27b248a255a14bdab285be561165c52a/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:42.777258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:42.879550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:42.933874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354c22-fd2a-49f5-89df-270627b540da admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:43.046209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:43.048099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.088635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:43.089812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.090109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.090389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.092823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:43.095265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:43.110000 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2005/3977] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:43.120838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:43.132189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb1a4e-8de1-475d-899d-3212f67225ba admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:43.139839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:43.140401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.140616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.140897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.141173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] PATH_INFO: `/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740/users/27b248a255a14bdab285be561165c52a/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.143346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efc2342fbdc4ff2b50bafc7f8287740, user_id=27b248a255a14bdab285be561165c52a, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:43.147252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676c18-c132-47f0-8dab-65887906fade admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:43.178671 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2006/3978] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:43 2022] PUT /identity/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740/users/27b248a255a14bdab285be561165c52a/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:43.189786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.190192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.203697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.235327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] The token cache is being invalidate because project 8eb9b21f32114079ab56c5795044678f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:43.240612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.248388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.259700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] MFA Rules not processed for user `27b248a255a14bdab285be561165c52a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:43.260424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.295957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.332764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.333982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8eb9b21f32114079ab56c5795044678f', 'request_id': 'req-7bc36edc-c19b-41c6-b097-73e81bc74a33'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.351039 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1973/3979] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:03:42 2022] DELETE /identity/v3/domains/8eb9b21f32114079ab56c5795044678f => generated 0 bytes in 980 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:43.355370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:43.377666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.399649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36edc-c19b-41c6-b097-73e81bc74a33 tempest-InheritsV3TestJSON-1771550161 tempest-InheritsV3TestJSON-1771550161-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:43.475942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:43.498920 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2007/3980] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:43.502682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:43.503987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.504429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.504807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] PATH_INFO: `/v3/users/7c9ca659af1f4d73ba71aabf06f39dff` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.505831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:43.506371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9ca659af1f4d73ba71aabf06f39dff)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:43.508729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:43.508910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.559380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad17320-8680-40be-8c9f-d7a68a570bcd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:43.565501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:43.571362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.574971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.575906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.577066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:43.580391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:43.602597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9ca659af1f4d73ba71aabf06f39dff'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.603701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9ca659af1f4d73ba71aabf06f39dff'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.623335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9ca659af1f4d73ba71aabf06f39dff'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.624757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9ca659af1f4d73ba71aabf06f39dff'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.643974 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2008/3981] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:43 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:43.645960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6f2465ad-a65e-4949-bff0-9ac8fffe69d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9ca659af1f4d73ba71aabf06f39dff'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:43.648768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:43.650793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.679437 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1974/3982] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:43 2022] DELETE /identity/v3/users/7c9ca659af1f4d73ba71aabf06f39dff => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:43.684248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.684850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.685304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.731089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:43.735771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.825268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd53995-6d25-440b-b5dc-19100ac8812e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:43.879444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:43.894062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1975/3983] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:43.907068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:43.909234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:43.969284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:43.970161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:43.970566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:43.970943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:43.971779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:43.985711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.030154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2009/3984] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:43 2022] POST /identity/v3/users => generated 294 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:44.035298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.057143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb22caa-e7c8-4a0b-a278-6c0762ae303a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:44.057597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293306-5f3c-4070-bc42-32b6a01fe9ed admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:44.068169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:44.070264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.071193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.072004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:44.072808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.073893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.075281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.076702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.077589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:44.081521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.101227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:44.106746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.110418 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2010/3985] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:44.112354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.152139 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1976/3986] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:44.154917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b91d-be53-4aaa-84e3-856fb2e90a6e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:44.172623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:44.174889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.175198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.176259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.177701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:44.185307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46836-e990-421b-8b0e-c85c0109b918 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.206364 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2011/3987] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:44.207751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.213741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:44.222953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b7dd-8a64-401c-a349-485c6cfb7a56 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:44.252733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:44.252733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.252733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.252733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] PATH_INFO: `/v3/projects/ab205de5dcf04d20ac23b10cf73f1cb4/users/78671e49d20d4c3bbc16fc618da9fb8d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.280065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab205de5dcf04d20ac23b10cf73f1cb4, user_id=78671e49d20d4c3bbc16fc618da9fb8d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:44.284347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.320563 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1977/3988] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:44 2022] PUT /identity/v3/projects/ab205de5dcf04d20ac23b10cf73f1cb4/users/78671e49d20d4c3bbc16fc618da9fb8d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:44.322970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.323263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.324202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.392455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] MFA Rules not processed for user `78671e49d20d4c3bbc16fc618da9fb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:44.394144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:44.569215 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2012/3989] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:44.687654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.690123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:44.823123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc294-d61b-462f-b3fc-6cae92b0e22b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:44.832331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:44.833230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:44.833518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:44.833798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] PATH_INFO: `/v3/projects/e2bce96ac387446c96edb220946bb5ac` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:44.836289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bce96ac387446c96edb220946bb5ac)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:44.839062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:44.922349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bce96ac387446c96edb220946bb5ac', 'request_id': 'req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:44.933795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bce96ac387446c96edb220946bb5ac', 'request_id': 'req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:44.948732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bce96ac387446c96edb220946bb5ac', 'request_id': 'req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:44.966084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.967995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:44.968165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] The token cache is being invalidate because project e2bce96ac387446c96edb220946bb5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:44.968298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:44.968982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:44.973852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1978/3990] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:44 2022] DELETE /identity/v3/projects/e2bce96ac387446c96edb220946bb5ac => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:44.974946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:44.976762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:45.057060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e11b-c8de-4f70-b7db-8e8ae4a5af02 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:45.062435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:45.063480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:45.064264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:45.064566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] PATH_INFO: `/v3/users/f9b587e98790460c930e6eebc12ffecb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:45.067632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b587e98790460c930e6eebc12ffecb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:45.070188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:45.074170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b2dfb-d2d1-4b17-9f2d-296188f81870 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:45.090156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:45.103430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:45.136638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:45.137326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:45.137701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:45.138053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:45.139331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b587e98790460c930e6eebc12ffecb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:45.140166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:45.140346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b587e98790460c930e6eebc12ffecb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:45.150129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b587e98790460c930e6eebc12ffecb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:45.151133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b587e98790460c930e6eebc12ffecb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:45.166954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b587e98790460c930e6eebc12ffecb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:45.182554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1979/3991] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:44 2022] DELETE /identity/v3/users/f9b587e98790460c930e6eebc12ffecb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:45.228531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:45.230069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:45.242410 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2013/3992] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:46.045582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.047570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.102576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.114833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4fe3d-e3f8-40e8-9590-3d94534dd94f service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.120194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.121381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.121817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.122881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] PATH_INFO: `/v3/projects/299b146df17741c9adfff50a7d7663dd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.123876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915e1d3-5067-4063-af62-998c6b4677ac admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.124470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=299b146df17741c9adfff50a7d7663dd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.126421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.129462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.130254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.130537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.130829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] PATH_INFO: `/v3/users/27b248a255a14bdab285be561165c52a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.132266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b248a255a14bdab285be561165c52a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.135154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.201485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299b146df17741c9adfff50a7d7663dd', 'request_id': 'req-87c47696-ed15-47c8-b7c6-3b832a3c49ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.209452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299b146df17741c9adfff50a7d7663dd', 'request_id': 'req-87c47696-ed15-47c8-b7c6-3b832a3c49ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.216562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299b146df17741c9adfff50a7d7663dd', 'request_id': 'req-87c47696-ed15-47c8-b7c6-3b832a3c49ec'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.237062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b248a255a14bdab285be561165c52a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.238915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b248a255a14bdab285be561165c52a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.243891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] The token cache is being invalidate because project 299b146df17741c9adfff50a7d7663dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:46.244094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.245186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87c47696-ed15-47c8-b7c6-3b832a3c49ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.247969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2014/3993] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:46 2022] DELETE /identity/v3/projects/299b146df17741c9adfff50a7d7663dd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:46.253709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5cb64-7ca2-4fea-ae0c-13c4895be606 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.253992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5cb64-7ca2-4fea-ae0c-13c4895be606 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.254411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5cb64-7ca2-4fea-ae0c-13c4895be606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.260083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b248a255a14bdab285be561165c52a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.261303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b248a255a14bdab285be561165c52a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.290121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0215a830-8439-4c8d-841b-89b04326933a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b248a255a14bdab285be561165c52a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:46.290726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8cd5cb64-7ca2-4fea-ae0c-13c4895be606 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:46.294268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8cd5cb64-7ca2-4fea-ae0c-13c4895be606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.333460 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1980/3994] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:46 2022] DELETE /identity/v3/users/27b248a255a14bdab285be561165c52a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:46.339211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.339817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.340176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.363968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:46.374948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:46.376912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.417628 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2015/3995] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:46.427328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.427840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.428350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.439658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:46.457541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:46.459496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.485744 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1981/3996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:46.496050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.497373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.574042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2016/3997] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:46.578779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.588658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6c5a-aaa8-4772-9f7f-3588a14c88d7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.592094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfe6bb-d7f9-43e4-8353-14454e3c4da6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.593351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.594386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.594929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.595222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.598289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.599162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.599584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.600091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.601103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:46.602081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.605276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6e64-2e04-49de-be50-9cb7e67b3578 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.611161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.615335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.626196 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2017/3998] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:03:46.629097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1982/3999] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:46.630579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.638306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.642616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73ce7-9395-46f1-bcb3-e4135efd586d service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.643131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.643605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.649932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.650610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.650887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.652252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.652252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.654107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.674295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:46.679549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.709586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1983/4000] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:46.709586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.803986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2018/4001] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:46.819626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.822146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:46.826252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f4ce3-5ca5-4715-a1f9-b0163ec772a9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.837118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55757582-96cd-49d4-977b-991769059423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.837818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757582-96cd-49d4-977b-991769059423 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.840305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757582-96cd-49d4-977b-991769059423 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.840616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55757582-96cd-49d4-977b-991769059423 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.841335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757582-96cd-49d4-977b-991769059423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.843301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55757582-96cd-49d4-977b-991769059423 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.897841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1984/4002] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:46 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:46.899061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55757582-96cd-49d4-977b-991769059423 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.921811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55757582-96cd-49d4-977b-991769059423 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.935170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.935996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.937643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.938125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.939030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.943868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317a1d-1d9d-4aed-a1eb-9eff63e2562b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.945618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.967557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1985/4003] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:46.969988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:46.984704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a40c1-26c2-4e87-827c-66395c6317e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:46.989873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:46.993406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:46.994134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:46.994433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:46.994711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:46.995565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:46.997320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:46.999090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:47.019161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1986/4004] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:47.024858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.040803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ed37-b121-4a41-994c-3c51bdb89fc6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.048311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.049564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.050037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.051909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.052064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.052237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.052362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.052524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] PATH_INFO: `/v3/projects/2568d120c5974d379a8c77f8a8176b19/users/2cfca64ae4744cc6a1b698541815154f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.080633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2568d120c5974d379a8c77f8a8176b19, user_id=2cfca64ae4744cc6a1b698541815154f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.085387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a4f6-9159-41f3-bd0b-c754e9bbb16c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.117776 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1987/4005] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:47 2022] PUT /identity/v3/projects/2568d120c5974d379a8c77f8a8176b19/users/2cfca64ae4744cc6a1b698541815154f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:47.124763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.125113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.125563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.136642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.138282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.165063 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2019/4006] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:03:47.166259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.168971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:47.186546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ea45-8133-4a0c-b317-7c0e3fa766bb service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.212667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] MFA Rules not processed for user `2cfca64ae4744cc6a1b698541815154f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:47.215533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:47.331852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.332992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.338786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.340151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] PATH_INFO: `/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.342724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efc2342fbdc4ff2b50bafc7f8287740)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.347100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.372749 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1988/4007] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:47.380387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.402550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5f3f-e221-4a65-bfc9-3552e7fda401 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.413577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.414272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.414566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.414845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.417177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.421815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.489314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efc2342fbdc4ff2b50bafc7f8287740', 'request_id': 'req-264833e6-4277-4cf8-8028-0cd1ac073680'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.498598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efc2342fbdc4ff2b50bafc7f8287740', 'request_id': 'req-264833e6-4277-4cf8-8028-0cd1ac073680'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.507749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efc2342fbdc4ff2b50bafc7f8287740', 'request_id': 'req-264833e6-4277-4cf8-8028-0cd1ac073680'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.514049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1989/4008] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:47 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:47.515115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.532097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] The token cache is being invalidate because project 3efc2342fbdc4ff2b50bafc7f8287740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:47.532330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.533593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.535887 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2020/4009] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:47 2022] DELETE /identity/v3/projects/3efc2342fbdc4ff2b50bafc7f8287740 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:47.546236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.548551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:47.564078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:47.613478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20611afe-eae8-4520-a4c0-e987f964b983 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.622036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.623752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.624870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.624870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.625764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.629025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.658385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264833e6-4277-4cf8-8028-0cd1ac073680 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.665420 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1990/4010] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:47 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:47.670117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.671051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.672437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.672815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:47.673068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.673715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] PATH_INFO: `/v3/users/78671e49d20d4c3bbc16fc618da9fb8d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.675911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78671e49d20d4c3bbc16fc618da9fb8d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.678601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.687435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e422f-71c6-40dd-bd98-a4e92e4a36b6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.694985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.695718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.696007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.696330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.697076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.698742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.715179 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1991/4011] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:03:47.719958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.743522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c559-c43e-41bc-bbca-ebd74bb2922c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:47.756302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:47.757504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:47.759849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:47.760148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] PATH_INFO: `/v3/projects/eec27e0738b84918ae2b91dae638b8d2/users/c27fabfb0a2e4e33b19728c97f715549/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:47.785265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec27e0738b84918ae2b91dae638b8d2, user_id=c27fabfb0a2e4e33b19728c97f715549, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:47.788445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:47.789216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78671e49d20d4c3bbc16fc618da9fb8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.791211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:47.799375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78671e49d20d4c3bbc16fc618da9fb8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.800545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78671e49d20d4c3bbc16fc618da9fb8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.801215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78671e49d20d4c3bbc16fc618da9fb8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.817865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1992/4012] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:47 2022] PUT /identity/v3/projects/eec27e0738b84918ae2b91dae638b8d2/users/c27fabfb0a2e4e33b19728c97f715549/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:47.822841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:47.827191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:47.830397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b398809c-10e9-4b3e-9927-0ac38a301e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78671e49d20d4c3bbc16fc618da9fb8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:47.860402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2021/4013] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:47 2022] DELETE /identity/v3/users/78671e49d20d4c3bbc16fc618da9fb8d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:47.976561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e8934-b330-4bc3-8315-145ceb24248e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.038334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a613-22c2-4a14-a80b-f8ab5e67602f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.039049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a613-22c2-4a14-a80b-f8ab5e67602f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.039338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765a613-22c2-4a14-a80b-f8ab5e67602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.066705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5765a613-22c2-4a14-a80b-f8ab5e67602f None None] MFA Rules not processed for user `d96f5288364449e3af2f39c71a8c3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:48.069074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5765a613-22c2-4a14-a80b-f8ab5e67602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:48.077755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.078600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.078988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.079367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.080721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.083394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.100762 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1993/4014] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:48.106660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.129603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9e5d-ce2c-468d-81f1-2ee68773672c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.135352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.137379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.138382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.138880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] PATH_INFO: `/v3/projects/eec27e0738b84918ae2b91dae638b8d2/users/c27fabfb0a2e4e33b19728c97f715549/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.142800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec27e0738b84918ae2b91dae638b8d2, user_id=c27fabfb0a2e4e33b19728c97f715549, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.146879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.157971 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2022/4015] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:48.176686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1994/4016] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:48 2022] PUT /identity/v3/projects/eec27e0738b84918ae2b91dae638b8d2/users/c27fabfb0a2e4e33b19728c97f715549/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:48.178050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.180394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.180783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.244504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] MFA Rules not processed for user `c27fabfb0a2e4e33b19728c97f715549`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:48.246059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:48.262105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:48.356128 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2023/4017] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:48.357754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.358479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.360704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:48.392281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7541e1-4423-4229-b6fd-010588cae287 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.399883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.400751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.400917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.401115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.402308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.404031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.443451 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1995/4018] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/projects => generated 333 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:48.448497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.495868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effe626-2b55-41e8-b11e-2cbf1b37ba39 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.548358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1c58d-b3eb-434a-b6af-13635034df34 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.556512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.557447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.557786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.558108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.558892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.562135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.570898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:48.587943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.588956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.589466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.589589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] PATH_INFO: `/v3/projects/ab205de5dcf04d20ac23b10cf73f1cb4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.591092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab205de5dcf04d20ac23b10cf73f1cb4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.593496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.621874 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1996/4019] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/projects => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:48.623855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.670653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab205de5dcf04d20ac23b10cf73f1cb4', 'request_id': 'req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:48.680020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab205de5dcf04d20ac23b10cf73f1cb4', 'request_id': 'req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:48.686387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:48.689339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab205de5dcf04d20ac23b10cf73f1cb4', 'request_id': 'req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:48.718119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] The token cache is being invalidate because project ab205de5dcf04d20ac23b10cf73f1cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:48.719005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:48.720752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ebeb9e11-f33e-4d2a-8298-190b6a79d69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:48.722735 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2024/4020] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:48 2022] DELETE /identity/v3/projects/ab205de5dcf04d20ac23b10cf73f1cb4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:48.727980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38033064-baf9-4ddb-83a7-35e724b9e96b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:48.728967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9020b-ec5a-47ff-a1a2-132243d543e2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.729392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9020b-ec5a-47ff-a1a2-132243d543e2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.729959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9020b-ec5a-47ff-a1a2-132243d543e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.768365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c9e9020b-ec5a-47ff-a1a2-132243d543e2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:48.770046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9e9020b-ec5a-47ff-a1a2-132243d543e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:48.820230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:48.821044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.821543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.821907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.822920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:48.825345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:48.876130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2025/4021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:48.879458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:48.880027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:48.880465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:48.885357 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1997/4022] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/projects => generated 357 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:48.891355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:48.900384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:48.924218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:48.926784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:49.004226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553f376-e325-49ba-95d4-8947f1d0e311 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.009782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.010473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.010763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.011051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.012150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.015033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.040220 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1998/4023] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:03:48 2022] GET /identity/v3/projects => generated 7194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:49.045160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.059963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6ff25-6ca4-4437-bff0-34c5d6fdd1d9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.070043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.070791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.071028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.071310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.073607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:49.074652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.076678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2026/4024] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:49.082746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.084385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.090743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:49.104986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5512a-7ec0-40c1-9c74-50a73c39019f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.117556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.118308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.118594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.118897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.119696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:49.120016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.121855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.124930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 1999/4025] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:03:49 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:49.127106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.141589 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2027/4026] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:49.142476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627367fc-97c5-4ef8-be82-fbb33bdd7035 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.146981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.150671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.151460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.151767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.151996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.156564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Adding query filter params (parent_id=f355d8f2e9ff4cfc841d5e97b2378e85) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:49.157939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.159187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162ba53-c1a6-46eb-a262-4c0e9e57c607 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.162834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.166854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.182957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.183527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.183838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.184773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.187329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.208728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2000/4027] 10.222.0.18 () {58 vars in 1215 bytes} [Sat Jun 4 21:03:49 2022] GET /identity/v3/projects?parent_id=f355d8f2e9ff4cfc841d5e97b2378e85 => generated 497 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:49.218834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.243957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2028/4028] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:49 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:49.246125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2408-134d-4f07-b92d-fa629d345b2c tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.251936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.375070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.376928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.377310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.377685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects/3c80d76db0d34831a7a388c24696d54d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.379896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c80d76db0d34831a7a388c24696d54d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.382364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.389042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:49.410374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e62687-c7c9-40e6-a790-594d6c2fc651 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.419304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.420621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.422751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.423398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.425836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.428274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.472796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2029/4029] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:49 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:49.476016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.500286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775372ce-8c40-4a40-98a9-72d2b8c14837 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.509251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c80d76db0d34831a7a388c24696d54d', 'request_id': 'req-1e56a8da-6b43-42e1-ace8-a9244b8084a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.520748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c80d76db0d34831a7a388c24696d54d', 'request_id': 'req-1e56a8da-6b43-42e1-ace8-a9244b8084a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.530646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c80d76db0d34831a7a388c24696d54d', 'request_id': 'req-1e56a8da-6b43-42e1-ace8-a9244b8084a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.557739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] The token cache is being invalidate because project 3c80d76db0d34831a7a388c24696d54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:49.560448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.562385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.572038 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2001/4030] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:49 2022] DELETE /identity/v3/projects/3c80d76db0d34831a7a388c24696d54d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:49.573820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.576458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:49.603879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.604960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.605246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.605527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.606267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.608368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.623096 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2030/4031] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:49.624523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.626402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:49.644300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e50fb-9ad9-41f4-8ea5-6ade361f0061 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.652055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.653162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.653540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.653917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] PATH_INFO: `/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96/users/2a3ad9ad808d4493b987bf513cfc2b77/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.668444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56a8da-6b43-42e1-ace8-a9244b8084a9 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.673862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.674821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.675088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.675538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects/f355d8f2e9ff4cfc841d5e97b2378e85` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.676980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f355d8f2e9ff4cfc841d5e97b2378e85)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.678293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0adc0f4184a494ab0f32132a5d5dc96, user_id=2a3ad9ad808d4493b987bf513cfc2b77, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.679258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.681505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.692084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:49.700958 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2031/4032] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:49 2022] PUT /identity/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96/users/2a3ad9ad808d4493b987bf513cfc2b77/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:49.709356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.769711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f355d8f2e9ff4cfc841d5e97b2378e85', 'request_id': 'req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.778501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f355d8f2e9ff4cfc841d5e97b2378e85', 'request_id': 'req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.785568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f355d8f2e9ff4cfc841d5e97b2378e85', 'request_id': 'req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.806272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] The token cache is being invalidate because project f355d8f2e9ff4cfc841d5e97b2378e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:49.807115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.807900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:49.810129 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2002/4033] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:49 2022] DELETE /identity/v3/projects/f355d8f2e9ff4cfc841d5e97b2378e85 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:49.815384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.817600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:49.840545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb220e-9dec-49c0-8775-8f234656e573 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.905029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.905777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.905978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.906284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d823d1-a6a0-46b3-afe7-9b71d1a77bc0 tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.906421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.906985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.908961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.911416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:49.915247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27fabfb0a2e4e33b19728c97f715549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec27e0738b84918ae2b91dae638b8d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.916167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.916586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.916857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] PATH_INFO: `/v3/projects/f372b8c0c97947c9afa3c91e7676296f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.918793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f372b8c0c97947c9afa3c91e7676296f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.922056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.926871 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2032/4034] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:49.927795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:49.929594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:49.946810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddb1d6-d0ac-4db6-9659-20f7a32e8203 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:49.952084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:49.952982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:49.953943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:49.954232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] PATH_INFO: `/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96/users/2a3ad9ad808d4493b987bf513cfc2b77/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:49.956417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0adc0f4184a494ab0f32132a5d5dc96, user_id=2a3ad9ad808d4493b987bf513cfc2b77, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:49.959128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98b05f-0595-4201-8bb7-4b4a22d96f5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:49.993046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2033/4035] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:49 2022] PUT /identity/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96/users/2a3ad9ad808d4493b987bf513cfc2b77/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:49.994938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f372b8c0c97947c9afa3c91e7676296f', 'request_id': 'req-4eea7115-5427-4d5a-ab54-9026a8408a4b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.004055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f372b8c0c97947c9afa3c91e7676296f', 'request_id': 'req-4eea7115-5427-4d5a-ab54-9026a8408a4b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.004759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.005055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.005338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.011236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f372b8c0c97947c9afa3c91e7676296f', 'request_id': 'req-4eea7115-5427-4d5a-ab54-9026a8408a4b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.042037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] The token cache is being invalidate because project f372b8c0c97947c9afa3c91e7676296f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:50.042447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.046916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.047440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] MFA Rules not processed for user `2a3ad9ad808d4493b987bf513cfc2b77`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:50.048788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.052583 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2003/4036] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:49 2022] DELETE /identity/v3/projects/f372b8c0c97947c9afa3c91e7676296f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:50.056696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.059041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.100906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:50.142876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7115-5427-4d5a-ab54-9026a8408a4b tempest-ListProjectsTestJSON-266936076 tempest-ListProjectsTestJSON-266936076-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.155311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2034/4037] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:50.156407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.160532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.227689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.229145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.229534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.229869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] PATH_INFO: `/v3/users/2cfca64ae4744cc6a1b698541815154f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.232426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfca64ae4744cc6a1b698541815154f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.235784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.266659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7ef90-d819-4312-b718-ec7be6f60de6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.275076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.276052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.276308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.276619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.278990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.280470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.312823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfca64ae4744cc6a1b698541815154f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.313613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfca64ae4744cc6a1b698541815154f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.322048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2035/4038] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:50 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:50.326211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.335175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfca64ae4744cc6a1b698541815154f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.336253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfca64ae4744cc6a1b698541815154f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.343532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.357477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b41069-7ea0-49fb-8c3a-f42c62cf2cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfca64ae4744cc6a1b698541815154f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:50.387097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2004/4039] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:50 2022] DELETE /identity/v3/users/2cfca64ae4744cc6a1b698541815154f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:50.391880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.392422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.394199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.421785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:50.423281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.467037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:50.474616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921bd8f-3e95-4516-bc5c-b1ab49322638 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.502441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:50.527170 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2005/4040] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:50.540829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.544066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:50.597164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.598158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.598451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.598733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.600971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.604621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.656726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db31d6d-e3e7-456d-b5d5-443de8f652bf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.659804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2036/4041] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:50 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:50.664341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.666479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.668055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.668055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.668055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.683715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82c3a7-6e2a-4954-946e-9dff9ee4a83b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.686587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.689557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.690298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.691062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.691179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.691396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.692350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.694254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.715317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2006/4042] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:03:50.724576 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2037/4043] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:50.730077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.748253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910ff99-cb62-47db-99b1-c035f2a25ccf service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.760012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.761753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.762186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.762596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.767855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.769628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe4605-843c-46ea-abc0-96644e3afa4f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.811569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2007/4044] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:50.813721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:50.832179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221ab94-ab70-4d9d-94de-26768999ac9d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:50.851798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:50.854689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.855199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.855983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] PATH_INFO: `/v3/projects/a1baa9c03039429fadb07d654d0a8e28/users/f17adda40269404da4fde708abac760e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.883269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1baa9c03039429fadb07d654d0a8e28, user_id=f17adda40269404da4fde708abac760e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:50.887897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:50.918936 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2038/4045] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:50 2022] PUT /identity/v3/projects/a1baa9c03039429fadb07d654d0a8e28/users/f17adda40269404da4fde708abac760e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:50.932596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:50.932926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:50.933207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:50.964013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] MFA Rules not processed for user `f17adda40269404da4fde708abac760e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:50.965242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:51.044717 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2008/4046] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:51.054168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:51.056667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:51.163435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f21bad-f6f3-484b-9ade-4d29491efdec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:51.171083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:51.172051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:51.172543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:51.173720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:51.177541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:51.298778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:51.300692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:51.323634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:51.326817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:51.349803 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2039/4047] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:51.416235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aef5e-fe92-4189-8cb0-5140277ed4e9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:51.431101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:51.432368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:51.432855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:51.433302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] PATH_INFO: `/v3/projects/2568d120c5974d379a8c77f8a8176b19` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:51.435082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2568d120c5974d379a8c77f8a8176b19)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:51.437642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:51.486863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:51.532508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2568d120c5974d379a8c77f8a8176b19', 'request_id': 'req-34b55863-6298-4ab7-bb15-15ca26db09fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.543963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2568d120c5974d379a8c77f8a8176b19', 'request_id': 'req-34b55863-6298-4ab7-bb15-15ca26db09fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.554331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2568d120c5974d379a8c77f8a8176b19', 'request_id': 'req-34b55863-6298-4ab7-bb15-15ca26db09fe'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.585625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] The token cache is being invalidate because project 2568d120c5974d379a8c77f8a8176b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:51.585625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.587856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.590231 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2009/4048] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:51 2022] DELETE /identity/v3/projects/2568d120c5974d379a8c77f8a8176b19 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:51.594709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:51.612381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6ffb7-d2e1-4179-a1b9-633744ab6f99 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:51.620935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:51.699710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:51.700810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:51.701739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:51.702029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] PATH_INFO: `/v3/users/c27fabfb0a2e4e33b19728c97f715549` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:51.703295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27fabfb0a2e4e33b19728c97f715549)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:51.706189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:51.751470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:51.755816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:51.777273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55863-6298-4ab7-bb15-15ca26db09fe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:51.783577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:51.785179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:51.785840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:51.786322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] PATH_INFO: `/v3/users/2a3ad9ad808d4493b987bf513cfc2b77` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:51.787931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3ad9ad808d4493b987bf513cfc2b77)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:51.790503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:51.826325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27fabfb0a2e4e33b19728c97f715549'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.841299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27fabfb0a2e4e33b19728c97f715549'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.842443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27fabfb0a2e4e33b19728c97f715549'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.843645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27fabfb0a2e4e33b19728c97f715549'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.862535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dd8e9bd0-a241-4fa2-9ba0-9107a28e3a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27fabfb0a2e4e33b19728c97f715549'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.869610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3ad9ad808d4493b987bf513cfc2b77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.870674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3ad9ad808d4493b987bf513cfc2b77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.880453 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2040/4049] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:51 2022] DELETE /identity/v3/users/c27fabfb0a2e4e33b19728c97f715549 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:51.882253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3ad9ad808d4493b987bf513cfc2b77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.883261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3ad9ad808d4493b987bf513cfc2b77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.912504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3ad9ad808d4493b987bf513cfc2b77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:51.944677 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2010/4050] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:51 2022] DELETE /identity/v3/users/2a3ad9ad808d4493b987bf513cfc2b77 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:51.949953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:51.950223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:51.950506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:51.997917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:51.999239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.123721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2041/4051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:52.145210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:52.151950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.293760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc60568-d2dd-4545-a58d-ee90b9175156 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:52.298255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:52.298938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.299499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.299499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.314280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:52.315540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712558f8-2fcf-446c-a077-f728745f1bc5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:52.330038 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2011/4052] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:52.412440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:52.417991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.456490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1a59-cc37-40f1-b954-2a8566a65053 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:52.471098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:52.475454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.475833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.476536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] PATH_INFO: `/v3/projects/eec27e0738b84918ae2b91dae638b8d2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.479621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec27e0738b84918ae2b91dae638b8d2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:52.484086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:52.531710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:52.597235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec27e0738b84918ae2b91dae638b8d2', 'request_id': 'req-eab1a75d-85b8-48e8-ab7f-f76543547aba'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:52.608006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec27e0738b84918ae2b91dae638b8d2', 'request_id': 'req-eab1a75d-85b8-48e8-ab7f-f76543547aba'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:52.623048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec27e0738b84918ae2b91dae638b8d2', 'request_id': 'req-eab1a75d-85b8-48e8-ab7f-f76543547aba'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:52.660499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] The token cache is being invalidate because project eec27e0738b84918ae2b91dae638b8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:52.661075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:52.662330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eab1a75d-85b8-48e8-ab7f-f76543547aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:52.664878 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2042/4053] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:52 2022] DELETE /identity/v3/projects/eec27e0738b84918ae2b91dae638b8d2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:52.670927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8d50-9179-45e0-afd5-5610ccb27c43 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.671233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8d50-9179-45e0-afd5-5610ccb27c43 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.672054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8d50-9179-45e0-afd5-5610ccb27c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.704251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae68c-1b5f-4486-9b0a-505091c278cf None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.704594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae68c-1b5f-4486-9b0a-505091c278cf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.705698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae68c-1b5f-4486-9b0a-505091c278cf None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.708031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2043/4054] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 21:03:52.713336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6576b1-fd9d-458e-b9d7-2bea72a97199 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.714351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6576b1-fd9d-458e-b9d7-2bea72a97199 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.714777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6576b1-fd9d-458e-b9d7-2bea72a97199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.718432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4f3f8d50-9179-45e0-afd5-5610ccb27c43 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:52.724286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4f3f8d50-9179-45e0-afd5-5610ccb27c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.778725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:52.853277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6c6576b1-fd9d-458e-b9d7-2bea72a97199 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:52.854167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c6576b1-fd9d-458e-b9d7-2bea72a97199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.898126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2012/4055] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:52.905998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:52.906492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:52.906605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:52.946573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:52.950876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:52.974752 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2013/4056] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:52.975900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:52.992975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837b149-9f0b-4d2f-a6f4-c1bf7a175432 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.002345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.007806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.008136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.008794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.009560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:53.009969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.011801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.015119 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2044/4057] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:53.018377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.018842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.020355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.047178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2014/4058] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:53.047374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:53.049464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.049860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.067362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.101401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecf2c-c920-4239-b267-d9134037fb85 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.110977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.112285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.112918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.113467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] PATH_INFO: `/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.116472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0adc0f4184a494ab0f32132a5d5dc96)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.124951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.153860 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2045/4059] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:03:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:53.154815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.181095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb2a34-b333-4655-8f24-b953f02d614c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.190184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.192317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.193666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.194531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.195455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.199945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.224130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:53.240736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0adc0f4184a494ab0f32132a5d5dc96', 'request_id': 'req-65a01a77-46af-44ae-b05a-18ff4e917f0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.250920 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2046/4060] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:53 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:53.253332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.255382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.257881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0adc0f4184a494ab0f32132a5d5dc96', 'request_id': 'req-65a01a77-46af-44ae-b05a-18ff4e917f0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.268834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0adc0f4184a494ab0f32132a5d5dc96', 'request_id': 'req-65a01a77-46af-44ae-b05a-18ff4e917f0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.301715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] The token cache is being invalidate because project e0adc0f4184a494ab0f32132a5d5dc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:53.302905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.303883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.306602 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2015/4061] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:53 2022] DELETE /identity/v3/projects/e0adc0f4184a494ab0f32132a5d5dc96 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:53.307747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.310881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.390150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcfa43-0a4f-44b4-977b-348d30565003 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.397645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.398082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.398364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.398755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.401150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.415826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a01a77-46af-44ae-b05a-18ff4e917f0e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.417938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.419853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.435945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2047/4062] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:53.437359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.438706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.458687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:53.498983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.499696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.500016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.500289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.502728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.580310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406542-6a5a-4b8d-85cb-a8b3693cf29c service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.604496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.605598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.606125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.606621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.607550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.609746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.610200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.613658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.625222 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2016/4063] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:53.626024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.627555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.645728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68ce60-165b-4eea-908f-c27d31b7c029 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.652510 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2048/4064] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:53 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:53.658933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.664359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.674742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77b944-dea7-471f-a0f1-263b401453e9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.679742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.680035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.680317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] PATH_INFO: `/v3/users/f17adda40269404da4fde708abac760e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.681063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.682265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.682808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.683162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17adda40269404da4fde708abac760e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.685955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.694223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.700271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.702335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.732937 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2049/4065] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:53.738392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.760750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0073dfb-ba6e-4741-9121-e190d02e54c3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.767713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.768790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.768992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.784114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:53.788561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:53.788754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17adda40269404da4fde708abac760e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.789023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17adda40269404da4fde708abac760e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.792626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:53.798464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17adda40269404da4fde708abac760e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.799364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17adda40269404da4fde708abac760e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.816295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24949d18-1b86-4d7d-8b98-5cf928940ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17adda40269404da4fde708abac760e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:53.819949 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2050/4066] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:53.827838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:53.830434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:53.866334 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2017/4067] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:53 2022] DELETE /identity/v3/users/f17adda40269404da4fde708abac760e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:53.873620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1d3f2-c739-4f1a-b90f-41e20b911b75 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:53.963823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:53.980680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:53.981652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:53.982813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:53.984492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] PATH_INFO: `/v3/projects/05e1b681b03f4f1ab2009307236e04b5/users/6431b1500a8c4013ba33b4c20dd56187/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.010692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e1b681b03f4f1ab2009307236e04b5, user_id=6431b1500a8c4013ba33b4c20dd56187, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:54.014604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:54.038208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2051/4068] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:53 2022] PUT /identity/v3/projects/05e1b681b03f4f1ab2009307236e04b5/users/6431b1500a8c4013ba33b4c20dd56187/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:54.055279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.055650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.055754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.144648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] MFA Rules not processed for user `6431b1500a8c4013ba33b4c20dd56187`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:54.148482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:54.211119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:54.384690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2018/4069] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:54.389739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:54.556952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:54.559866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:54.592905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765919-9ed4-4b99-9f0e-c1f88d87cf53 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:54.599293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa80b8f-09d4-4a7b-a6f0-fb009017bf05 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:54.614491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:54.615410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.615845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.616227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.617225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:54.620136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:54.652760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:54.658397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.666931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.669229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] PATH_INFO: `/v3/projects/a1baa9c03039429fadb07d654d0a8e28` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.675316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1baa9c03039429fadb07d654d0a8e28)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:54.683225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:54.686397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2052/4070] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:54 2022] POST /identity/v3/projects => generated 367 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:54.691164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:54.793412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1baa9c03039429fadb07d654d0a8e28', 'request_id': 'req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:54.810854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1baa9c03039429fadb07d654d0a8e28', 'request_id': 'req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:54.819548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edb4f2-ba46-4bbb-9973-aaaf611a5f51 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:54.829273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1baa9c03039429fadb07d654d0a8e28', 'request_id': 'req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:54.868337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] The token cache is being invalidate because project a1baa9c03039429fadb07d654d0a8e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:54.868337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:54.872369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ee48e93-e12f-44ad-8b6d-1cec1a504dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:54.883970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2019/4071] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:54 2022] DELETE /identity/v3/projects/a1baa9c03039429fadb07d654d0a8e28 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:03:54.897472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d5cf-df19-4bc0-b537-2172e7982594 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.897923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d5cf-df19-4bc0-b537-2172e7982594 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.898405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d5cf-df19-4bc0-b537-2172e7982594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.929941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:54.930752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.931093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.931443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.932316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:54.934429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:54.955052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1488d5cf-df19-4bc0-b537-2172e7982594 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:54.957843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1488d5cf-df19-4bc0-b537-2172e7982594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:54.971567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2020/4072] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:54.971809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:54.977232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:54.980658 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2053/4073] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:54 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:54.982576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:54.984262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:54.984634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:54.993235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:55.019456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c082bf6-00a8-4d1c-b347-64afc82a78f7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.023306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:55.024769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:55.028174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.028904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.029312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.029766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.030577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.032993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.043842 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2021/4074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:55.044666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.058574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cbbba-09aa-4b0b-942e-d6c940d0ad74 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.067236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.068544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.070068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.070068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.070791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:55.071163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.076130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2054/4075] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:55.076558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.080996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.092921 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2022/4076] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:55.099027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.115449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0580-fbfd-4b98-99a1-472344023ed8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.120351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b17d7-9c24-4330-a132-02ce16d1b2b7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.126285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.127231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.127775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.127898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] PATH_INFO: `/v3/projects/b364611f4d4143d3a487026d1d97e8ff/users/905549c751b842d398c5a3260dc2016c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.136419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.137269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.137560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.137845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.138673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.142452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.170080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364611f4d4143d3a487026d1d97e8ff, user_id=905549c751b842d398c5a3260dc2016c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.176169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.209782 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2055/4077] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:55 2022] PUT /identity/v3/projects/b364611f4d4143d3a487026d1d97e8ff/users/905549c751b842d398c5a3260dc2016c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:55.218218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.218844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2023/4078] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:55 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:55.221052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.357075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:55.366654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d730a60-0fff-4cc6-a48e-cf71c9be4651 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.367767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0c3d-b252-432d-ab0e-0d8785e04819 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.373904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.374933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.375483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.375987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.381692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.382692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.383646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.384686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.385093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.385823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.386390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.388366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.401856 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2024/4079] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:55.413048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.429991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3c96-2917-4949-948d-766304df0b5f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.435486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2056/4080] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:55 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:55.439758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.442916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.444202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.444626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.445059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] PATH_INFO: `/v3/projects/b364611f4d4143d3a487026d1d97e8ff/users/905549c751b842d398c5a3260dc2016c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.447976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364611f4d4143d3a487026d1d97e8ff, user_id=905549c751b842d398c5a3260dc2016c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.452855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e550ad-da8d-40a0-8add-11066bccd264 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.459082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7c2d-4286-4f13-b0a1-5ae51f62e610 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.467452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.469251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.470539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.470939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.471903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.484168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.489928 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2025/4081] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:55 2022] PUT /identity/v3/projects/b364611f4d4143d3a487026d1d97e8ff/users/905549c751b842d398c5a3260dc2016c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:55.504602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2057/4082] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:55.506141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.507112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.507605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.508508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.533078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bcb6a-cbd7-4dc8-a7cc-7d39d23c7b03 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.665553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] MFA Rules not processed for user `905549c751b842d398c5a3260dc2016c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:55.676657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:55.736478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.737194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.737671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.737913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.738886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.740539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.760451 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2058/4083] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:55.769103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.798094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d729-7cca-493b-b90a-c718db56a735 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.804519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:55.805344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.805630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.805932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] PATH_INFO: `/v3/projects/b0099e3e84fb48dbb6fee07c78fe11e0/users/6714188f43e7456092eeea982244531d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.852255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0099e3e84fb48dbb6fee07c78fe11e0, user_id=6714188f43e7456092eeea982244531d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:55.858185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91235ea-5c19-4875-b430-c49ce973edec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:55.887156 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2026/4084] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:55.891649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:55.903793 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2059/4085] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:55 2022] PUT /identity/v3/projects/b0099e3e84fb48dbb6fee07c78fe11e0/users/6714188f43e7456092eeea982244531d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:55.916453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:55.916870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:55.917867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:55.920713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db292c-d99f-43be-9128-8a5d5dd79645 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:55.985247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:55.994441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] MFA Rules not processed for user `6714188f43e7456092eeea982244531d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:55.996795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:56.022761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.023860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.024149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.024430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.025344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.027331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.057033 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2027/4086] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:55 2022] POST /identity/v3/roles => generated 235 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:56.060282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.082261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835952-9e6d-4e81-b385-dd305cf27f14 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.089932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.090885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.091303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.092479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.093354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.095878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.103396 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2060/4087] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:56.113741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.130022 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2028/4088] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/roles => generated 235 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.132285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.148649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1c28c-ea7a-495c-8ada-af635132493b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.162570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.163568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.164041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.164463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.165528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.169269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.211642 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2029/4089] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/roles => generated 235 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.218351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.247403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03f5b9-16fe-4d3d-83c4-7c60e011dfd6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.255668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.256552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.256941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.257408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.258339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.260471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.276773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020bb64-2be2-4fa9-8b61-47ba075888bd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.283325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.284291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.285374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.286056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.286999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.289609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.330158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2030/4090] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/domains => generated 276 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.340630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.369105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2061/4091] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.371740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.478487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:56.521945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3626-2ad9-4f73-8a13-d6a776e851a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.530431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.531142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.531538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.531827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.532576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.535431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.576671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df42d-4ddd-471e-8048-ef43494db416 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.630066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2062/4092] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.640078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.679124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12a211-1ed6-4b99-a01e-03fb9028adcf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.688738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.690367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.690869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.692571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.696311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.708337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.746713 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2063/4093] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:56 2022] GET /identity/v3/roles => generated 2098 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:56.752656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.782629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.783451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.783783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.784070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.785349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.787889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da990de4-0cab-4a1a-b90e-4b8ca1fd0950 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.788202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.800829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.801900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.803547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.803547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.803547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.805282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.807943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:56.835592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2064/4094] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:03:56 2022] GET /identity/v3/roles => generated 2098 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:56.840264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.855739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1d1c2-eadd-41eb-a270-a3d2935657a9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:56.862134 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2031/4095] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/projects => generated 401 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:56.865502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:56.866886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.867332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.867867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] PATH_INFO: `/v3/projects/5378d9b80eeb43a59deedf1215dcbb3c/users/3c77fa83ad2f472b9e8e9cec20e8daa3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:56.869109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:56.899549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5378d9b80eeb43a59deedf1215dcbb3c, user_id=3c77fa83ad2f472b9e8e9cec20e8daa3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:56.904468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56163e2-12b8-4c60-9d6b-becb1174f248 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:56.934385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2065/4096] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:56 2022] PUT /identity/v3/projects/5378d9b80eeb43a59deedf1215dcbb3c/users/3c77fa83ad2f472b9e8e9cec20e8daa3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:56.953960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:56.953960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:56.954223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.027565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] MFA Rules not processed for user `3c77fa83ad2f472b9e8e9cec20e8daa3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:57.029771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:57.041888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c852d3-165a-4d1d-99b3-2ae7b227b1f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.143128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:57.181763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.185072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.185419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.185768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.189303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.196719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.213166 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2066/4097] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:57.237174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.244078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:57.252944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2032/4098] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:56 2022] POST /identity/v3/groups => generated 300 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:57.257328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.288199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43af90-a4f6-4ff5-acb1-ebfce898668b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.305843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.310586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.312971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.313354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.316511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.321748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.355255 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2033/4099] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:57 2022] POST /identity/v3/roles => generated 234 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:57.370230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.394633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678fa33-d122-4b46-98d5-aa95a9ebb5e3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.397896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79fde6-774e-43c1-bc85-d8c0e9af55f8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.404869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.405861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.406398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.406939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.407879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.408293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.409342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.409844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.410219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.425414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.472063 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2034/4100] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:57 2022] POST /identity/v3/users => generated 439 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:57.481695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.504341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.505983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.507634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1a646-6525-4f18-84c8-445b049a3c07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.527535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.528036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2067/4101] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:57.529563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.532476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.532907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.533915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.539086 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:57.539086 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:57.539086 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:57.540527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.583037 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2035/4102] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:03:57 2022] POST /identity/v3/roles => generated 270 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:57.584434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.603409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e226b17-ba35-4a03-a6a0-329fcda50060 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.610249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.611530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.611957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.612238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/b567e79899c44b52873856777ebd9c8d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.639983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:57.648692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=b567e79899c44b52873856777ebd9c8d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.651417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc82d-785f-49b4-8261-1fce38e49e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.680569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2068/4103] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:57 2022] PUT /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/b567e79899c44b52873856777ebd9c8d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:57.685465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.706346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa4820-f685-4e29-9199-db9ddb6dfe5b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.733016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.733648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.734114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.788149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:57.789867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:57.814181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.815020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.815365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.816305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.817567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Adding query filter params (scope.project.id=66c4d330b065400591252ecbeafcbc46, user.id=8dcb2918305a47dfb514124667e5b053) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:57.817950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.820523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.882423 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2069/4104] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:03:57.911501 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2036/4105] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:57 2022] GET /identity/v3/role_assignments?scope.project.id=66c4d330b065400591252ecbeafcbc46&user.id=8dcb2918305a47dfb514124667e5b053&effective => generated 228 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:57.915852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.919868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:57.922251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:57.933747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae747d7-18ff-460d-99eb-8c296b333372 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:57.939864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:57.941117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:57.941408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:57.941890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/b567e79899c44b52873856777ebd9c8d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:57.945434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=b567e79899c44b52873856777ebd9c8d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:57.950151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:57.961299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role b567e79899c44b52873856777ebd9c8d was removed from user 8dcb2918305a47dfb514124667e5b053 on project 66c4d330b065400591252ecbeafcbc46. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:57.961657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:57.962429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:58.001072 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2070/4106] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:03:57 2022] DELETE /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/b567e79899c44b52873856777ebd9c8d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:58.006874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.009804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:58.037243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:58.092199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aec53-990e-4f7c-b803-c905bf3692a1 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.182700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabb79c-693c-4c96-9405-41a981b0aa2f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.193779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.195051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.195642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.195823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/b567e79899c44b52873856777ebd9c8d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.197634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b567e79899c44b52873856777ebd9c8d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.198958 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:58.198958 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:58.198958 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:58.200099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.239097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.240869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.241351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.241813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.245969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:58.276499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role b567e79899c44b52873856777ebd9c8d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:58.276987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:58.277694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:58.279997 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2071/4107] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:58 2022] DELETE /identity/v3/roles/b567e79899c44b52873856777ebd9c8d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:58.289530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.291386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:58.335982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:58.343740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.345934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.364099 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2037/4108] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:58.396921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2a0d5-eb7e-4e15-b37c-bb10de3ff790 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.407858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.408590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.408945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.409244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/0e161825dc824fd5a92e2e08f4dd1d5e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.412622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=0e161825dc824fd5a92e2e08f4dd1d5e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.415608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.444525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.445218 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2072/4109] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:03:58 2022] PUT /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/0e161825dc824fd5a92e2e08f4dd1d5e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:58.465009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5e76d-f408-4f17-b7b3-d8e0164ca230 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.553380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.555444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.556125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.556726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.558885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.560593 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:58.560593 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:58.560593 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:58.562762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.637239 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2038/4110] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:03:58 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 521 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:03:58.641343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.658857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563ae4a-8bd4-4d30-b071-133ee5440d93 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.769079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.773622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:58.801773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:58.846690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.849638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.849638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.849638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.850077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Adding query filter params (scope.project.id=66c4d330b065400591252ecbeafcbc46, user.id=8dcb2918305a47dfb514124667e5b053) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:58.850502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.852705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.895582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1088-66f9-4999-b5fb-465bb2731396 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.902701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.904268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.904564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.904891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.907719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:58.944554 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2073/4111] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:58 2022] GET /identity/v3/role_assignments?scope.project.id=66c4d330b065400591252ecbeafcbc46&user.id=8dcb2918305a47dfb514124667e5b053&effective => generated 1061 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:03:58.946281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:58.958498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79539b0-c569-4482-81a3-5d1318454017 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:58.969556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:58.970843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:58.971389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:58.972039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:58.976862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.978510 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:58.978510 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:03:58.978510 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:03:58.982670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:58.985640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:58.988168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.006512 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2074/4112] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:03:58 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:59.010975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.023725 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2039/4113] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:03:59.093218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94ec9-8919-4e08-bb2e-e181efad69ba tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.098433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.099152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.101997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.102330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.103384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Adding query filter params (scope.project.id=66c4d330b065400591252ecbeafcbc46, user.id=8dcb2918305a47dfb514124667e5b053) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:59.103766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.105754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63bbb1-a927-4577-8420-869124d745d5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.121389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:59.180250 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2075/4114] 10.222.0.18 () {58 vars in 1355 bytes} [Sat Jun 4 21:03:59 2022] GET /identity/v3/role_assignments?scope.project.id=66c4d330b065400591252ecbeafcbc46&user.id=8dcb2918305a47dfb514124667e5b053&effective => generated 577 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:59.181858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.209097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ba74-3e1f-4937-a49e-a9795270bed5 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.213811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.214750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.215036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.215311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.217754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.219096 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:59.219096 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:59.219096 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:59.219901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.224772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.225556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.226014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8.: keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = query.one() Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._iter().one() Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._only_one_row( Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:03:59.245989 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 04 21:03:59.247110 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:03:59.248132 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2040/4115] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:03:59 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 137 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:03:59.253250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.253806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:03:59.255703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:59.269428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a2dd3-1d59-41cb-9084-36b773188e41 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.283110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.284501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.287023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.287397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/0e161825dc824fd5a92e2e08f4dd1d5e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.291156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=0e161825dc824fd5a92e2e08f4dd1d5e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.294315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.303844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 0e161825dc824fd5a92e2e08f4dd1d5e was removed from user 8dcb2918305a47dfb514124667e5b053 on project 66c4d330b065400591252ecbeafcbc46. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:59.304328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:59.305112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:59.354301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2041/4116] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:03:59 2022] DELETE /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/0e161825dc824fd5a92e2e08f4dd1d5e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:59.369046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.377670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:59.388258 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2076/4117] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:03:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:03:59.403424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.406479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:59.528748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afc1d-044e-4b4a-a324-b971c186cb9e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.539448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.540180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.540475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.540761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.542313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.546639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.549698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92a714-38aa-4ba1-8bab-daf635c91e80 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.598365 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2042/4118] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:03:59 2022] POST /identity/v3/roles => generated 271 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:03:59.599500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.621248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13700b8c-5c6c-4ce3-82e5-ddd2cc217d08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.627404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.628546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.628927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.629244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.630462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Adding query filter params (domain_id=3dc9135bcf1841b3805b6aaa6c6386ea) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:59.630803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.632009 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:59.632009 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:59.632009 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:59.632995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.647030 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2043/4119] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Jun 4 21:03:59 2022] GET /identity/v3/roles?domain_id=3dc9135bcf1841b3805b6aaa6c6386ea => generated 408 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:03:59.648913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.700654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871dbc3-4769-401b-8a02-8f90440df257 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.712185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.713824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.714119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.714865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/44dd347875d34f8e9edbf2a732c81f36` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.716243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=44dd347875d34f8e9edbf2a732c81f36)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.717499 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:59.717499 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:03:59.717499 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:03:59.719145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.751733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:59.754289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.755019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.755554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.755941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.780361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:59.813855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 44dd347875d34f8e9edbf2a732c81f36 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:03:59.814485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:59.818846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:03:59.824025 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2044/4120] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:03:59 2022] DELETE /identity/v3/roles/44dd347875d34f8e9edbf2a732c81f36 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:03:59.827138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:03:59.830730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:03:59.859055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.861153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:03:59.877890 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2077/4121] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:59.962504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18515eb-5c24-4a21-8962-87757104b3e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:03:59.978468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:03:59.980083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:03:59.981865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:03:59.982313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:03:59.983885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Adding query filter params (domain_id=3dc9135bcf1841b3805b6aaa6c6386ea) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:03:59.984398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:03:59.994388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.005777 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2045/4122] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Jun 4 21:03:59 2022] GET /identity/v3/roles?domain_id=3dc9135bcf1841b3805b6aaa6c6386ea => generated 148 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:00.010333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.036173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3b000-ab11-445c-8fb2-6eaf5588c876 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.053057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.056496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.056850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.058483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/44dd347875d34f8e9edbf2a732c81f36` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.111987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Could not find role: 44dd347875d34f8e9edbf2a732c81f36.: keystone.exception.RoleNotFound: Could not find role: 44dd347875d34f8e9edbf2a732c81f36. Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jun 04 21:04:00.137992 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:04:00.139156 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 44dd347875d34f8e9edbf2a732c81f36. Jun 04 21:04:00.140376 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:04:00.150994 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2078/4123] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:00 2022] DELETE /identity/v3/roles/44dd347875d34f8e9edbf2a732c81f36 => generated 110 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:04:00.152891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.170675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ac9ca-d249-4dab-9947-65e710eba64a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.178084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.180825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.181331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.181775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.193073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.203473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.217698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.220243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:00.242419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2046/4124] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:00 2022] PUT /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:00.246529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.345971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd888c-b7aa-484e-a96c-70eb5834218a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.407009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47869d87-7d28-4755-b669-ed7a4009a400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.424244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.425936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.426376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.426874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.429192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, group_id=c736786126ef48c0a9e6e9517120267c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.432311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.437485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.438651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.439116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.439440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] PATH_INFO: `/v3/users/6714188f43e7456092eeea982244531d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.441982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6714188f43e7456092eeea982244531d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.444546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.451014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2047/4125] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Jun 4 21:04:00 2022] GET /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles => generated 409 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:00.452583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.467622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8540dbe-8b19-43f8-8db8-f2b0fd09dc66 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.473344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.474350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.475943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.476349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.479578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.486623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.498257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2048/4126] 10.222.0.18 () {58 vars in 1464 bytes} [Sat Jun 4 21:04:00 2022] HEAD /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:00.499921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.518315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704b7f-1a90-4ef6-91fe-927a062ca178 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.524266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.525194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.525483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.525769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.528217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.530931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.537891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 7462a7ebe2684129b9979a330f47513a was removed from group c736786126ef48c0a9e6e9517120267c on domain 3dc9135bcf1841b3805b6aaa6c6386ea. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:00.538193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.538950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.545179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6714188f43e7456092eeea982244531d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.554549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:00.558426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6714188f43e7456092eeea982244531d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.561401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6714188f43e7456092eeea982244531d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.562542 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2049/4127] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:04:00 2022] DELETE /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:00.563069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6714188f43e7456092eeea982244531d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.568250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.571062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:00.586451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b2bbe66-5231-4eea-a6df-63a547efdb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6714188f43e7456092eeea982244531d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:00.610739 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2079/4128] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:00 2022] DELETE /identity/v3/users/6714188f43e7456092eeea982244531d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:00.615720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:00.619271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.619971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.620286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.640464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:00.642648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:00.662840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe274e-fd3d-4af6-a44e-45fe1f0ffd56 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.747811 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2080/4129] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:00.758004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.759758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:00.810237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.811281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.813595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.814006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:00.817766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66c4d330b065400591252ecbeafcbc46, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:00.821284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:00.847559 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2050/4130] 10.222.0.18 () {60 vars in 1485 bytes} [Sat Jun 4 21:04:00 2022] PUT /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:00.858268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:00.863921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:00.880810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea2f59-8cf3-434d-b767-6eb5113444e5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:00.977065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:00.978497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:00.978940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:00.979487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.001994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e4244-b90b-4ad3-8ef5-80e4015b5be9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.007974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.009037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.009329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.009608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.015991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_grants(project_id=66c4d330b065400591252ecbeafcbc46, group_id=c736786126ef48c0a9e6e9517120267c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.019134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.032167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:01.043957 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2051/4131] 10.222.0.18 () {58 vars in 1367 bytes} [Sat Jun 4 21:04:00 2022] GET /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles => generated 410 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:01.045942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.059414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0627-33f6-4171-bac4-6a0082ffe586 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.066018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.067298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.068091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.068531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/groups/c736786126ef48c0a9e6e9517120267c/users/8dcb2918305a47dfb514124667e5b053` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.070586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c736786126ef48c0a9e6e9517120267c, user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.071762 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:01.071762 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:01.071762 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:01.073036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.081978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.084697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337be106-927b-41e1-aed6-88c078fb9216 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.112160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2081/4132] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:01.124235 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2052/4133] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:04:01 2022] PUT /identity/v3/groups/c736786126ef48c0a9e6e9517120267c/users/8dcb2918305a47dfb514124667e5b053 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:01.129008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.129245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.129516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.200973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] MFA Rules not processed for user `8dcb2918305a47dfb514124667e5b053`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:01.203125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:01.356099 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2082/4134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:01.361798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.437223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:01.469108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88579a7b-2550-4d7c-931d-1e1faf1e7c39 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.475086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.476039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.476326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.476610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.479332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_grant(project_id=66c4d330b065400591252ecbeafcbc46, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.483052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.490076 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2053/4135] 10.222.0.18 () {58 vars in 1467 bytes} [Sat Jun 4 21:04:01 2022] HEAD /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:01.495069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.508336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231956f-0109-462c-88b2-9450fdea7b15 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.513482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.514498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.514669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.514958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.517281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=66c4d330b065400591252ecbeafcbc46, group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.520321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.527051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 7462a7ebe2684129b9979a330f47513a was removed from group c736786126ef48c0a9e6e9517120267c on project 66c4d330b065400591252ecbeafcbc46. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:01.527355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.528175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.551360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2083/4136] 10.222.0.18 () {58 vars in 1469 bytes} [Sat Jun 4 21:04:01 2022] DELETE /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:01.556176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.558018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:01.573299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dfe84-6761-4ce6-9f5c-da55d764b5dd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.675180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.677683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.678369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.679047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/groups/c736786126ef48c0a9e6e9517120267c/users/8dcb2918305a47dfb514124667e5b053` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.683698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c736786126ef48c0a9e6e9517120267c, user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.684924 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:01.684924 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:01.684924 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:01.689762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.690134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.691832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:01.716671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.751553 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2054/4137] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:04:01 2022] DELETE /identity/v3/groups/c736786126ef48c0a9e6e9517120267c/users/8dcb2918305a47dfb514124667e5b053 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:01.758746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.806539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921cc57-adbb-4642-b4b9-354f127864b2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.832866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:01.867328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c7be6-0ef5-42db-8f7a-0babcefd0400 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.872502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.873557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.873944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.874315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.876148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.877269 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:01.877269 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:01.877269 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:01.878323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.881832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.882768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.883111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.883527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] PATH_INFO: `/v3/projects/b0099e3e84fb48dbb6fee07c78fe11e0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.885045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0099e3e84fb48dbb6fee07c78fe11e0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.887281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.889251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2055/4138] 10.222.0.18 () {60 vars in 1380 bytes} [Sat Jun 4 21:04:01 2022] PUT /identity/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:01.895295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.906924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef816f-070e-4011-946c-9abcd8241299 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.912802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:01.914037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:01.914404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:01.914747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:01.916964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=c736786126ef48c0a9e6e9517120267c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:01.918696 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:01.918696 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:01.918696 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:01.920484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:01.935162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2056/4139] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:04:01 2022] GET /identity/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles => generated 375 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:01.939288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.942429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0099e3e84fb48dbb6fee07c78fe11e0', 'request_id': 'req-6d2007e6-007a-4a71-888c-adf87065478a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.950401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dec7f-4163-4e01-a3cb-ec4ce5f803df tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:01.950614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0099e3e84fb48dbb6fee07c78fe11e0', 'request_id': 'req-6d2007e6-007a-4a71-888c-adf87065478a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.958384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0099e3e84fb48dbb6fee07c78fe11e0', 'request_id': 'req-6d2007e6-007a-4a71-888c-adf87065478a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.976493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] The token cache is being invalidate because project b0099e3e84fb48dbb6fee07c78fe11e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:01.976948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.978002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:01.980582 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2084/4140] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:01 2022] DELETE /identity/v3/projects/b0099e3e84fb48dbb6fee07c78fe11e0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:01.985205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:01.987111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:02.011335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:02.033157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.035161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.035653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.036018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.038628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.040002 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:02.040002 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:02.040002 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:02.043163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.050962 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2057/4141] 10.222.0.18 () {58 vars in 1362 bytes} [Sat Jun 4 21:04:01 2022] HEAD /identity/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.055721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.057889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:02.082097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d171cc-5956-4cc9-872d-8eaa966c10fb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.087822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.088773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.089268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.089617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.091555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=c736786126ef48c0a9e6e9517120267c, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.092657 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:02.092657 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:02.092657 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:02.093718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.102536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2007e6-007a-4a71-888c-adf87065478a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.112834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.114381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.114909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.115493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] PATH_INFO: `/v3/users/3c77fa83ad2f472b9e8e9cec20e8daa3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.118871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2058/4142] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Jun 4 21:04:02 2022] DELETE /identity/v3/system/groups/c736786126ef48c0a9e6e9517120267c/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.119420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c77fa83ad2f472b9e8e9cec20e8daa3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.121228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.121975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.144508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa080e-c032-48f2-9cc7-2d1360df6e18 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.164604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.165644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.166082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.166602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.170537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.173854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.212830 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2059/4143] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Jun 4 21:04:02 2022] PUT /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.218878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.222407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c77fa83ad2f472b9e8e9cec20e8daa3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.229774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:02.233082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c77fa83ad2f472b9e8e9cec20e8daa3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.234203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c77fa83ad2f472b9e8e9cec20e8daa3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.235286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c77fa83ad2f472b9e8e9cec20e8daa3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.288827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c77fa83ad2f472b9e8e9cec20e8daa3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.312030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2085/4144] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:01 2022] DELETE /identity/v3/users/3c77fa83ad2f472b9e8e9cec20e8daa3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:02.332637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56666b0-85db-4540-81e6-4db6383ab5e7 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.471394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.472363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.472699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.474387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.475495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.478240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.495680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2060/4145] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jun 4 21:04:02 2022] GET /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles => generated 408 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:02.497754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.499294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:02.515399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a7ca5-5a9f-4dae-be86-704c82e0f172 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.524766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.526525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.531158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.531821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.537121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.541370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.553849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2086/4146] 10.222.0.18 () {58 vars in 1461 bytes} [Sat Jun 4 21:04:02 2022] HEAD /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.558244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.570643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711c1f-cd1e-442f-9a02-94d8c8740935 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.577530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.578490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.578767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.579053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.583763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.589811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.601964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 7462a7ebe2684129b9979a330f47513a was removed from user 8dcb2918305a47dfb514124667e5b053 on domain 3dc9135bcf1841b3805b6aaa6c6386ea. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:02.602592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.603495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:02.648031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.649108 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2061/4147] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Jun 4 21:04:02 2022] DELETE /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.650827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:02.685173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa7ba-a641-41e4-b4aa-1b36c95f33fa tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.818704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.819791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.820131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.820475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.823613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.826369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:02.846901 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2087/4148] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:02 2022] PUT /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:02.851306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.871585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b06b5-7fa9-4c35-b65b-e60aba068139 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:02.934591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:02.937197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:02.947129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:02.969273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:02.970425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:02.971701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:02.972166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:02.974308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_grants(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:02.977386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.043123 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2062/4149] 10.222.0.18 () {58 vars in 1364 bytes} [Sat Jun 4 21:04:02 2022] GET /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles => generated 409 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:03.045315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.063285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf3b8f-1a8c-431b-80b7-856e0bd3529f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.068183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6ca85-e3c1-482b-b0d9-c3f9ee2c3244 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.076160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.077605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.077999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.078469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] PATH_INFO: `/v3/projects/5378d9b80eeb43a59deedf1215dcbb3c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.079869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5378d9b80eeb43a59deedf1215dcbb3c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.082891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.086952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.088258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.088611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.088906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.093978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.096562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.133216 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2063/4150] 10.222.0.18 () {58 vars in 1464 bytes} [Sat Jun 4 21:04:03 2022] HEAD /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:03.134507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.155614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3baef-5a78-4af9-ae57-00d5aed8f6d3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.169424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5378d9b80eeb43a59deedf1215dcbb3c', 'request_id': 'req-ac0c2abd-a878-4675-9923-bc9f5e19335e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.177198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5378d9b80eeb43a59deedf1215dcbb3c', 'request_id': 'req-ac0c2abd-a878-4675-9923-bc9f5e19335e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.184523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:03.188290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5378d9b80eeb43a59deedf1215dcbb3c', 'request_id': 'req-ac0c2abd-a878-4675-9923-bc9f5e19335e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.212346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] The token cache is being invalidate because project 5378d9b80eeb43a59deedf1215dcbb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:03.213347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.214246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ac0c2abd-a878-4675-9923-bc9f5e19335e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.217181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2088/4151] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:02 2022] DELETE /identity/v3/projects/5378d9b80eeb43a59deedf1215dcbb3c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:03.224200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551635-6919-4475-953a-251210f23449 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.225148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551635-6919-4475-953a-251210f23449 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.225739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551635-6919-4475-953a-251210f23449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.238933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.239977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.240552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.240676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.243338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=66c4d330b065400591252ecbeafcbc46, user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.246236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.255574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 7462a7ebe2684129b9979a330f47513a was removed from user 8dcb2918305a47dfb514124667e5b053 on project 66c4d330b065400591252ecbeafcbc46. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:03.255574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.255987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-af551635-6919-4475-953a-251210f23449 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:03.256175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:03.256291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-af551635-6919-4475-953a-251210f23449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:03.285742 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2064/4152] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:04:03 2022] DELETE /identity/v3/projects/66c4d330b065400591252ecbeafcbc46/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:03.297476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.306622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:03.394460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2089/4153] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:03.406497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.407061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.407494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.411820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabc4ea-28bd-4b2f-9c50-b48f42e25d4c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.424287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.425334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.425619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.425901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.427872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.428925 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:03.428925 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:03.428925 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:03.429828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.452067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:03.452328 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2065/4154] 10.222.0.18 () {60 vars in 1377 bytes} [Sat Jun 4 21:04:03 2022] PUT /identity/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:03.452510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:03.460152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.497960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ec5e-9403-44fb-a625-7bfa2a1d5578 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.537130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.540924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.541354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.541646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.543614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.544677 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:03.544677 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:03.544677 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:03.547057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.576482 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2066/4155] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:04:03 2022] GET /identity/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles => generated 374 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:03.593830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.610011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309c1c-a482-4c29-a690-dcb8392d0f09 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.621986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2090/4156] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:03.627031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.631781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.635241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.635800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.636234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.637368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e641cd-e4f4-4599-816a-73f1e3f382d3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.642224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.642690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.643029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.643375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.643999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.645056 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:03.645056 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:03.645056 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:03.645432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:03.645798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.648006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.648545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.657180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2067/4157] 10.222.0.18 () {58 vars in 1359 bytes} [Sat Jun 4 21:04:03 2022] HEAD /identity/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:03.658518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.671566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2091/4158] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:03.671566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.678231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a6384-2ed0-45a7-a0e4-2ec85a36b5d9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.683216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23bad6-c655-460b-b786-9a6578201268 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.684836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.686628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.686938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.687247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.688254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.689195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=8dcb2918305a47dfb514124667e5b053, role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.689293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.689559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.689858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.690153 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:03.690153 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:03.690153 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:03.690828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.691112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.693939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.702003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2068/4159] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jun 4 21:04:03 2022] DELETE /identity/v3/system/users/8dcb2918305a47dfb514124667e5b053/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:03.707674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.735691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f7f8-9184-4fc1-a394-d9fb1e2057c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.743197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.747366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.747531 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2092/4160] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:03.747647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.747647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.747647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.748059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.749000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.781780 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2069/4161] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/roles => generated 270 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:03.783144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.798653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d744b-4bcd-4f27-b30a-fcefc9422ae0 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.808451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:03.845555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:03.868203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d242-c7b6-4c09-85c3-baa253dabf3b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.878568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.879614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.880034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.880345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.881047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.883732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.930534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2093/4162] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:03.932286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.937859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.939383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.939878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.940307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.941829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.943857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.945768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a61e4-f262-4b77-8bbb-dec872fa2f07 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:03.952935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:03.953766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:03.954045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:03.954321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:03.955214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:03.957852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:03.970492 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2070/4163] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:03 2022] POST /identity/v3/roles => generated 270 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:03.976709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:03.978928 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2094/4164] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:03 2022] GET /identity/v3/roles => generated 2323 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:03.983655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.001145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65c9e1-4d36-4abd-8e74-210107a17ea7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.008157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dcf4-fbcc-42db-97ce-5d5a6110b236 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.009687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.010816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.011331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.011863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.012914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.014525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.015195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.015571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.016017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/8c23442e55b944ac9c851cebf4eafd36` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.016670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.018296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=8c23442e55b944ac9c851cebf4eafd36)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.022050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.036867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2095/4165] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:03 2022] GET /identity/v3/roles => generated 2323 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:04.041072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.054766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84e621-a7e7-491a-8cef-9f6f9cac9668 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.062564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2071/4166] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:03 2022] PUT /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/8c23442e55b944ac9c851cebf4eafd36 => generated 531 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.067125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.163814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.164779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.165067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.165426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] PATH_INFO: `/v3/projects/25fece1760704d84afe2362221799643/users/f7f60a93b31e4855abfd8be053c558a4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.187196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fece1760704d84afe2362221799643, user_id=f7f60a93b31e4855abfd8be053c558a4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.190288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784c41a-9b18-44a8-85a7-303fd4c813b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.220550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c722f-0b7c-477f-b821-afe461b2a12b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.242097 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2096/4167] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:04 2022] PUT /identity/v3/projects/25fece1760704d84afe2362221799643/users/f7f60a93b31e4855abfd8be053c558a4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:04.246228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.246525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.246808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.289132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] MFA Rules not processed for user `f7f60a93b31e4855abfd8be053c558a4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:04.290906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:04.373056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.374178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.375372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.375840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.379350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.382337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.396064 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2097/4168] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:04.401685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.418320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2072/4169] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:04:04 2022] POST /identity/v3/domains => generated 276 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.419452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.447132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:04.458152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:04.536118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d0bb5-2785-4d89-9a08-048f2c7a0358 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.538179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837f2b0-e9da-4580-a10b-ffc2078aabf6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.543924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.544850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.545484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.546047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.547003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.549650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.595702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2073/4170] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:04 2022] POST /identity/v3/roles => generated 270 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.598363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.617722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641ba6-facb-426d-af6b-873b74c61456 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.626011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.626793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.627448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.627714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.627817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.628087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/b92b3da68a76432abcef23120a142d97` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.628224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.629494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.630480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.632648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.633255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=b92b3da68a76432abcef23120a142d97)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.634895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.671627 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2074/4171] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:04 2022] PUT /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/b92b3da68a76432abcef23120a142d97 => generated 531 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.675628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.677219 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2098/4172] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:04 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.681957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.768482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b587-d220-468c-b5fd-c57c832ee3b5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.813676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372b7b-f9b6-40cf-962c-666eb5970ecc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.819026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.820347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.820633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.820913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.821767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.823917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.857436 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2099/4173] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:04 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:04.863625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.891715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b518-c2d8-42ad-b1e0-777a253d3e00 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.893029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.896080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.897073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.897911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.902444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.906022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.906902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:04.908077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:04.908529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:04.909437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:04.912449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:04.915924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:04.958686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2100/4174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:04 2022] GET /identity/v3/roles => generated 2323 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:04.959965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:04.974077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b909d-99cc-4143-9264-84cca5afc470 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:04.982757 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2075/4175] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:04 2022] PUT /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/7462a7ebe2684129b9979a330f47513a => generated 525 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:04.987193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.006375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:05.072277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:05.092564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba58d0b-61b7-4107-be05-16d169ac42f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.101911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.102891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.103332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.104495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.105881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.107189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.107317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.108027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.108540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/7462a7ebe2684129b9979a330f47513a/implies/2364954c168844ce93a4c4a9fb3518c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.111238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7462a7ebe2684129b9979a330f47513a, implied_role_id=2364954c168844ce93a4c4a9fb3518c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.112624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.113727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.142745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2101/4176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:04 2022] GET /identity/v3/roles => generated 2323 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] 2364954c168844ce93a4c4a9fb3518c3 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 2364954c168844ce93a4c4a9fb3518c3 cannot be an implied roles. Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jun 04 21:04:05.147765 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 2364954c168844ce93a4c4a9fb3518c3 cannot be an implied roles. Jun 04 21:04:05.148938 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:05.151470 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2076/4177] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:04 2022] PUT /identity/v3/roles/7462a7ebe2684129b9979a330f47513a/implies/2364954c168844ce93a4c4a9fb3518c3 => generated 116 bytes in 165 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:04:05.152317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.155472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.170158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc4b57-2dd3-4ee0-8f4d-6c51c7152474 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.177725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce313cf-4ded-4255-9212-8c5906d1e861 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.181332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.182950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.183397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.183646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.184080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.184668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.185036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.185528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] PATH_INFO: `/v3/projects/4138297ed1464b5e8bc443847a6e074c/users/aad8d98f78254b339ca6d3014f481b66/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.188436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.192525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.210758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2077/4178] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:05 2022] DELETE /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:05.212210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4138297ed1464b5e8bc443847a6e074c, user_id=aad8d98f78254b339ca6d3014f481b66, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.215138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45192ad7-5253-4485-a9f3-0efe06bc0dcb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.215682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.258318 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2102/4179] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:05 2022] PUT /identity/v3/projects/4138297ed1464b5e8bc443847a6e074c/users/aad8d98f78254b339ca6d3014f481b66/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:05.260765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.261178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.261553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.307214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] MFA Rules not processed for user `aad8d98f78254b339ca6d3014f481b66`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:05.308668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:05.324329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be57f0-c7d7-4b0a-9ce2-0b9fc07f1bf9 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.430229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.431764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.432236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.432965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/b92b3da68a76432abcef23120a142d97` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.436519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=b92b3da68a76432abcef23120a142d97)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.438640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.452040 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2103/4180] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:05.453451 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2078/4181] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:05 2022] DELETE /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/b92b3da68a76432abcef23120a142d97 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:05.458038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.471999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.474065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:05.475450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188a8f9-0f04-4e07-ad6b-975d3b2ec0c4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.554219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:05.598992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170e82b-c79d-4d7e-a338-248bdfd02a07 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.608898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.610681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.611826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.614648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.623498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.626249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.626625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.626962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/b92b3da68a76432abcef23120a142d97` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.630309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b92b3da68a76432abcef23120a142d97)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.632335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.706677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role b92b3da68a76432abcef23120a142d97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:05.707170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:05.708940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:05.715037 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2104/4182] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:05 2022] DELETE /identity/v3/roles/b92b3da68a76432abcef23120a142d97 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:05.720944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.722772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:05.732608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.734206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.752642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:05.776586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2079/4183] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:05.879687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0acbf-c5df-48e6-8be3-ff125096f18f tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.887851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:05.889061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:05.889697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:05.890011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/86cd3f32873049daae842cea3ba154ff` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:05.910243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:05.921860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f403f-6050-4999-abc9-569b721ac938 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:05.927816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=86cd3f32873049daae842cea3ba154ff)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:05.929044 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:05.929044 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:05.929044 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:05.938292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:05.983955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:05.984714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.024875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a11-cb2a-424e-894c-47835976856f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:06.025925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a11-cb2a-424e-894c-47835976856f service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:06.026211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a11-cb2a-424e-894c-47835976856f service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:06.026520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778a11-cb2a-424e-894c-47835976856f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:06.028467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75778a11-cb2a-424e-894c-47835976856f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:06.037815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.039256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.043639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2105/4184] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:04:05 2022] PATCH /identity/v3/domains/86cd3f32873049daae842cea3ba154ff => generated 277 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:06.048316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:06.050598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:06.107393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778a11-cb2a-424e-894c-47835976856f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:06.109072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778a11-cb2a-424e-894c-47835976856f service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:06.127027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2080/4185] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:06.154649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e3658-4b68-4faf-ac8c-38293ba61a9b tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:06.160268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:06.161311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:06.161609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:06.161896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/86cd3f32873049daae842cea3ba154ff` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:06.183802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=86cd3f32873049daae842cea3ba154ff)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:06.184877 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:06.184877 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:06.184877 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:06.185844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:06.228946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.235198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '86cd3f32873049daae842cea3ba154ff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.334641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:06.348944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.360611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.372508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.394891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] The token cache is being invalidate because project 86cd3f32873049daae842cea3ba154ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:06.395361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.396217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.413856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.415974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.430690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '86cd3f32873049daae842cea3ba154ff', 'request_id': 'req-74a26c0b-004e-438a-b25a-173cbcaca8bb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.438809 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2106/4186] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:06 2022] DELETE /identity/v3/domains/86cd3f32873049daae842cea3ba154ff => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:06.443143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a11-cb2a-424e-894c-47835976856f service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:06.444879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75778a11-cb2a-424e-894c-47835976856f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:06.483365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778a11-cb2a-424e-894c-47835976856f service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:06.555264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:06.581300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:06.582372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:06.582960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:06.583251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/8c23442e55b944ac9c851cebf4eafd36` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:06.586324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=2364954c168844ce93a4c4a9fb3518c3, implied_role_id=8c23442e55b944ac9c851cebf4eafd36)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:06.588696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:06.624948 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2081/4187] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:06 2022] DELETE /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3/implies/8c23442e55b944ac9c851cebf4eafd36 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:06.631075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:06.633230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:06.652614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a26c0b-004e-438a-b25a-173cbcaca8bb tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:06.740281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:06.741298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:06.741584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:06.741867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/8c23442e55b944ac9c851cebf4eafd36` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:06.743104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8c23442e55b944ac9c851cebf4eafd36)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:06.744781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:06.800239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 8c23442e55b944ac9c851cebf4eafd36 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:06.800589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.804085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.807103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2107/4188] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:06 2022] DELETE /identity/v3/roles/8c23442e55b944ac9c851cebf4eafd36 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:06.811210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:06.813473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:06.838036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15564cc2-71cb-4b40-b1c9-1fda6c434912 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:06.918267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:06.919214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:06.919632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:06.922758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/2364954c168844ce93a4c4a9fb3518c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:06.925303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2364954c168844ce93a4c4a9fb3518c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:06.927457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:06.977545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 2364954c168844ce93a4c4a9fb3518c3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:06.978126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.979041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:06.986335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2082/4189] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:06 2022] DELETE /identity/v3/roles/2364954c168844ce93a4c4a9fb3518c3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:06.987635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.004776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1e7ce-1d3e-4a3d-bd4f-908ccee25e4e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.087731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.088898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.089281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.089725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.091734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.092892 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:07.092892 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:07.092892 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:07.094343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.113585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:07.150593 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2108/4190] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:06 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 521 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:07.154125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.155743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:07.179775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc21df-0519-4568-88ec-0f8b4e1e1965 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.281930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.283282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.283282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.283768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.285779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.286939 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:07.286939 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:07.286939 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:07.288148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.289213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.290641 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:07.290641 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:07.290641 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:07.291759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.305327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2083/4191] 10.222.0.18 () {58 vars in 1344 bytes} [Sat Jun 4 21:04:07 2022] HEAD /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:07.309919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.343911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06b75-83d9-491e-b405-45bcba3e6d01 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.349517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.350849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.351305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.351777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.353692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.354751 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:07.354751 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:07.354751 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:07.355764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.372970 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2109/4192] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:04:07 2022] GET /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 521 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:07.377353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.390363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290f74-4c45-4f21-b810-c74b3170badd tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.398247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.399423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.399865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.400125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.402914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.404759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.419610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2084/4193] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:07 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:07.422789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.438517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d99cf-43de-43b6-86a4-6a0530e9907d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.543990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.545117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.545479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.545817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.547879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.550040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8.: keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = query.one() Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._iter().one() Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._only_one_row( Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:07.568352 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 04 21:04:07.569677 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 04 21:04:07.570979 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 04 21:04:07.570979 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:04:07.570979 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:04:07.571496 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2110/4194] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:04:07 2022] GET /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 137 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:04:07.576074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.615922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d633698-7c11-4b3e-930c-a0e6183c3002 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.627675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.629486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.629768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.630247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.632375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.633893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8.: keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = query.one() Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._iter().one() Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._only_one_row( Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:07.669486 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 04 21:04:07.671843 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 04 21:04:07.672948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 04 21:04:07.672948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 04 21:04:07.672948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 04 21:04:07.672948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 0e161825dc824fd5a92e2e08f4dd1d5e does not imply cb2944c3616f4b61b6cb111f4f3c19d8. Jun 04 21:04:07.672948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:07.674625 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2085/4195] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:07 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 137 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:04:07.679540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.692923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589953c9-9ab4-4df5-9d50-5a68a73965f5 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.702432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.703747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.704212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.704676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.707734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.710193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.763829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2111/4196] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:07 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 521 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:07.769787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.803359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865f4d8-b84c-4001-91be-0f29d9f8620d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:07.845860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:07.897137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:07.898236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:07.898744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:07.899067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:07.902452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:07.905363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:07.951393 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2086/4197] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:07 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8 => generated 521 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:07.956335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:07.974230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d5f4c-85e5-47ef-b56e-d91d42c205cc tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.070880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.073160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:08.129805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.129805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.129805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.130633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.168629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=73f1e75fd4234345aac6b881f6e516a8, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.170521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.223640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ae01-df17-46fb-ada7-010bb8f5ed33 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.229841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.231278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.231763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.232215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] PATH_INFO: `/v3/users/f7f60a93b31e4855abfd8be053c558a4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.233807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f60a93b31e4855abfd8be053c558a4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.236536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.253908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2112/4198] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:07 2022] PUT /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a => generated 520 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:08.253908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.338669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:08.393684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2405-6b4b-4265-88f7-8b3dfeb8e65c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.395706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f60a93b31e4855abfd8be053c558a4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:08.396877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f60a93b31e4855abfd8be053c558a4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:08.407025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.407643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.407929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.408208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.408983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.410272 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:08.410272 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:08.410272 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:08.411301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.411982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f60a93b31e4855abfd8be053c558a4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:08.412721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f60a93b31e4855abfd8be053c558a4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:08.435068 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2113/4199] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:04:08 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:08.436232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.438544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:08.454056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b6c3ba-3d5d-4695-b0fd-4b51b335fbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f60a93b31e4855abfd8be053c558a4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:08.484698 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2087/4200] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:08 2022] DELETE /identity/v3/users/f7f60a93b31e4855abfd8be053c558a4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:08.489127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f4d3-7c33-4cb8-9eff-cd0edd2fcddf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.490321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.490614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.490915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.512542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:08.513788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:08.536776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:08.589562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2088/4201] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:08.607336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.608908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:08.613781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.614767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.615054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.615343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.617354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=73f1e75fd4234345aac6b881f6e516a8, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.619166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.630861 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2114/4202] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:08 2022] DELETE /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:08.634908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.693681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee922-c6cc-4f43-8a5c-9a10a4fccf19 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.720560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacaa12-1344-41a6-ba77-7fc260b37a44 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.725952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.726951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.727241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.727565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.729549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.731647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.749927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2115/4203] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:08 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:08.755017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.834116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.835070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.835561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.835995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.895941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e537a-be01-4060-899f-a6e454cc1e08 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:08.911703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:08.912306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:08.912585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:08.912939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:08.917789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.919565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:08.925591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:08.947355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2116/4204] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:08 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:08.952384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:08.996409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:08.998033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.023760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2089/4205] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:09.066612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aade6-5dac-46cc-8559-c7f3b11f348d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.072856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.074109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.074485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.074976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.075972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.077886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.100305 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2117/4206] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:08 2022] GET /identity/v3/roles => generated 2323 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:09.105296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.129232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43b2d2-8fac-4728-a3d8-eb215da00d71 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.134675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.135657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.136355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.137287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.138883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.141084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.167228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2090/4207] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:09 2022] POST /identity/v3/roles => generated 235 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:09.170690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.187900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47b7d-be9f-40fd-94b9-604ec1eb2fdf tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.206163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.209317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.209959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.210226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/25f799d687834c4fa3417d7ccc2b7257` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.212570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:update_role(role_id=25f799d687834c4fa3417d7ccc2b7257)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.213809 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:09.213809 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:09.213809 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:09.214958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.272204 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2118/4208] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 21:04:09 2022] PATCH /identity/v3/roles/25f799d687834c4fa3417d7ccc2b7257 => generated 238 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:09.273267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.285362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157d1c-1d7d-45fc-9007-f0c8571879ca tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.295363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.296580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.296871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.297151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/25f799d687834c4fa3417d7ccc2b7257` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.310943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:get_role(role_id=25f799d687834c4fa3417d7ccc2b7257)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.313032 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:09.313032 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:09.313032 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:09.313969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.317256 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2091/4209] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:04:09 2022] GET /identity/v3/roles/25f799d687834c4fa3417d7ccc2b7257 => generated 238 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:09.320975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.341280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000cb22-5890-40cb-9887-13a23a330126 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.359412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.361724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.362204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.362640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.364963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.367683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.399795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2119/4210] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:09 2022] GET /identity/v3/roles => generated 2552 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:09.400152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.420011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab9e7b-4c3f-47a0-8e0e-1fb5b04e7f06 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.435425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.437539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.438884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.439456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/25f799d687834c4fa3417d7ccc2b7257` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.441731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_role(role_id=25f799d687834c4fa3417d7ccc2b7257)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.444278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.448495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:09.460615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.463297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:09.523580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 25f799d687834c4fa3417d7ccc2b7257 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:09.524184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.549068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.596280 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2092/4211] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:09 2022] DELETE /identity/v3/roles/25f799d687834c4fa3417d7ccc2b7257 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:09.603325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.605190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:09.627747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12df0-36d1-4546-93ee-7fbdb0873e0c tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.759645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.761848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.762674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.764390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] PATH_INFO: `/v3/projects/25fece1760704d84afe2362221799643` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.766457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fece1760704d84afe2362221799643)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.766634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c44000-864d-41af-9544-c2164a1844f2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:09.772506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:09.773295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:09.773435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.773574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:09.773853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:09.775655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:09.777794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:09.793219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:09.823199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2093/4212] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:09 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 521 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:09.824454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.863303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fece1760704d84afe2362221799643', 'request_id': 'req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.874294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fece1760704d84afe2362221799643', 'request_id': 'req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.879301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fece1760704d84afe2362221799643', 'request_id': 'req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.900528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] The token cache is being invalidate because project 25fece1760704d84afe2362221799643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:09.900843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.901641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:09.904547 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2120/4213] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:09 2022] DELETE /identity/v3/projects/25fece1760704d84afe2362221799643 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:09.907543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:09.910145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:09.945830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529272-08be-468c-9e23-4a1af0fa7f61 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.015985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912aee-f65f-4fcf-bd46-f5887f7ddf05 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.022356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.023279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.023595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.023892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] PATH_INFO: `/v3/users/aad8d98f78254b339ca6d3014f481b66` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.025453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad8d98f78254b339ca6d3014f481b66)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.027705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.035887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:10.047462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.048626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.048900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.049219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.052058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.057374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.092632 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2094/4214] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:09 2022] PUT /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8 => generated 521 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:10.094904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.098751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:10.128474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad8d98f78254b339ca6d3014f481b66'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.138338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad8d98f78254b339ca6d3014f481b66'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.139977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad8d98f78254b339ca6d3014f481b66'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.140746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad8d98f78254b339ca6d3014f481b66'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.161462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad8d98f78254b339ca6d3014f481b66'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.196960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be1b8-9bcc-4b04-8eb8-221b5c2af962 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.201826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2121/4215] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:09 2022] DELETE /identity/v3/users/aad8d98f78254b339ca6d3014f481b66 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:10.281220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.282544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.282544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.282544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.295197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=73f1e75fd4234345aac6b881f6e516a8, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.296931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.335206 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2095/4216] 10.222.0.18 () {60 vars in 1362 bytes} [Sat Jun 4 21:04:10 2022] PUT /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a => generated 520 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:10.339419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.340945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:10.360225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724123-a9d4-4f92-aef7-126d3a7aebf5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.382300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:10.448307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.449295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.449637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.449975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.451351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.452433 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:10.452433 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:10.452433 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:10.453331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.463541 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2122/4217] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:04:10 2022] GET /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies => generated 489 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:10.465740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.477461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250d98-9f19-42b3-98e8-db8f62b413c6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.489211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.490227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.490546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.490849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.492194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.493370 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:10.493370 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:10.493370 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:10.494357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.503317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2096/4218] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:04:10 2022] GET /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies => generated 661 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:10.509707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.531767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3708-e308-4472-9230-92133704b920 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.538337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.540646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.541016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.541407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.544291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=73f1e75fd4234345aac6b881f6e516a8, implied_role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.546585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.560312 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2123/4219] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:10 2022] DELETE /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8/implies/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:10.564986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.578853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659820bc-8d44-4c85-8797-bfac0cbb856d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.609314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.611443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:10.659253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:10.680844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.683225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.683631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.683990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.686236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.688365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.702333 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2097/4220] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:10 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/73f1e75fd4234345aac6b881f6e516a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:10.706568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.727542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c906bed-aeba-4300-a431-f07b467578f3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.787356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d18c-6691-4ae7-bb4b-92f83ee1cf36 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.793134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.794077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.794366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.794493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:10.795242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.795689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.796104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.796442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] PATH_INFO: `/v3/projects/4138297ed1464b5e8bc443847a6e074c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.797236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0e161825dc824fd5a92e2e08f4dd1d5e, implied_role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.797804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4138297ed1464b5e8bc443847a6e074c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:10.799243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.800114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:10.816098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2098/4221] 10.222.0.18 () {58 vars in 1346 bytes} [Sat Jun 4 21:04:10 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e/implies/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:10.817101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:10.862508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4138297ed1464b5e8bc443847a6e074c', 'request_id': 'req-ce1f9f4b-52df-4e03-a524-bed83b8225f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.864766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:10.878173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4138297ed1464b5e8bc443847a6e074c', 'request_id': 'req-ce1f9f4b-52df-4e03-a524-bed83b8225f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.888327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4138297ed1464b5e8bc443847a6e074c', 'request_id': 'req-ce1f9f4b-52df-4e03-a524-bed83b8225f9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.903037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb062-f7b3-4f66-8b00-f0081dd2143a tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:10.907431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] The token cache is being invalidate because project 4138297ed1464b5e8bc443847a6e074c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:10.908077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.909660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce1f9f4b-52df-4e03-a524-bed83b8225f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:10.911544 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2124/4222] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:10 2022] DELETE /identity/v3/projects/4138297ed1464b5e8bc443847a6e074c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:10.918293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8d44-21cc-459e-886d-5a48443e5c6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:10.918549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8d44-21cc-459e-886d-5a48443e5c6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:10.918826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8d44-21cc-459e-886d-5a48443e5c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:10.947389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ff8d8d44-21cc-459e-886d-5a48443e5c6b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:10.948647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ff8d8d44-21cc-459e-886d-5a48443e5c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.019693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.022249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.022603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.022946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/86cd3f32873049daae842cea3ba154ff` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.037259 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2125/4223] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:11.038924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:04:11.046336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.046638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.046923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Could not find domain: 86cd3f32873049daae842cea3ba154ff.: keystone.exception.DomainNotFound: Could not find domain: 86cd3f32873049daae842cea3ba154ff. Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 86cd3f32873049daae842cea3ba154ff. Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:11.051906 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:11.053225 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 86cd3f32873049daae842cea3ba154ff. Jun 04 21:04:11.054528 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:11.057070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2099/4224] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:04:10 2022] PATCH /identity/v3/domains/86cd3f32873049daae842cea3ba154ff => generated 112 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:04:11.058364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.060278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.071923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:11.073206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.076093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e22924-b7d9-401b-a27c-2ded9f38a6ad tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.084764 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2126/4225] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:11.089144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.090139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.090447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.090727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/users/8dcb2918305a47dfb514124667e5b053` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.092438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8dcb2918305a47dfb514124667e5b053)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.092760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.094978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.106178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ceee7-6a64-45f9-8fe3-457c3c84931c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.111826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.112565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.112875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.113154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.113869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:11.114173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.116000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.134064 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2127/4226] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:11.139258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.154555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6846-7235-4ae3-aec5-e9a7e8ff40b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.159277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:11.161953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.162887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.163408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.163831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.164602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.168149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.201929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.203554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.205104 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2128/4227] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:11 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:11.210503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.212790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.219336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.220839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.253878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcb2918305a47dfb514124667e5b053'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.279690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2100/4228] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:11 2022] DELETE /identity/v3/users/8dcb2918305a47dfb514124667e5b053 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:11.284309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.286760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.310232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ccd52-72da-40f0-bd9f-388e2d7b6e25 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.377127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9638e5-681d-48d6-b076-04af284ba6d2 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.384244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.386682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.387030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.387397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/7462a7ebe2684129b9979a330f47513a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.389767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7462a7ebe2684129b9979a330f47513a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.390681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:11.393030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.422933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.424105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.425115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.425258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.426491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.429886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.456907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 7462a7ebe2684129b9979a330f47513a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:11.457317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.458331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2129/4229] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:11 2022] POST /identity/v3/users => generated 278 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:11.459065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:11.462959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.464165 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2101/4230] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:11 2022] DELETE /identity/v3/roles/7462a7ebe2684129b9979a330f47513a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:11.465386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.468011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.469843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.485257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d221-1455-4ffb-a5b2-36d1ff717f30 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.566193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.567002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.567491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.567860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.569297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.569571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3b18-a548-424a-af56-d575883120c3 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.571403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.584441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.585929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.586334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.586691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/groups/c736786126ef48c0a9e6e9517120267c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.588492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2130/4231] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:11 2022] GET /identity/v3/roles => generated 2098 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:11.595305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c736786126ef48c0a9e6e9517120267c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.596303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.598234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.609178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb486b-3a25-4312-bf82-e00155a578de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.621122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:11.621681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.621681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.621681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.621681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.622034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.622549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.639120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2131/4232] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:11 2022] GET /identity/v3/roles => generated 2098 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:11.644441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.658987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc607-dada-46e5-b44f-a413bd31c1fd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.666425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.667461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.667847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.668356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] PATH_INFO: `/v3/projects/d10d6a3415e8483aa755dbec66bd4555/users/52a2e1a0e2b145068ca12fc916400aae/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.674967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2102/4233] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:04:11 2022] DELETE /identity/v3/groups/c736786126ef48c0a9e6e9517120267c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:11.679975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.687801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10d6a3415e8483aa755dbec66bd4555, user_id=52a2e1a0e2b145068ca12fc916400aae, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.692195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1206d9-e433-441b-a010-8548e4612a03 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.711268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2132/4234] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:11 2022] PUT /identity/v3/projects/d10d6a3415e8483aa755dbec66bd4555/users/52a2e1a0e2b145068ca12fc916400aae/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:11.725094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.725448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.726006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.761599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] MFA Rules not processed for user `52a2e1a0e2b145068ca12fc916400aae`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:11.763026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:11.786476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0354-1e29-4b3c-a324-d0533c21286d tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.869677 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2133/4235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:11.874541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:11.878913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:11.884404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:11.884684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:11.884975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/projects/66c4d330b065400591252ecbeafcbc46` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:11.887257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66c4d330b065400591252ecbeafcbc46)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:11.890297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:11.915614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:11.978291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612b69a-0dfc-4576-bbdb-c2438b309690 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:11.995203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c4d330b065400591252ecbeafcbc46', 'request_id': 'req-716d630c-6f71-4951-9ec2-cd62a6121e2e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.003723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c4d330b065400591252ecbeafcbc46', 'request_id': 'req-716d630c-6f71-4951-9ec2-cd62a6121e2e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.012808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c4d330b065400591252ecbeafcbc46', 'request_id': 'req-716d630c-6f71-4951-9ec2-cd62a6121e2e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.038498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] The token cache is being invalidate because project 66c4d330b065400591252ecbeafcbc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:12.038884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.039797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.041839 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2103/4236] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:11 2022] DELETE /identity/v3/projects/66c4d330b065400591252ecbeafcbc46 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:12.045951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.047879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.055307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:12.068821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.069660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.070039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.070476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.071415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.073934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.113418 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2134/4237] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:11 2022] POST /identity/v3/projects => generated 357 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:12.119458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.122102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.158413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d630c-6f71-4951-9ec2-cd62a6121e2e tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.219794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38668-e413-4548-9afe-282eb887d4de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.229792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.230570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.230852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.231150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.231948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.236695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.237345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.239163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.239911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.240319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.241944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.244314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.275456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.277391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.305255 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2135/4238] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:12 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:12.305255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.305255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.324768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ee9d6-5bd4-4d36-a6be-32e798d22fdb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.331662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.333410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.338104 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2104/4239] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:04:12 2022] PATCH /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea => generated 277 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:12.342362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.344335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.437698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:12.467428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.468378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.468964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.469259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.470420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.473314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6677-f6e4-4ab1-aab5-6cb245d0a715 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.476189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2931ea-38e9-4938-8f28-71b1ecb11c40 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.483228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.484491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.484880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.485262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.487566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2136/4240] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:12 2022] GET /identity/v3/roles => generated 2098 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:12.489216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.489516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.489844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.511738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3dc9135bcf1841b3805b6aaa6c6386ea)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.512820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:12.513858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.514285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.527501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:12.541495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.545184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.577014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2137/4241] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:12.578546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.580121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.601951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca8c3-d37b-499e-ba5c-8b214cf75340 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.605203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.612920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.618914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.636049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] The token cache is being invalidate because project 3dc9135bcf1841b3805b6aaa6c6386ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:12.636448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.637216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.645999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.647099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.647803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3dc9135bcf1841b3805b6aaa6c6386ea', 'request_id': 'req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.657623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2105/4242] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:12 2022] DELETE /identity/v3/domains/3dc9135bcf1841b3805b6aaa6c6386ea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:12.658755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.660921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.678257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.679633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.680073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.680919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] PATH_INFO: `/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e/users/c1ac2cac89644364bdcc974972ed093e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.700809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc9a4ade2ee40f9a4437c49cb2a984e, user_id=c1ac2cac89644364bdcc974972ed093e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.703482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.725435 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2138/4243] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:12 2022] PUT /identity/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e/users/c1ac2cac89644364bdcc974972ed093e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:12.726707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.728693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.746658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fba64d-f2af-4e49-8b2c-77a28e8cf5f4 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.844225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:12.863176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad5b42-cf9c-4294-a0ec-89ab2eb89f69 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:12.868146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.869846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.870137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.870439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.871169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:12.873220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:12.873598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.874031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:12.874483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/73f1e75fd4234345aac6b881f6e516a8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:12.876996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_role(role_id=73f1e75fd4234345aac6b881f6e516a8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.879682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.900406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:12.939611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 73f1e75fd4234345aac6b881f6e516a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:12.940265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.942179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:12.944738 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2139/4244] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:12 2022] DELETE /identity/v3/roles/73f1e75fd4234345aac6b881f6e516a8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:12.945738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.947931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:12.954498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:12.958342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:12.969130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2106/4245] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:12.970377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:12.995956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa398d1e-dd3a-4c50-8b92-908aa8827d63 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.069688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f573-d86c-4e01-beb9-37649997b015 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.087696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.088432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.088710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.089872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.090204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.092252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.093640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.094665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.094927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.095205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/cb2944c3616f4b61b6cb111f4f3c19d8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.098898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cb2944c3616f4b61b6cb111f4f3c19d8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.101597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.109065 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2140/4246] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:12 2022] GET /identity/v3/roles => generated 1872 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:13.114302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.130608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb5ab-1f20-42d9-8425-85e8e8197494 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.138992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.140414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.140766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.141029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] PATH_INFO: `/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e/users/c1ac2cac89644364bdcc974972ed093e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.143354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc9a4ade2ee40f9a4437c49cb2a984e, user_id=c1ac2cac89644364bdcc974972ed093e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.147007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e791b2-f780-48ca-a118-89818ba46dd3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.162972 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2141/4247] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:13 2022] PUT /identity/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e/users/c1ac2cac89644364bdcc974972ed093e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:13.172968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role cb2944c3616f4b61b6cb111f4f3c19d8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:13.172968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.172968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.175005 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2107/4248] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:12 2022] DELETE /identity/v3/roles/cb2944c3616f4b61b6cb111f4f3c19d8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:13.176470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.176759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.177036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.180045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.181573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.213491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] MFA Rules not processed for user `c1ac2cac89644364bdcc974972ed093e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:13.215001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.274783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00464-5e4d-4940-88c5-818b56cd3df6 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.282674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '905549c751b842d398c5a3260dc2016c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b364611f4d4143d3a487026d1d97e8ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.284897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.285477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.285918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] PATH_INFO: `/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.287538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0e161825dc824fd5a92e2e08f4dd1d5e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.289330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.295874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:13.307672 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2142/4249] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:13.312832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.326749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612ebe1-b979-4200-b025-77162ff1b514 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.333033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ac2cac89644364bdcc974972ed093e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.334177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.334648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.335061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.335928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:13.336309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.337212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invalidating the token cache because role 0e161825dc824fd5a92e2e08f4dd1d5e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:13.337746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.338044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.340363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.343566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2108/4250] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:13 2022] DELETE /identity/v3/roles/0e161825dc824fd5a92e2e08f4dd1d5e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:13.348363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.352193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.359662 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2143/4251] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:13.366234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.369245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.401119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d2d-be6c-4f98-b562-678630051441 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.449688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:13.481598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ccca-87a2-436a-84a0-a66bb3c81e50 tempest-RolesV3TestJSON-1753767196 tempest-RolesV3TestJSON-1753767196-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.488432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.489947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.490332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.490708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] PATH_INFO: `/v3/users/6431b1500a8c4013ba33b4c20dd56187` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.492399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6431b1500a8c4013ba33b4c20dd56187)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.494849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.525922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ac2cac89644364bdcc974972ed093e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.526767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.527568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.527568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.528483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.530922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411d0cb-9bfd-4023-9b13-1118cb6795ba tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.560658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6431b1500a8c4013ba33b4c20dd56187'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.562025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6431b1500a8c4013ba33b4c20dd56187'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.575172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6431b1500a8c4013ba33b4c20dd56187'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.575716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2144/4252] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:13 2022] POST /identity/v3/projects => generated 349 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:13.576017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6431b1500a8c4013ba33b4c20dd56187'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.580274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7513e-f026-4a36-8e41-4f15302ca385 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.581477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7513e-f026-4a36-8e41-4f15302ca385 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.581726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7513e-f026-4a36-8e41-4f15302ca385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.607214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-97f7513e-f026-4a36-8e41-4f15302ca385 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:13.608742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-97f7513e-f026-4a36-8e41-4f15302ca385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.612559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6431b1500a8c4013ba33b4c20dd56187'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:13.635207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2109/4253] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:13 2022] DELETE /identity/v3/users/6431b1500a8c4013ba33b4c20dd56187 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:13.639067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.639067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.685582 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2145/4254] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:13.693908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.694230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.694491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.697458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:13.719048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64556-ab7c-4d53-a0da-b7802671f49e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.720797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:13.721980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.726083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ac2cac89644364bdcc974972ed093e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.726759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.727042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.727356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.728323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:13.728616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.730232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.743426 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2110/4255] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:13.744391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.746221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.808768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2146/4256] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:13.809946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.820121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:13.846686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c36a8-1d9f-40a0-8a31-d01c41c595c3 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.853291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.853936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.854267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.854576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.904092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d55ea-a7a9-4db5-8859-e09f4762c8d5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.908993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.910567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.910840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.911161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.922244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.923789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.923898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.926508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.935812 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2147/4257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:13.937908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2111/4258] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:13.938802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:13.951471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af74b-f38a-4c0c-b881-dec0d80eb362 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:13.957319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:13.958236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:13.958576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:13.958848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:13.972434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:13.974643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:13.994030 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2112/4259] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:14.144956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:14.152237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:14.166388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61286e42-13c7-48f7-9322-0bf1d8e66252 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:14.173538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1ac2cac89644364bdcc974972ed093e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:14.177127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:14.177720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:14.178167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] PATH_INFO: `/v3/projects/78477608f3b04562ba18d8e94fb32aec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:14.180745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78477608f3b04562ba18d8e94fb32aec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:14.183373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:14.297049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78477608f3b04562ba18d8e94fb32aec', 'request_id': 'req-1361341c-1137-4c9a-9895-8ccf53c0e311'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.316998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78477608f3b04562ba18d8e94fb32aec', 'request_id': 'req-1361341c-1137-4c9a-9895-8ccf53c0e311'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.332775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78477608f3b04562ba18d8e94fb32aec', 'request_id': 'req-1361341c-1137-4c9a-9895-8ccf53c0e311'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.357701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] The token cache is being invalidate because project 78477608f3b04562ba18d8e94fb32aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:14.357701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.384179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1361341c-1137-4c9a-9895-8ccf53c0e311 tempest-QuotasTest-1715326452 tempest-QuotasTest-1715326452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.387670 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2148/4260] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:14 2022] DELETE /identity/v3/projects/78477608f3b04562ba18d8e94fb32aec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:14.422410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:14.423902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:14.450322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc61e4c-b7cc-437f-8274-aaa51fe01ba9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:14.555060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:14.555387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:14.555804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:14.584223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:14.585512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:14.601218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:14.602214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:14.602484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:14.602763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] PATH_INFO: `/v3/projects/05e1b681b03f4f1ab2009307236e04b5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:14.604031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e1b681b03f4f1ab2009307236e04b5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:14.606942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:14.625273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:14.679146 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2149/4261] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:14.685078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:14.689187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:14.705202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e1b681b03f4f1ab2009307236e04b5', 'request_id': 'req-0d09b40a-79d8-4a5f-9d9d-e097612a275e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.716038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e1b681b03f4f1ab2009307236e04b5', 'request_id': 'req-0d09b40a-79d8-4a5f-9d9d-e097612a275e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.716985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ca06-f316-485d-8591-1c13b607ba81 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:14.726811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e1b681b03f4f1ab2009307236e04b5', 'request_id': 'req-0d09b40a-79d8-4a5f-9d9d-e097612a275e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.747964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] The token cache is being invalidate because project 05e1b681b03f4f1ab2009307236e04b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:14.748335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.749230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.751346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2113/4262] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:14 2022] DELETE /identity/v3/projects/05e1b681b03f4f1ab2009307236e04b5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:14.752254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:14.753973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:14.805548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:14.806609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:14.806983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:14.808047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] PATH_INFO: `/v3/users/52a2e1a0e2b145068ca12fc916400aae` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:14.809589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a2e1a0e2b145068ca12fc916400aae)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:14.811657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:14.884293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:14.900110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a2e1a0e2b145068ca12fc916400aae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.911340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a2e1a0e2b145068ca12fc916400aae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.912372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a2e1a0e2b145068ca12fc916400aae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.913164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a2e1a0e2b145068ca12fc916400aae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.919387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b40a-79d8-4a5f-9d9d-e097612a275e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:14.931839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a2e1a0e2b145068ca12fc916400aae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:14.934911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:14.936248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:14.936589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:14.937749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:14.941847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:14.950937 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2150/4263] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:14 2022] DELETE /identity/v3/users/52a2e1a0e2b145068ca12fc916400aae => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:14.953749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:14.957239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.058552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1ac89-7d57-4f83-b9db-5836ce26a61e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:15.066824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:15.067804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.068186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.068596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] PATH_INFO: `/v3/users/905549c751b842d398c5a3260dc2016c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.070184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=905549c751b842d398c5a3260dc2016c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:15.072495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:15.106775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:15.111827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d106c3d-c4e0-426c-89bc-be8adfa78356 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:15.137972 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2114/4264] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:15.145066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.145366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.145659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.157269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905549c751b842d398c5a3260dc2016c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.166522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905549c751b842d398c5a3260dc2016c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.167389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905549c751b842d398c5a3260dc2016c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.168547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905549c751b842d398c5a3260dc2016c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.193747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905549c751b842d398c5a3260dc2016c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.204500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:15.216065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.234638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2151/4265] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:14 2022] DELETE /identity/v3/users/905549c751b842d398c5a3260dc2016c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:15.237388 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2115/4266] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:15.258243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:15.262374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.344331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:15.408702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c9298-0b09-4171-9a5d-92540eeeffaf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:15.414213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:15.415200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.415791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.415976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.536015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:15.537648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10aae63-d1ad-4032-9c44-59335db21408 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:15.557132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2152/4267] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:15.670509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:15.672344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.690767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbad71-5c3e-4198-b364-751437406ba8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:15.703533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:15.706000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.706745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.707256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] PATH_INFO: `/v3/projects/b364611f4d4143d3a487026d1d97e8ff` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.719547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364611f4d4143d3a487026d1d97e8ff)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:15.726120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:15.792436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:15.810944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364611f4d4143d3a487026d1d97e8ff', 'request_id': 'req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.819174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364611f4d4143d3a487026d1d97e8ff', 'request_id': 'req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.827340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364611f4d4143d3a487026d1d97e8ff', 'request_id': 'req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.848650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] The token cache is being invalidate because project b364611f4d4143d3a487026d1d97e8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:15.849610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.850296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5c5efb2f-8f6c-4538-8cb8-18cf3c91e6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:15.852017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2116/4268] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:15 2022] DELETE /identity/v3/projects/b364611f4d4143d3a487026d1d97e8ff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:15.857411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.857748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.858066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.879121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:15.880384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.960044 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2153/4269] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:15.962365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:15.962663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:15.962958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:15.984580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:15.985833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:15.994978 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2117/4270] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:15.999297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.010096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e54e44-a10b-476a-bad6-804c9b5794a5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.015360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.016700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.016700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.016700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.017369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:16.017726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.019399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.033456 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2154/4271] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:16.038133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.047990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460aa9f9-7ab0-4ad3-93fa-b6c1fa7b7413 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.053624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.054746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.054746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.055141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.055972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.057940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.090500 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2118/4272] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:16 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:16.094630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.108036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a34c94-e190-4ac3-8a15-874186b49ad3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.178962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.179259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.179564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.179898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.180597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.182612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.198791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:16.212869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.215985 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2155/4273] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:16 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:16.227377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828bf3-e858-4005-94b5-88365035f470 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.236038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.236738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.237024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.237503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.238260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.246085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.273433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2119/4274] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:16.289703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.307547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e3bf-fff2-4cb0-8924-29c342ef4607 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.324048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.327695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.327695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.327695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.329558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.337998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d825e-6a5a-4c2b-8cec-096d2a814bd6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.382560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2156/4275] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:16.387713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.409127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0002af-691d-415f-8544-7e9e27452616 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.419845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.422224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.422565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.422965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] PATH_INFO: `/v3/projects/7be15134ec8348b6a5760ab8c2061e95/users/f4961f3a138646cb9aa71bfea7506812/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.456888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be15134ec8348b6a5760ab8c2061e95, user_id=f4961f3a138646cb9aa71bfea7506812, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.460689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.506992 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2120/4276] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:16 2022] PUT /identity/v3/projects/7be15134ec8348b6a5760ab8c2061e95/users/f4961f3a138646cb9aa71bfea7506812/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:16.509073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.509265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.509547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.523368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.529109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:16.616767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] MFA Rules not processed for user `f4961f3a138646cb9aa71bfea7506812`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:16.618129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:16.656849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf6c3-c487-4116-8c8e-20c30f513568 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.664037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.666273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.666760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.667102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] PATH_INFO: `/v3/projects/d10d6a3415e8483aa755dbec66bd4555` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.668888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10d6a3415e8483aa755dbec66bd4555)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.671940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.736873 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2157/4277] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:16.738174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.775029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3249200-3cfb-4543-baf4-704cfa2d7f59 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:16.780342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10d6a3415e8483aa755dbec66bd4555', 'request_id': 'req-161e0a67-366b-47a6-98ca-b3ae6d33fd43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:16.795080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10d6a3415e8483aa755dbec66bd4555', 'request_id': 'req-161e0a67-366b-47a6-98ca-b3ae6d33fd43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:16.800511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:16.807246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10d6a3415e8483aa755dbec66bd4555', 'request_id': 'req-161e0a67-366b-47a6-98ca-b3ae6d33fd43'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:16.845141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] The token cache is being invalidate because project d10d6a3415e8483aa755dbec66bd4555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:16.851869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:16.853727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:16.861508 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2121/4278] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:16 2022] DELETE /identity/v3/projects/d10d6a3415e8483aa755dbec66bd4555 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:16.864967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.867983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:16.928002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:16.929776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:16.930452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:16.931011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:16.933343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:16.936586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:16.992186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2158/4279] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:16 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:16.993870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:16.995681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.010791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e0a67-366b-47a6-98ca-b3ae6d33fd43 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.121760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.122731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.123324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.123324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] PATH_INFO: `/v3/users/c1ac2cac89644364bdcc974972ed093e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.124932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ac2cac89644364bdcc974972ed093e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.127034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.152451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255f8f9-2896-4d71-b057-daf1ad318043 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.158995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.160403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.161171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.161635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.162832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.165478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.177578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:17.205975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2159/4280] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:16 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:17.212560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.220025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ac2cac89644364bdcc974972ed093e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:17.220953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ac2cac89644364bdcc974972ed093e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:17.234385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ac2cac89644364bdcc974972ed093e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:17.234812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db904b-beb5-4f46-b328-34b2dabd9317 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.235346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ac2cac89644364bdcc974972ed093e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:17.244094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.245655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.246110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.246474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.247376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.250174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.269419 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2160/4281] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:17.269419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.270817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.288632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ac2cac89644364bdcc974972ed093e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:17.311612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2122/4282] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:16 2022] DELETE /identity/v3/users/c1ac2cac89644364bdcc974972ed093e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:17.324831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.326517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.344478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:17.385485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3a258-aab7-4dd7-9820-e4ab0a29e33b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.435394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69df734-d161-41c8-902c-2eda03578418 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.441954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.443008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.443291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.443847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] PATH_INFO: `/v3/projects/1cf907a59c6c43c984e831c816a6c753/users/7425c7535238404982655747e395757f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.463013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf907a59c6c43c984e831c816a6c753, user_id=7425c7535238404982655747e395757f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.466327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.487692 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2123/4283] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:17 2022] PUT /identity/v3/projects/1cf907a59c6c43c984e831c816a6c753/users/7425c7535238404982655747e395757f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:17.490761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.510311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.511163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.511444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.511954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.514452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.590505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef88cb-4c80-40cc-90d3-ae6d50e2e81d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.597526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.599058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.599617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.599997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.600791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.602718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.616793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2124/4284] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:17.621334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.634853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb0739-8554-4166-93f9-2c2a42c58b83 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.641261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.642166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.642494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.642775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] PATH_INFO: `/v3/projects/1cf907a59c6c43c984e831c816a6c753/users/7425c7535238404982655747e395757f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.645137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf907a59c6c43c984e831c816a6c753, user_id=7425c7535238404982655747e395757f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.648248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.650707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.652811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01664d-a670-4d46-ac9b-d8b75823d8a3 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.668359 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2161/4285] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:17.669027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2125/4286] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:17 2022] PUT /identity/v3/projects/1cf907a59c6c43c984e831c816a6c753/users/7425c7535238404982655747e395757f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:17.681379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.681754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.682109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.696587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:17.719646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] MFA Rules not processed for user `7425c7535238404982655747e395757f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:17.721105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.855275 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2162/4287] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:17.860266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.875560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547bd48-1117-469a-ba1b-7cb7b328ca6d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.882500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.884495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:17.895553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.896816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.898463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.899038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.902148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.903735 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:17.903735 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:17.903735 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:17.906787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:17.929226 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2126/4288] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:04:17 2022] POST /identity/v3/services => generated 240 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:17.934017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:17.972031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca02ea-f957-4a3f-a9a0-55adaca8702b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:17.978548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:17.979695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:17.980320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:17.980455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/5166535023ba47b399b8d20bb68476e6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:17.981337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5166535023ba47b399b8d20bb68476e6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:17.982920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.003721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7d09-3833-42dd-9e12-4ad08cef9aa7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.020824 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2127/4289] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:17 2022] DELETE /identity/v3/services/5166535023ba47b399b8d20bb68476e6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:18.022364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.028185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.029981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.030370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.030802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] PATH_INFO: `/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.032279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc9a4ade2ee40f9a4437c49cb2a984e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.034999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.050431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0001-81f9-4af5-9b74-de8c4ed5887d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.055625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.056409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.056802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.057176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.058437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.060285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.085755 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2128/4290] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/services => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:18.091149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.111490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:18.130164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad0535-d4fc-45ea-866f-1f4495e92dd6 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.137355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.139467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.140016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.140450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/18790c2c2522422bb3d7d54cd362d789` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.142086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:update_service(service_id=18790c2c2522422bb3d7d54cd362d789)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.144266 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:18.144266 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:18.144266 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:18.146366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.174380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2129/4291] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:04:18 2022] PATCH /identity/v3/services/18790c2c2522422bb3d7d54cd362d789 => generated 280 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.179000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.213390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffe67-bd6e-4c6a-87d1-5913dd308e8e tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.221976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.225535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.226059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.226507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/18790c2c2522422bb3d7d54cd362d789` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.228610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:get_service(service_id=18790c2c2522422bb3d7d54cd362d789)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.230608 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:18.230608 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:18.230608 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:18.232010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.239891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2130/4292] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services/18790c2c2522422bb3d7d54cd362d789 => generated 280 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.243957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.257202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0323c9-3e5e-4666-9173-51bda54e7fb1 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.264857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'request_id': 'req-64252fb3-1327-4af7-b797-a2f04e90b960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:18.279084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'request_id': 'req-64252fb3-1327-4af7-b797-a2f04e90b960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:18.288009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc9a4ade2ee40f9a4437c49cb2a984e', 'request_id': 'req-64252fb3-1327-4af7-b797-a2f04e90b960'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:18.309317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] The token cache is being invalidate because project bdc9a4ade2ee40f9a4437c49cb2a984e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:18.310939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:18.310939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64252fb3-1327-4af7-b797-a2f04e90b960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:18.318959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2163/4293] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:17 2022] DELETE /identity/v3/projects/bdc9a4ade2ee40f9a4437c49cb2a984e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:18.321229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465980c-b01d-4618-99d6-856903fa218d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.321229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465980c-b01d-4618-99d6-856903fa218d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.321808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465980c-b01d-4618-99d6-856903fa218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.351556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7465980c-b01d-4618-99d6-856903fa218d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:18.352984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7465980c-b01d-4618-99d6-856903fa218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:18.366939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:18.372878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.374206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.374830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.375249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/18790c2c2522422bb3d7d54cd362d789` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.376393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:delete_service(service_id=18790c2c2522422bb3d7d54cd362d789)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.379100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.408054 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2131/4294] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:18 2022] DELETE /identity/v3/services/18790c2c2522422bb3d7d54cd362d789 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:18.413177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.417273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:18.453837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504baf5d-5df1-40f6-b118-c1679ae54afd tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.461374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.462394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.462808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.463191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/18790c2c2522422bb3d7d54cd362d789` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.464041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:get_service(service_id=18790c2c2522422bb3d7d54cd362d789)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.466088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-b9d56f41-0f09-4a30-acd8-bdee7d5e112a tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Could not find service: 18790c2c2522422bb3d7d54cd362d789.: keystone.exception.ServiceNotFound: Could not find service: 18790c2c2522422bb3d7d54cd362d789. Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 18790c2c2522422bb3d7d54cd362d789. Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:18.483292 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:04:18.484725 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 18790c2c2522422bb3d7d54cd362d789. Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:18.485754 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2132/4295] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services/18790c2c2522422bb3d7d54cd362d789 => generated 113 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:04:18.490585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2164/4296] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:18.491132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.491132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.491362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.491638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465980c-b01d-4618-99d6-856903fa218d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.504838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465980c-b01d-4618-99d6-856903fa218d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.510239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.511182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.511477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.511762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.512624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.514421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.517122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:18.519855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:18.534333 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2133/4297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:18.538833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.539741 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2165/4298] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/services => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:18.543996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.552618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2065fe-9240-4b3a-9244-bc8b3efed1a9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.573117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397fa40-9a22-4134-ae1f-06f6e8b803f7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.574663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.575570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.575896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.576266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.577089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:18.577563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.579297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.582199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.583766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.584344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.584852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.585777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.588466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.593865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2134/4299] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.598986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.613619 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2166/4300] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/services => generated 274 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:18.615197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d5e8-52f6-4f53-b0f8-fcf3b27965b7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.618126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.640750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.642122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.642711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.643224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.644354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.646709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.666598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7298cc4-bfb7-493d-bea5-3436bdfc007c tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.672295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.672980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.673332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.673679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.674512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.677155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.693810 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2135/4301] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:18.698739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.704352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2167/4302] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/services => generated 274 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:18.709317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.738759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009575f7-334a-4474-9547-c4fd81f1f41f tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.759835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:18.806904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef780da-29fb-4bc0-8103-2ece67609853 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.834032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.834920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.835066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.835193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.835469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.836120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.836488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.836606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.836881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.837763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.838994 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:18.838994 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:18.838994 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:18.840231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.841093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.854911 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2168/4303] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services => generated 2978 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:18.856750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.872996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4878-069e-4a52-8aad-07be7342a7d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.879866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.880567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2136/4304] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:18 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:18.884305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.884798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.885214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.885853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.886196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1830969936) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:18.886717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.888647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.899295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2169/4305] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1830969936 => generated 418 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.900418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.902546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65680928-3522-426d-a838-dfdb48620797 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.911624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.911884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc749bc-7f9b-4d47-8930-34252501d119 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.912000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.912547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.913093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.914274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.917526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.919490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.920554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.920974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.921427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.922293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2077431223) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:18.922767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.924979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.933386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2137/4306] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:18.936328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2170/4307] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2077431223 => generated 417 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.938950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.939110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.953413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31213b5d-d148-4da8-b1a1-a63cf134a41b tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.962190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.962781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd6b5c-cf67-4836-a52d-88495e1b0f02 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:18.963259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.963477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.963787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.964994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2133876429) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:18.965156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.967061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:18.974751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2171/4308] 10.222.0.18 () {58 vars in 1221 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2133876429 => generated 417 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:18.977063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:18.978635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:18.979129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:18.979890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:18.980016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:18.981199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:18.998196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d89ec-e76b-4253-8a51-5a8f3999b9d4 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.001089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.005940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.006896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.019790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.020194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/ab3fda71fd8d464b9a66eb500815bb94` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.021091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ab3fda71fd8d464b9a66eb500815bb94)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.023794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.033543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:19.036721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2138/4309] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:19.040593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.054122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b071f-720b-49b1-82d5-440f8ba41469 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.061602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2172/4310] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:18 2022] DELETE /identity/v3/services/ab3fda71fd8d464b9a66eb500815bb94 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.066742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.079977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.081783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.082114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.082334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] PATH_INFO: `/v3/projects/ffc82ce7885b4554a061d77fd7ef3704/users/58e3b0cf7b4448ffa60ad4c9d9d36c37/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.105404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc82ce7885b4554a061d77fd7ef3704, user_id=58e3b0cf7b4448ffa60ad4c9d9d36c37, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.109396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e3b8-684b-4246-9bb5-cbd1afce88ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.131708 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2139/4311] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:19 2022] PUT /identity/v3/projects/ffc82ce7885b4554a061d77fd7ef3704/users/58e3b0cf7b4448ffa60ad4c9d9d36c37/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.137814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24b86-1c75-45d5-8c74-13d04755de9d tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.145419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.145660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.146263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.175191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] MFA Rules not processed for user `58e3b0cf7b4448ffa60ad4c9d9d36c37`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:19.176677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:19.242041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.243917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.244213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.244530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/3f108b432a0a4313b502a63df0f6252e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.245300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3f108b432a0a4313b502a63df0f6252e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.247100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.261614 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2140/4312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3595 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:19.266390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.284253 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2173/4313] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:19 2022] DELETE /identity/v3/services/3f108b432a0a4313b502a63df0f6252e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.291102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.312870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f8c3-6d7b-46fe-a1b1-92168fe881e7 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.324819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7425c7535238404982655747e395757f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cf907a59c6c43c984e831c816a6c753', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.326427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.326684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.326995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] PATH_INFO: `/v3/services/d735f14e724d403bb95a557cbd01bf08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.327872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d735f14e724d403bb95a557cbd01bf08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.330604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.346652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:19.363662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c57d8-368f-4b16-ac62-c2335748e45a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.365525 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2174/4314] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:19 2022] DELETE /identity/v3/services/d735f14e724d403bb95a557cbd01bf08 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.371782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.374103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:19.397110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.397894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.398257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.398443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717211-85fd-4da5-b3c4-3b6c16e1b107 tempest-ServicesTestJSON-679901950 tempest-ServicesTestJSON-679901950-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.398682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.399486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.401491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.403379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.404449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.405145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.405145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] PATH_INFO: `/v3/users/f4961f3a138646cb9aa71bfea7506812` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.406492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4961f3a138646cb9aa71bfea7506812)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.408697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.440640 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2141/4315] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:19.441726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.498752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4961f3a138646cb9aa71bfea7506812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:19.511460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4961f3a138646cb9aa71bfea7506812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:19.512462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4961f3a138646cb9aa71bfea7506812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:19.514303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4961f3a138646cb9aa71bfea7506812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:19.543771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43dd326f-a8b8-429d-ba28-9354e7ccb550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4961f3a138646cb9aa71bfea7506812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:19.560310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:19.566960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013fdc-884c-40f4-9371-a6df72d5cda8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.567830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2175/4316] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:19 2022] DELETE /identity/v3/users/f4961f3a138646cb9aa71bfea7506812 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.573005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.573505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.573924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.616651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:19.618722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:19.656526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.657360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.657798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.658302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.659370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.661424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.699581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2142/4317] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:19 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:19.703249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.706061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:19.712289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2176/4318] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:19.724078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.725799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:19.725979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ae78-ba31-4a19-a9ee-199b42a6b5e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.731980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.732671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.732961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.733411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.734225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.735943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.759704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2143/4319] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:19.760901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.776219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbf20f-ab94-44b1-ad5a-e22480ac966b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.782252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.783339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.783680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.784319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] PATH_INFO: `/v3/projects/01956d3751734843b359711f64578acc/users/568db339b62d40e79e4f4fc9100c2480/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.804110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=01956d3751734843b359711f64578acc, user_id=568db339b62d40e79e4f4fc9100c2480, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.808562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.826161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65642cf7-da82-4274-a444-8a31c7b017cd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.832402 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2144/4320] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:19 2022] PUT /identity/v3/projects/01956d3751734843b359711f64578acc/users/568db339b62d40e79e4f4fc9100c2480/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.836825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.876205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:19.898452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.899168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.899449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.899862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.919767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e04a2-abbd-4f6e-8f58-1b1a8edfe5aa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.925258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.925941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.927152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.927152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.927470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.929111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.940499 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2145/4321] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:19.946257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:19.958411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14650e0-4b84-4ba3-b249-dd84f38f0e00 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:19.963682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:19.964586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.966112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.966112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] PATH_INFO: `/v3/projects/01956d3751734843b359711f64578acc/users/568db339b62d40e79e4f4fc9100c2480/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:19.968242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01956d3751734843b359711f64578acc, user_id=568db339b62d40e79e4f4fc9100c2480, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:19.970905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9830a-91db-4d30-9e18-9e507a330352 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:19.986358 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2146/4322] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:19 2022] PUT /identity/v3/projects/01956d3751734843b359711f64578acc/users/568db339b62d40e79e4f4fc9100c2480/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:19.997166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:19.997525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:19.998053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:20.009778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:20.011614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:20.019331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:20.032714 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2177/4323] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:20.039912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] MFA Rules not processed for user `568db339b62d40e79e4f4fc9100c2480`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:20.041357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:20.150128 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2147/4324] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:20.165297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:20.178168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6888e-648b-4cb1-88d2-f6b053f77ea5 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:20.278831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:20.280940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:20.281300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:20.281967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:20.299369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:20.301216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:20.317625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2178/4325] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:20.515770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:20.517874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:20.743247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d853-e598-419f-9783-6dedaf4b8765 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:20.754059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:20.756086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:20.756599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:20.758087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] PATH_INFO: `/v3/projects/7be15134ec8348b6a5760ab8c2061e95` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:20.761015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be15134ec8348b6a5760ab8c2061e95)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:20.765609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:20.841952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:20.858763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be15134ec8348b6a5760ab8c2061e95', 'request_id': 'req-73dc358b-c16a-4229-8641-1cf793c33d48'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:20.885995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be15134ec8348b6a5760ab8c2061e95', 'request_id': 'req-73dc358b-c16a-4229-8641-1cf793c33d48'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:20.896103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be15134ec8348b6a5760ab8c2061e95', 'request_id': 'req-73dc358b-c16a-4229-8641-1cf793c33d48'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:20.944323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] The token cache is being invalidate because project 7be15134ec8348b6a5760ab8c2061e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:20.945013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:20.945570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:20.950029 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2148/4326] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:20 2022] DELETE /identity/v3/projects/7be15134ec8348b6a5760ab8c2061e95 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:20.953214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:20.981220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a69d-4cdb-441d-ade6-ed928d62b46f service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:21.076118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:21.077057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:21.077341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:21.077693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] PATH_INFO: `/v3/users/7425c7535238404982655747e395757f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:21.080315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7425c7535238404982655747e395757f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:21.082804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:21.172498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7425c7535238404982655747e395757f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:21.182603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7425c7535238404982655747e395757f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:21.183772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7425c7535238404982655747e395757f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:21.184555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7425c7535238404982655747e395757f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:21.202592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-35beff1c-46d9-4230-a4b4-6b698913173d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7425c7535238404982655747e395757f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:21.226599 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2179/4327] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:20 2022] DELETE /identity/v3/users/7425c7535238404982655747e395757f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:22.234413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.235930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:22.262805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc358b-c16a-4229-8641-1cf793c33d48 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.366326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.366536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.366772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.380244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] PATH_INFO: `/v3/projects/1cf907a59c6c43c984e831c816a6c753` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.382702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf907a59c6c43c984e831c816a6c753)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.384686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.470749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf907a59c6c43c984e831c816a6c753', 'request_id': 'req-e0088267-0182-4f63-a00a-3d6fea13eb04'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:22.478767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf907a59c6c43c984e831c816a6c753', 'request_id': 'req-e0088267-0182-4f63-a00a-3d6fea13eb04'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:22.489440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf907a59c6c43c984e831c816a6c753', 'request_id': 'req-e0088267-0182-4f63-a00a-3d6fea13eb04'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:22.516417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] The token cache is being invalidate because project 1cf907a59c6c43c984e831c816a6c753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:22.516725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:22.517427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e0088267-0182-4f63-a00a-3d6fea13eb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:22.519463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2149/4328] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:22 2022] DELETE /identity/v3/projects/1cf907a59c6c43c984e831c816a6c753 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:22.524767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.525429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.525429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.545579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:22.546718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:22.561659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:22.613937 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2180/4329] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:22.622424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.622645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.622932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.643349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:22.644722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:22.653516 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2150/4330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:22.658133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.668331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd9761-ec52-48d9-84fc-47dcb3b672cc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.673138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.673853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.674134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.674587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.675666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:22.675887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.677502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.690383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2181/4331] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:22.695181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.705018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af46dc-1668-40e0-a2b8-b5d29c202ddc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.711468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.712227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.712550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.712841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.713537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.715479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.748016 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2151/4332] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:22 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:22.752485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.778887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc91c0-7f26-4444-b5df-6c646815fe80 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.852843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.853568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.853856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.854133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.854829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.856921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.890697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2182/4333] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:22 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:22.892026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.902807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f3480-9574-4aee-99c8-6d3f67b58c7d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.907473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.908170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.908448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.908721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.909502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.911108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.922126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2152/4334] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:22.926145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.936591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fb0eb-718c-4998-a4e8-a216f78d9d07 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:22.941868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:22.942625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:22.942997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:22.943357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:22.944457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:22.946102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfb320-ba18-42e2-8a1d-20cfc2f5b154 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:22.963629 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2183/4335] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:22.965185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:22.998856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68fb83-e8c6-427d-b948-a1b7b38af4ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.004589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.005563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.005855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.006139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] PATH_INFO: `/v3/projects/ea5a66c05d85412f8d71d7a29c26095e/users/cda78f5d8d5f4538a4adf17222f56cc6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.024656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:23.030140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5a66c05d85412f8d71d7a29c26095e, user_id=cda78f5d8d5f4538a4adf17222f56cc6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.035264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.095234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2153/4336] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:22 2022] PUT /identity/v3/projects/ea5a66c05d85412f8d71d7a29c26095e/users/cda78f5d8d5f4538a4adf17222f56cc6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:23.098229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.098532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.098919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.172665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] MFA Rules not processed for user `cda78f5d8d5f4538a4adf17222f56cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:23.174796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:23.295569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2184/4337] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:23.296929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.318603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.320326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:23.347202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:23.392835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fa241-6a53-469e-a3d8-3048d80ac256 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.400266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.401041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.401366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.401816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.402787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.405064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.407920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69031-6934-444e-8dcb-bdf3902ea5ae None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.412971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.413857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.414175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.414521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] PATH_INFO: `/v3/users/58e3b0cf7b4448ffa60ad4c9d9d36c37` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.415935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e3b0cf7b4448ffa60ad4c9d9d36c37)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.417930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.440086 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2154/4338] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:23 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:23.444472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.540862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e3b0cf7b4448ffa60ad4c9d9d36c37'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:23.549840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e3b0cf7b4448ffa60ad4c9d9d36c37'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:23.550940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e3b0cf7b4448ffa60ad4c9d9d36c37'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:23.551687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e3b0cf7b4448ffa60ad4c9d9d36c37'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:23.569389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70f624c6-c2e7-4922-bd31-61aa828b329f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e3b0cf7b4448ffa60ad4c9d9d36c37'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:23.569968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d95d2-8b82-45de-adbf-52cfadee10a9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.584697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.585777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.586282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.586766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.587595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.590624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2185/4339] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:23 2022] DELETE /identity/v3/users/58e3b0cf7b4448ffa60ad4c9d9d36c37 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:23.593414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.595588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.595945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.596573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.644074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2155/4340] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:23 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:23.645664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:23.648194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:23.648782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.651878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:23.669575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e1f8-e728-44d1-b2c3-472bad431ca8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.740754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2186/4341] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:23.749468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.751833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:23.758530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.759184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.759646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.760030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.760929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.762771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.779027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2156/4342] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:23.784248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.797193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475732b1-1984-4fbc-9e95-5e6b36bdbd34 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.798857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:23.806806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.808224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:23.808834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.809089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.809371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] PATH_INFO: `/v3/projects/c2bdc0415f254cdca6785b5ed07a6103/users/fd58d5436f4a45e2bd66de50b1a62fc6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.832807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bdc0415f254cdca6785b5ed07a6103, user_id=fd58d5436f4a45e2bd66de50b1a62fc6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:23.836158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:23.850665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253b99-958f-471c-8721-c5cc995b3802 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.854573 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2157/4343] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:23 2022] PUT /identity/v3/projects/c2bdc0415f254cdca6785b5ed07a6103/users/fd58d5436f4a45e2bd66de50b1a62fc6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:23.860140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:23.950845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.952602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.952948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.953173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.980375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745251-cda3-4637-9ead-dca6403ef471 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:23.989355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:23.990531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:23.993472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:23.993997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:23.996832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.000582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.015488 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2158/4344] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:24.020555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.037746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab89d2-dccb-4e71-8d74-42a30b84747d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.044665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.045740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.046085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.046542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] PATH_INFO: `/v3/projects/c2bdc0415f254cdca6785b5ed07a6103/users/fd58d5436f4a45e2bd66de50b1a62fc6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.048542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bdc0415f254cdca6785b5ed07a6103, user_id=fd58d5436f4a45e2bd66de50b1a62fc6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.051499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dd0a4-5db4-491a-a811-76240c04fdf6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.052927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.054955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.064989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2159/4345] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:24 2022] PUT /identity/v3/projects/c2bdc0415f254cdca6785b5ed07a6103/users/fd58d5436f4a45e2bd66de50b1a62fc6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:24.072234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2187/4346] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:24.075580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.076066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.076433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.110049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] MFA Rules not processed for user `fd58d5436f4a45e2bd66de50b1a62fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:24.112666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:24.239467 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2160/4347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:24.240801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.383173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971e36-fb1d-406b-98a6-65cc6d81408b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.388535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.389286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.389490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.389764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.390464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.392510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.449702 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2188/4348] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:24 2022] POST /identity/v3/projects => generated 360 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:24.451487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.472321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeafa8-6c3a-488a-bd09-0eb3d7c77ae4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.497721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.500548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:24.567578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:24.575940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:24.597826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.598521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.598869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.599200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.599911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.601832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.621327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8108a-8af3-4480-b246-4a1ea86cb760 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.628750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.629813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.630239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.630381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] PATH_INFO: `/v3/projects/ffc82ce7885b4554a061d77fd7ef3704` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.631902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc82ce7885b4554a061d77fd7ef3704)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.634438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.635551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2161/4349] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:24 2022] POST /identity/v3/users => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:24.647181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.659631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e80af-7ebe-4d50-a3c1-a0a87ca587c3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.666464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.668832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.669170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.669460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/1fea2208566d447a8a1d7be4f2d03c76` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.689094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_user(user_id=1fea2208566d447a8a1d7be4f2d03c76)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.693053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.695210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2162/4350] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:04:24 2022] GET /identity/v3/users/1fea2208566d447a8a1d7be4f2d03c76 => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:24.700456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.704184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc82ce7885b4554a061d77fd7ef3704', 'request_id': 'req-6537762e-14d5-4797-88fa-0e117303efa8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.712335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc82ce7885b4554a061d77fd7ef3704', 'request_id': 'req-6537762e-14d5-4797-88fa-0e117303efa8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.716689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba9cc1-d3ef-49eb-8dab-327be9173b6c tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.719363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc82ce7885b4554a061d77fd7ef3704', 'request_id': 'req-6537762e-14d5-4797-88fa-0e117303efa8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.739284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] The token cache is being invalidate because project ffc82ce7885b4554a061d77fd7ef3704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:24.739624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.740444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.743122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2189/4351] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:24 2022] DELETE /identity/v3/projects/ffc82ce7885b4554a061d77fd7ef3704 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:24.747989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:24.749483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:24.815302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.816484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.816932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.817228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/1fea2208566d447a8a1d7be4f2d03c76` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.823585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1fea2208566d447a8a1d7be4f2d03c76)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.823585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.844920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537762e-14d5-4797-88fa-0e117303efa8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:24.851680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:24.852814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:24.853249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:24.853578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] PATH_INFO: `/v3/users/568db339b62d40e79e4f4fc9100c2480` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:24.855069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568db339b62d40e79e4f4fc9100c2480)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:24.858674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:24.922744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fea2208566d447a8a1d7be4f2d03c76'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.924527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fea2208566d447a8a1d7be4f2d03c76'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.940881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568db339b62d40e79e4f4fc9100c2480'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.942391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fea2208566d447a8a1d7be4f2d03c76'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.943473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fea2208566d447a8a1d7be4f2d03c76'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.969445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fea2208566d447a8a1d7be4f2d03c76'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.985103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568db339b62d40e79e4f4fc9100c2480'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.985933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568db339b62d40e79e4f4fc9100c2480'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.986636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568db339b62d40e79e4f4fc9100c2480'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:24.993932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:25.008636 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2163/4352] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:24 2022] DELETE /identity/v3/users/1fea2208566d447a8a1d7be4f2d03c76 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:25.012974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:25.016796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568db339b62d40e79e4f4fc9100c2480'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.017513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:25.045614 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2190/4353] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:24 2022] DELETE /identity/v3/users/568db339b62d40e79e4f4fc9100c2480 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:25.158636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:25.216738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc90f5e-0029-4e32-ba4a-f731fd3dcae3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:25.326139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:25.327122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.327412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.327820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/18f3b62589cc467e8fe1c18838cdd140` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.329933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18f3b62589cc467e8fe1c18838cdd140)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:25.341638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:25.388200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:25.391494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:25.480201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f3b62589cc467e8fe1c18838cdd140', 'request_id': 'req-0f09b0a1-47bd-41da-b0bf-37ac33846252'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.482243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f3b62589cc467e8fe1c18838cdd140', 'request_id': 'req-0f09b0a1-47bd-41da-b0bf-37ac33846252'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.490802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f3b62589cc467e8fe1c18838cdd140', 'request_id': 'req-0f09b0a1-47bd-41da-b0bf-37ac33846252'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.512934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] The token cache is being invalidate because project 18f3b62589cc467e8fe1c18838cdd140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:25.514065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.514497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a959fcc-7585-4792-affc-f29a856cdcc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:25.515392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.517873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2164/4354] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:25 2022] DELETE /identity/v3/projects/18f3b62589cc467e8fe1c18838cdd140 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:25.525042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:25.526621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:25.655806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:25.655806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.655806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.655806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] PATH_INFO: `/v3/projects/01956d3751734843b359711f64578acc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.656840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01956d3751734843b359711f64578acc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:25.665147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:25.677888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09b0a1-47bd-41da-b0bf-37ac33846252 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:25.692029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:25.692783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.693098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.693347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.694165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:25.696187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:25.750940 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2165/4355] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:25 2022] POST /identity/v3/projects => generated 357 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:25.755967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:25.763867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:25.781260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01956d3751734843b359711f64578acc', 'request_id': 'req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.794657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01956d3751734843b359711f64578acc', 'request_id': 'req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.800128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01956d3751734843b359711f64578acc', 'request_id': 'req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.819463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] The token cache is being invalidate because project 01956d3751734843b359711f64578acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:25.819877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.820563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-539d97bf-5ab6-47b3-b46e-a6dde4e340b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:25.822749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2191/4356] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:25 2022] DELETE /identity/v3/projects/01956d3751734843b359711f64578acc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:25.828220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5784-c740-41f8-a31b-93f170d121c1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.828511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5784-c740-41f8-a31b-93f170d121c1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.829115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5784-c740-41f8-a31b-93f170d121c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.854028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770ab6-3b44-4ec4-afa6-403ce8e51552 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:25.872259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-238d5784-c740-41f8-a31b-93f170d121c1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:25.874859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-238d5784-c740-41f8-a31b-93f170d121c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:25.888936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:25.964291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:25.965005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.965292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.965628 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2192/4357] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:25.972434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.974048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:25.974400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:25.974683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:25.974957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:25.976312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:25.995663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:25.997016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:26.013231 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2193/4358] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:26.024313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.033931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2166/4359] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:25 2022] POST /identity/v3/users => generated 417 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:26.036337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.039108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:26.045415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bb428-c59a-4b21-ba13-dc814f29e4a6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.057537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0b603-30ae-4572-801c-8ae87d4bdd19 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.059602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.060663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.061110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.061480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.062486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:26.062881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.064967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.076856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.077576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.077879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.078132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.079182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.080195 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2194/4360] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:26.084246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.085566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.098194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67ac9c-d1d6-43d4-886e-f6f3e5d3d3e8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.103571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.105155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.105641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.105925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.106635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.108790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.112673 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2167/4361] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/roles => generated 239 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:26.116604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.133569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5df73-3b25-4f83-9eca-0726c879137e tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.142672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.145440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.145440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.145678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/f765e43a1517470e8904e1e72197fbb8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.165183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_user(user_id=f765e43a1517470e8904e1e72197fbb8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.165416 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2195/4362] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:26.168075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.170314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.170568 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2168/4363] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/users/f765e43a1517470e8904e1e72197fbb8 => generated 417 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:26.176066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.197791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe60e4b-0254-4a06-8af8-64c2fc31baba tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.282981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.284506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.284812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.285623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/roles/989b654dd84a47a0bee49a1902d34137` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.288077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_role(role_id=989b654dd84a47a0bee49a1902d34137)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.290796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.295934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2169/4364] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/roles/989b654dd84a47a0bee49a1902d34137 => generated 239 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:26.296106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3311214-9d19-49ef-842c-ce40129c55b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.297099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.305475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.306543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.307067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.307560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.308771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.311698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.326107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5a8b-df1e-4109-ae64-dc06c0683a30 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.346527 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2196/4365] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:26.348312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.351751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.352487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.352770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.353052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.353756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.355977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.364755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcf5e0-059b-46e4-a7e5-ca14ae48be2a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.369842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:26.405486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.406926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.407547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.408050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.410130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.415968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.420389 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2170/4366] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/projects => generated 360 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:26.423871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.441757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2197/4367] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/roles => generated 1650 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:26.446255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.468530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69176fc-5819-485c-ab40-5fa5c315e98a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.547905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daad8de-6ce9-4793-a6ca-b0dd77ea41ed tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.550449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:26.553902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.554888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.555247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.555631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/d52ea8f4ca2a4d7e9128921510448555` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.557587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_project(project_id=d52ea8f4ca2a4d7e9128921510448555)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.560343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63bb45-b243-4aea-ab70-d0a1ea829943 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.562415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2171/4368] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/projects/d52ea8f4ca2a4d7e9128921510448555 => generated 360 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:26.562822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.563746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.564061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.564171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.564342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.564443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.564617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.565797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.567699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.582697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2198/4369] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/roles => generated 1650 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:26.582697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.585398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] MFA Rules not processed for user `21ae179d22a140f7a6ebccaeea7932db`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:26.587076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:26.595737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b87723-af1d-4084-b50e-627ee1628c63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.602562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.603466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.603784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.604180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/d52ea8f4ca2a4d7e9128921510448555/users/f765e43a1517470e8904e1e72197fbb8/roles/989b654dd84a47a0bee49a1902d34137` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.607397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d52ea8f4ca2a4d7e9128921510448555, user_id=f765e43a1517470e8904e1e72197fbb8, role_id=989b654dd84a47a0bee49a1902d34137)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.610381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.633348 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2199/4370] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:26 2022] PUT /identity/v3/projects/d52ea8f4ca2a4d7e9128921510448555/users/f765e43a1517470e8904e1e72197fbb8/roles/989b654dd84a47a0bee49a1902d34137 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:26.636837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.679674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2172/4371] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:26.680687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.698481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f007c6-6df5-462f-a8f4-07dce996b3e4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.731467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148b2e5-6d8a-4bb9-94d6-273b96a4551a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:26.752082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.753992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.754590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.755322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] PATH_INFO: `/v3/projects/6eda6049d3c84577b31b5764691bce8c/users/0f3f0b579db749afb41968de41bb1de2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.778228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eda6049d3c84577b31b5764691bce8c, user_id=0f3f0b579db749afb41968de41bb1de2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.781195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662995e-e694-4fd9-bdf5-c673d4a1f877 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.795711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:26.796772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.797368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.797574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.798436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:26.800781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:26.830667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2200/4372] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:26 2022] PUT /identity/v3/projects/6eda6049d3c84577b31b5764691bce8c/users/0f3f0b579db749afb41968de41bb1de2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:26.833748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:26.834145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:26.834326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:26.870302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2173/4373] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/projects => generated 356 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:26.876470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:26.901925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] MFA Rules not processed for user `0f3f0b579db749afb41968de41bb1de2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:26.903150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:26.963957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:27.082920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd32d8-58de-4b79-a176-ae2885e95e04 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.091884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.094814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2201/4374] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:27.096391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.097891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.098414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.098887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/6a1aaf25045240119ca286f60a36f819` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.101100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_project(project_id=6a1aaf25045240119ca286f60a36f819)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.103844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.105526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.112506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2174/4375] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:04:26 2022] GET /identity/v3/projects/6a1aaf25045240119ca286f60a36f819 => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:27.113927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.119390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.172673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:27.199626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aca7f-677f-427d-a982-0c94b183183b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.206651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.207890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.208272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.208655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] PATH_INFO: `/v3/users/d96f5288364449e3af2f39c71a8c3ef2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.211441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96f5288364449e3af2f39c71a8c3ef2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.213020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.225920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53218513-2bed-4b1b-8433-ed046097ba4a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.230589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.231977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.232410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.233381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.244822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.246896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.258624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2175/4376] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:27.260315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.274897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b70be2-e7dc-4858-aacf-0f204b414105 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.280634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.281617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.281904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.282223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/6a1aaf25045240119ca286f60a36f819/users/f765e43a1517470e8904e1e72197fbb8/roles/989b654dd84a47a0bee49a1902d34137` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.285109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6a1aaf25045240119ca286f60a36f819, user_id=f765e43a1517470e8904e1e72197fbb8, role_id=989b654dd84a47a0bee49a1902d34137)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.288939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.289678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96f5288364449e3af2f39c71a8c3ef2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.307138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96f5288364449e3af2f39c71a8c3ef2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.307942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96f5288364449e3af2f39c71a8c3ef2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.309100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96f5288364449e3af2f39c71a8c3ef2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.314159 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2176/4377] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:27 2022] PUT /identity/v3/projects/6a1aaf25045240119ca286f60a36f819/users/f765e43a1517470e8904e1e72197fbb8/roles/989b654dd84a47a0bee49a1902d34137 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:27.315589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.317147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.326099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96f5288364449e3af2f39c71a8c3ef2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.347438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2202/4378] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:27 2022] DELETE /identity/v3/users/d96f5288364449e3af2f39c71a8c3ef2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:27.352408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.355640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.435220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7419e-020d-4bb3-92a8-e302a79c7d78 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.468771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c69c6-d054-4ae3-af2d-1e7760dabce6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.476647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.479371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.480273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.480573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/f765e43a1517470e8904e1e72197fbb8/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.484603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=f765e43a1517470e8904e1e72197fbb8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.487351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.554416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:27.573447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.574482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.574794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.575252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] PATH_INFO: `/v3/users/0f3f0b579db749afb41968de41bb1de2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.575577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2203/4379] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:04:27 2022] GET /identity/v3/users/f765e43a1517470e8904e1e72197fbb8/projects => generated 840 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:27.576567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.578362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3f0b579db749afb41968de41bb1de2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.581992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.593060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0947a-7f6d-43e2-ac14-7830908ed7a7 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.599468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.600399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.600745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.601031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/6a1aaf25045240119ca286f60a36f819` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.602527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a1aaf25045240119ca286f60a36f819)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.604692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.670979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:27.701530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3f0b579db749afb41968de41bb1de2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.702507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1aaf25045240119ca286f60a36f819', 'request_id': 'req-ed004dda-1c40-42e0-b863-a96d5cdd815f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.702660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3f0b579db749afb41968de41bb1de2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.711387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1aaf25045240119ca286f60a36f819', 'request_id': 'req-ed004dda-1c40-42e0-b863-a96d5cdd815f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.715085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3f0b579db749afb41968de41bb1de2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.715747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3f0b579db749afb41968de41bb1de2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.720857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1aaf25045240119ca286f60a36f819', 'request_id': 'req-ed004dda-1c40-42e0-b863-a96d5cdd815f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.734319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3f0b579db749afb41968de41bb1de2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.741497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] The token cache is being invalidate because project 6a1aaf25045240119ca286f60a36f819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:27.741497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.742748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.745494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2204/4380] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:27 2022] DELETE /identity/v3/projects/6a1aaf25045240119ca286f60a36f819 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:27.746522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.748206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.764736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2177/4381] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:27 2022] DELETE /identity/v3/users/0f3f0b579db749afb41968de41bb1de2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:27.766073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:27.768495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:27.857873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ade4-dbb5-4f34-b13e-9c708b3f6406 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.860719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004dda-1c40-42e0-b863-a96d5cdd815f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:27.864948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.866028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.866449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.866819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/d52ea8f4ca2a4d7e9128921510448555` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.868322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d52ea8f4ca2a4d7e9128921510448555)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.870941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.941091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52ea8f4ca2a4d7e9128921510448555', 'request_id': 'req-54b2fc82-03d2-4928-aed5-e1f126b839fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.954361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52ea8f4ca2a4d7e9128921510448555', 'request_id': 'req-54b2fc82-03d2-4928-aed5-e1f126b839fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.961661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:27.962675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.963035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:27.963429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] PATH_INFO: `/v3/projects/b0cebb51402146e693490f681342be4f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:27.964755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cebb51402146e693490f681342be4f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:27.965063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52ea8f4ca2a4d7e9128921510448555', 'request_id': 'req-54b2fc82-03d2-4928-aed5-e1f126b839fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.967263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:27.987575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] The token cache is being invalidate because project d52ea8f4ca2a4d7e9128921510448555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:27.989577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.991426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-54b2fc82-03d2-4928-aed5-e1f126b839fc tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:27.994253 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2178/4382] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:27 2022] DELETE /identity/v3/projects/d52ea8f4ca2a4d7e9128921510448555 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:27.997233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48b3c-894c-41af-9a55-1204e1535d90 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:27.998015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48b3c-894c-41af-9a55-1204e1535d90 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.000904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48b3c-894c-41af-9a55-1204e1535d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.010320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.027262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-07b48b3c-894c-41af-9a55-1204e1535d90 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:28.029695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07b48b3c-894c-41af-9a55-1204e1535d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.033317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cebb51402146e693490f681342be4f', 'request_id': 'req-4f10e100-66b9-4edf-ad3c-18c2604d0b93'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.044326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cebb51402146e693490f681342be4f', 'request_id': 'req-4f10e100-66b9-4edf-ad3c-18c2604d0b93'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.053926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cebb51402146e693490f681342be4f', 'request_id': 'req-4f10e100-66b9-4edf-ad3c-18c2604d0b93'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.061331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.089625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] The token cache is being invalidate because project b0cebb51402146e693490f681342be4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:28.090229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.091676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.095556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2205/4383] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:27 2022] DELETE /identity/v3/projects/b0cebb51402146e693490f681342be4f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:28.097566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.099816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.143854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2179/4384] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:28.149329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.149686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.149993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.175419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:28.177030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.190438 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2180/4385] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:28.191892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.193539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.196698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10e100-66b9-4edf-ad3c-18c2604d0b93 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.203010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.204089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.204383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.204789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/roles/989b654dd84a47a0bee49a1902d34137` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.206373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_role(role_id=989b654dd84a47a0bee49a1902d34137)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.208175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.279408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invalidating the token cache because role 989b654dd84a47a0bee49a1902d34137 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:28.280328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.281143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1321df32-4bd0-4987-8ca0-33debcf06131 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.284786 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2206/4386] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:28 2022] DELETE /identity/v3/roles/989b654dd84a47a0bee49a1902d34137 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:28.284958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982486cf-5389-4442-8b13-0912f9eea368 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.285641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.285933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.286408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.313287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:28.314703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.383251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.387184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.387539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.387781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.395005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.437676 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2207/4387] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:28.439119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.441239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.501907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.504816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.517486 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2181/4388] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:28.519599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.527833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.533914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835da8ef-6ab9-4ffb-9de7-4adc86c644f9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.543150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.544437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.545465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.545779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.546690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:28.546985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.550611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.566197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1bd0-e1a5-4d90-9c79-357ac6e3d0f4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.572818 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2182/4389] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:28.573808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.587731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71022871-b412-4540-8116-29d56ad3ccf2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.593789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.594483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.594772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.595069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.595883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.598286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.599414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.599829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.599957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.600252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/f765e43a1517470e8904e1e72197fbb8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.607646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f765e43a1517470e8904e1e72197fbb8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.610597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.620883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.652293 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2183/4390] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:28.657127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.723834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f765e43a1517470e8904e1e72197fbb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.749068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f765e43a1517470e8904e1e72197fbb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.750110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f765e43a1517470e8904e1e72197fbb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.751205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f765e43a1517470e8904e1e72197fbb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.789906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f765e43a1517470e8904e1e72197fbb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:28.805250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edbb85-deba-4bdf-a7ad-7ac883b07858 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.816997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.819155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.819452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.819837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.820561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.826729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:28.857638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2208/4391] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:28 2022] DELETE /identity/v3/users/f765e43a1517470e8904e1e72197fbb8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:28.862985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.868574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.878136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2184/4392] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:28 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:28.879528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:28.884590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:28.908869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879a2ad-4ff6-4ded-91d1-f7ab8c7aef8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:28.987285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:28.988964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:28.989304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:28.989593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:28.991059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:28.992472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.007588 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2185/4393] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:29.011415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.030964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68476d8-4e82-4a37-9ec6-8919d011495e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.045273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.046024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.046315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.046995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.047333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.051444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.075502 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2186/4394] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:29.084491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21355db-ca15-45c6-9d54-54de03a80645 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.084747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.102814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cc0c-c6b4-42b3-86a8-e62ad52951fe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.104611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.104611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.105508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.105508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/aea607ba400241d5b5d3d62704c311d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.107194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aea607ba400241d5b5d3d62704c311d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.110070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.121828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.126224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.126571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.126857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] PATH_INFO: `/v3/projects/5c275250b53146a2a6fbd1c15b484560/users/82f7fda07c394cce95c6f317ad334d68/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.173237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c275250b53146a2a6fbd1c15b484560, user_id=82f7fda07c394cce95c6f317ad334d68, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.180650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.220858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2187/4395] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:29 2022] PUT /identity/v3/projects/5c275250b53146a2a6fbd1c15b484560/users/82f7fda07c394cce95c6f317ad334d68/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:29.223053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.228771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.237573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea607ba400241d5b5d3d62704c311d8', 'request_id': 'req-7bbd75c8-8504-4329-ae9e-857a383c47a9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.246724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea607ba400241d5b5d3d62704c311d8', 'request_id': 'req-7bbd75c8-8504-4329-ae9e-857a383c47a9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.256243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea607ba400241d5b5d3d62704c311d8', 'request_id': 'req-7bbd75c8-8504-4329-ae9e-857a383c47a9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.278974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] The token cache is being invalidate because project aea607ba400241d5b5d3d62704c311d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:29.279436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.280990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bbd75c8-8504-4329-ae9e-857a383c47a9 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.282890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:29.288335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2209/4396] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:28 2022] DELETE /identity/v3/projects/aea607ba400241d5b5d3d62704c311d8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:29.288335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.288335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.288335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.319818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:29.321875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.329940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:29.345585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0befe7-10ff-4c76-a64e-271f8fb3fb8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.436987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2210/4397] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:29.437866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.438961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.440000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.440297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.441475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] PATH_INFO: `/v3/projects/6eda6049d3c84577b31b5764691bce8c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.442785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.445609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eda6049d3c84577b31b5764691bce8c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.447713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.520901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eda6049d3c84577b31b5764691bce8c', 'request_id': 'req-5bc32fda-5d9a-470b-a263-80e4cea40586'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.529256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eda6049d3c84577b31b5764691bce8c', 'request_id': 'req-5bc32fda-5d9a-470b-a263-80e4cea40586'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.538160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eda6049d3c84577b31b5764691bce8c', 'request_id': 'req-5bc32fda-5d9a-470b-a263-80e4cea40586'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.559695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1f40-b892-425a-9f10-3eec6e8eb5f8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.560688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] The token cache is being invalidate because project 6eda6049d3c84577b31b5764691bce8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:29.561287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.562308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.564751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2188/4398] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:29 2022] DELETE /identity/v3/projects/6eda6049d3c84577b31b5764691bce8c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:29.565993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.568352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.640096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.642804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.643334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.644502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/cda78f5d8d5f4538a4adf17222f56cc6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.646174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:update_user(user_id=cda78f5d8d5f4538a4adf17222f56cc6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.647787 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:29.647787 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:04:29.647787 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:04:29.650148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.684711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc32fda-5d9a-470b-a263-80e4cea40586 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.690230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.691279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.691656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.692034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.694349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.705250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.712622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:29.720284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invalidating the token cache because user cda78f5d8d5f4538a4adf17222f56cc6 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:29.720989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.722782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-828b8626-19ea-4e30-9dec-bf00b85e9599 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:29.726718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2211/4399] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 21:04:29 2022] PATCH /identity/v3/users/cda78f5d8d5f4538a4adf17222f56cc6 => generated 296 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:29.730326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671800-8c28-49c9-8959-eac9642e968f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.734278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671800-8c28-49c9-8959-eac9642e968f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.738471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671800-8c28-49c9-8959-eac9642e968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.777743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ac671800-8c28-49c9-8959-eac9642e968f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:29.779143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac671800-8c28-49c9-8959-eac9642e968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.817463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.821017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc153c1d-44d4-407c-979f-a1414709afbe service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.849276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2189/4400] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:29.850947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1544f-408d-476c-987f-039c8b62772b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.852181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1544f-408d-476c-987f-039c8b62772b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.852472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1544f-408d-476c-987f-039c8b62772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.860167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:29.901175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-63f1544f-408d-476c-987f-039c8b62772b None None] MFA Rules not processed for user `cda78f5d8d5f4538a4adf17222f56cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:29.902432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63f1544f-408d-476c-987f-039c8b62772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.910062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2190/4401] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:29.910953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1544f-408d-476c-987f-039c8b62772b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.913098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63f1544f-408d-476c-987f-039c8b62772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.916391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2212/4402] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:29.922393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.922720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.923140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.944958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1544f-408d-476c-987f-039c8b62772b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.949534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:29.951764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:29.951899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.953870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.954154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.954539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/cda78f5d8d5f4538a4adf17222f56cc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:29.957179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:update_user(user_id=cda78f5d8d5f4538a4adf17222f56cc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:29.958595 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:04:29.958595 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:04:29.958595 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:04:29.961497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:29.968250 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2213/4403] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:29.973221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:29.990269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ec199-325b-4210-bf8b-3d86a3bcb4b0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:29.997921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:29.998636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:29.998918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:29.999386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.001306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:30.001306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.004460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.024167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.040483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2214/4404] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:30.045172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invalidating the token cache because user cda78f5d8d5f4538a4adf17222f56cc6 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:30.045474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.045668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.047374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.050955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.063251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2191/4405] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 21:04:29 2022] PATCH /identity/v3/users/cda78f5d8d5f4538a4adf17222f56cc6 => generated 296 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:30.064437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.066874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.078039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e3915-61af-4937-ac64-7f8f183083fd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.084964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530ba8e-a3f2-475a-83a7-8b2642a4d128 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.089934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.091342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.091841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.092274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.094468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.095697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.108649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.112181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.112924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.113529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/cda78f5d8d5f4538a4adf17222f56cc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.150605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:update_user(user_id=cda78f5d8d5f4538a4adf17222f56cc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.156548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.162101 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2215/4406] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:30.168008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.239566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.261313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invalidating the token cache because user cda78f5d8d5f4538a4adf17222f56cc6 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:30.262146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.263306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9cc1d00f-e2b1-400d-8c5c-e2533e3915d4 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.265938 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2192/4407] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 21:04:30 2022] PATCH /identity/v3/users/cda78f5d8d5f4538a4adf17222f56cc6 => generated 296 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:30.271208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.272310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.272795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.337568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0af39-260b-4f4e-85a8-066c11f57f10 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.341339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] MFA Rules not processed for user `cda78f5d8d5f4538a4adf17222f56cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:30.342833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.348262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.348971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.349256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.352766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.355011 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2193/4408] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 21:04:30.363629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.364314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.378127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.382561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.423279 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2216/4409] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:30.424466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.431403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.460140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95c82e-c33a-44db-913f-b40df1b46176 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.475762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.477451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.477753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.478189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.479043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.483099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.511451 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2217/4410] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:30.514768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.533008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:30.545206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ec0a-e478-4658-9a65-d3aacfd323bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.548297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c104c2-679d-4d63-afce-a08320ffe1fe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.556694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.557262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.558274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.558559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.558849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/cda78f5d8d5f4538a4adf17222f56cc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.559491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.561141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.561737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.562830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.562947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:update_user(user_id=cda78f5d8d5f4538a4adf17222f56cc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.565366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.565583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.586488 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2218/4411] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:04:30.592020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.608239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637157-e855-4c3a-9b9b-807d563695e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.618443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.620570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.621291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.622811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] PATH_INFO: `/v3/projects/baf5ceaed9b646e39bcb18e82146ed3e/users/1ce29cab189247e283afea730e23d7ed/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.644863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.650315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf5ceaed9b646e39bcb18e82146ed3e, user_id=1ce29cab189247e283afea730e23d7ed, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.655639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222a547-0515-4441-a967-46e467a0f379 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.669936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invalidating the token cache because user cda78f5d8d5f4538a4adf17222f56cc6 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:30.670248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.670918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:30.674774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2194/4412] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 21:04:30 2022] PATCH /identity/v3/users/cda78f5d8d5f4538a4adf17222f56cc6 => generated 296 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:30.678885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.681488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.708540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147a859-fe7b-46b8-b981-e52e016ac55a tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.727253 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2219/4413] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:30 2022] PUT /identity/v3/projects/baf5ceaed9b646e39bcb18e82146ed3e/users/1ce29cab189247e283afea730e23d7ed/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:30.730272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.730614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.730975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.819034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] MFA Rules not processed for user `1ce29cab189247e283afea730e23d7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:30.820560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:30.864966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.864966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.864966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.866338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.866338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:30.866338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:30.920898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2195/4414] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/users => generated 265 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:30.921955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:30.949823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b093d-7d73-431e-b5af-1d08dd8691e2 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:30.966094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aac9c-3057-44c8-9a11-db8396b82843 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:30.967001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aac9c-3057-44c8-9a11-db8396b82843 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:30.967278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aac9c-3057-44c8-9a11-db8396b82843 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:30.970709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aac9c-3057-44c8-9a11-db8396b82843 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/7d013691013c47068054ca20ba74fc8b/password` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:30.987115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:31.089840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c69aac9c-3057-44c8-9a11-db8396b82843 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:31.113961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2196/4415] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/users/7d013691013c47068054ca20ba74fc8b/password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:31.124347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2220/4416] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:31.167007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:31.167391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:31.167589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:31.187075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:31.189145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:31.232901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:31.237714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:31.346744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e9623-ee6d-46d1-8651-66fb0dcc8e9f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:31.359171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:31.363785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:31.364988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:31.365423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:31.393677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:31.394870 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2197/4417] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:31.395986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cd95c-9bf1-410e-a704-799a0a010140 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:31.414838 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2221/4418] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:31.426891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:31.428840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:31.440667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:31.576581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119c15c-f159-4dbe-a1b5-ef0a1ae2e6a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:31.596009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:31.598987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:31.599434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:31.600085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:31.627086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:31.630352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:31.649043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2198/4419] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:32.120606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.121198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.121198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.147403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] MFA Rules not processed for user `7d013691013c47068054ca20ba74fc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:32.148776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:32.154133 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2222/4420] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:32 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:32.160143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.203952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c997-8e38-43de-9d3e-42ef15f04659 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:32.217989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:32.221550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.222107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.222771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.236562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:32.253374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:32.264714 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2199/4421] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Jun 4 21:04:32 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:32.269207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.291235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f54ce5-e9b0-4e63-8580-8ab0f2808185 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:32.298554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:32.299811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.300117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.300500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/7d013691013c47068054ca20ba74fc8b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.302628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7d013691013c47068054ca20ba74fc8b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:32.305031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:32.391207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:32.402461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:32.403822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:32.404822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:32.421582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d013691013c47068054ca20ba74fc8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:32.449580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.453513 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2223/4422] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:32 2022] DELETE /identity/v3/users/7d013691013c47068054ca20ba74fc8b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:32.465049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186e35b-7b43-46ad-8656-4844b73f16be tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:32.581040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:32.583485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.583832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.584411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.586525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:32.590715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:32.636604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2200/4423] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:32 2022] POST /identity/v3/users => generated 364 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:32.640952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.642514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:32.661008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037f083-7085-41b4-bb17-894dad3182b5 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:32.667292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:32.668393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.668922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.669310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.670176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:32.672406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69edcd4-66b3-4951-956d-d87390e222b6 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:32.724053 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2224/4424] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:32 2022] POST /identity/v3/projects => generated 360 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:32.728342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.750319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3328-9a9b-42dc-bc08-8eea20ab044f tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:32.760450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.760693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.760899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.810679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:32.814823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:32.836609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:32.907618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:32.909016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:32.909530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:32.909929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/e4c04b2ed2b24319bf0045339b848227` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:32.944874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2225/4425] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:32.946198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:32.949303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:32.952443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:32.997017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:update_user(user_id=e4c04b2ed2b24319bf0045339b848227)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:33.003251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:33.128466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c0c6d-c301-45ad-ad97-8c5c2afcea8b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:33.137419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:33.138167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:33.138651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:33.140228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:33.148133 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2201/4426] 10.222.0.18 () {60 vars in 1243 bytes} [Sat Jun 4 21:04:32 2022] PATCH /identity/v3/users/e4c04b2ed2b24319bf0045339b848227 => generated 523 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:33.151923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:33.157438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:33.160547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:33.172298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2226/4427] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:33.176288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd7ce6-bae0-4fac-af35-46933e403117 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:33.182115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:33.183592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:33.183797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:33.184032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/e4c04b2ed2b24319bf0045339b848227` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:33.211822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:get_user(user_id=e4c04b2ed2b24319bf0045339b848227)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:33.218187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:33.226056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:33.230723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2202/4428] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:04:33 2022] GET /identity/v3/users/e4c04b2ed2b24319bf0045339b848227 => generated 389 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:33.241067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf23f6-0770-4aa8-a130-44c30ffa9832 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:33.250294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:33.251951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:33.252458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:33.252934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/projects/d4add967d9354b8da877120ac9160211` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:33.254712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4add967d9354b8da877120ac9160211)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:33.260356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:33.376122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4add967d9354b8da877120ac9160211', 'request_id': 'req-78240aa8-4133-40f6-81d9-1718abc1fc8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.388246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4add967d9354b8da877120ac9160211', 'request_id': 'req-78240aa8-4133-40f6-81d9-1718abc1fc8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.398442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4add967d9354b8da877120ac9160211', 'request_id': 'req-78240aa8-4133-40f6-81d9-1718abc1fc8d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.418006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] The token cache is being invalidate because project d4add967d9354b8da877120ac9160211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:33.418657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.419654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78240aa8-4133-40f6-81d9-1718abc1fc8d tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.422706 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2227/4429] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:33 2022] DELETE /identity/v3/projects/d4add967d9354b8da877120ac9160211 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:33.427189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:33.431881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:33.460853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53fda7-a19e-4e1f-9edf-25f8ce474af3 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:33.549519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd58d5436f4a45e2bd66de50b1a62fc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2bdc0415f254cdca6785b5ed07a6103', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:33.550612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:33.550788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:33.551031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] PATH_INFO: `/v3/users/e4c04b2ed2b24319bf0045339b848227` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:33.552763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e4c04b2ed2b24319bf0045339b848227)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:33.555425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:33.640078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c04b2ed2b24319bf0045339b848227'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.640890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c04b2ed2b24319bf0045339b848227'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.654220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c04b2ed2b24319bf0045339b848227'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.657420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c04b2ed2b24319bf0045339b848227'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.709447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c04b2ed2b24319bf0045339b848227'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:33.722585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:33.722982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:33.723223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:33.746494 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2203/4430] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:33 2022] DELETE /identity/v3/users/e4c04b2ed2b24319bf0045339b848227 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:33.755755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:33.759642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:33.776389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:33.779039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:33.867587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:33.941873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:UPDATE=2,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:34.022404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2228/4431] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:34.041399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:34.042968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.057197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538494-fdd9-4a05-a5e9-9516626f6a85 tempest-UsersV3TestJSON-1127672109 tempest-UsersV3TestJSON-1127672109-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:34.079540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:34.080603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.081434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.081657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] PATH_INFO: `/v3/users/cda78f5d8d5f4538a4adf17222f56cc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.136954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda78f5d8d5f4538a4adf17222f56cc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:34.138951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:34.270766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.273791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.291283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.293983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.306807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123b222-e95e-49cd-bb1a-33d1b0e28da2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:34.315799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:34.316967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.317931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.318444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.322120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.325261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a61841ac-0801-4f2c-923e-fc080418c35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda78f5d8d5f4538a4adf17222f56cc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.356279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2204/4432] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:33 2022] DELETE /identity/v3/users/cda78f5d8d5f4538a4adf17222f56cc6 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:34.359347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.359683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.359968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.367573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:34.384363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:34.398001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:34.403456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.433220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2229/4433] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:34.563847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2205/4434] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:34.618115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:34.620130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.645718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ecaed-69f4-42ba-a70a-b600dd149b50 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:34.654728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:34.656134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.656516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.656966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] PATH_INFO: `/v3/users/61a665da0b8f4dcd8c39570a49b62449` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.658710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a665da0b8f4dcd8c39570a49b62449)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:34.661731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:34.721102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:34.722852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.791287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a665da0b8f4dcd8c39570a49b62449'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.809234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a665da0b8f4dcd8c39570a49b62449'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.813556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a665da0b8f4dcd8c39570a49b62449'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.814722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a665da0b8f4dcd8c39570a49b62449'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.843948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:34.848288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1a167664-e793-4fd1-ba5e-36061ba65533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a665da0b8f4dcd8c39570a49b62449'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:34.850642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf2320-5c73-447f-937e-a4845ea3ffd6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:34.858802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:34.859540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.859835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.860138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.871004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:34.884399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2230/4435] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:34 2022] DELETE /identity/v3/users/61a665da0b8f4dcd8c39570a49b62449 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:34.888235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:34.888852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:34.889692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:34.895012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:34.896993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:34.914889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2206/4436] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:34.930316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:34.931600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:35.059573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:35.152715 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2231/4437] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:35.190397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:35.192298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:35.209891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6ae6f-db0c-43b0-9c7d-ec48b89062cd service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:35.329954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:35.330874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:35.331206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:35.331567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:35.345432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:35.347913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479d242-7fbe-4c81-97a0-e47e24260a6a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:35.386191 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2207/4438] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:35.948445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:35.950542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:35.989854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775fed-4cc9-474f-87c5-682ffa7252fa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:36.007145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:36.009296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.010307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.010599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] PATH_INFO: `/v3/projects/6b1dd7943ab249e6bf2156b54b4c3a20` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.018949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1dd7943ab249e6bf2156b54b4c3a20)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:36.025151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:36.174995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1dd7943ab249e6bf2156b54b4c3a20', 'request_id': 'req-daa89842-0bf8-4afc-be96-fd85a0000e0d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:36.184866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1dd7943ab249e6bf2156b54b4c3a20', 'request_id': 'req-daa89842-0bf8-4afc-be96-fd85a0000e0d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:36.199741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1dd7943ab249e6bf2156b54b4c3a20', 'request_id': 'req-daa89842-0bf8-4afc-be96-fd85a0000e0d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:36.225782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] The token cache is being invalidate because project 6b1dd7943ab249e6bf2156b54b4c3a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:36.226388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:36.227271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daa89842-0bf8-4afc-be96-fd85a0000e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:36.230630 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2232/4439] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:35 2022] DELETE /identity/v3/projects/6b1dd7943ab249e6bf2156b54b4c3a20 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:36.235846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.236134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.237098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.276692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:36.278166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:36.469705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2208/4440] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:36.478309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.478899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.479382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.520159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:36.522629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:36.545280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:36.546969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2233/4441] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:36.567367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7bd2e-6217-4563-9363-ad92a35d54b6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:36.582460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:36.584752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.585456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.586121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.586878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:36.587270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:36.607084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:36.626824 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2209/4442] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:36.632921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:36.646122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43ad44-911a-4b10-8f89-72dc162e9084 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:36.653571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:36.654635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.654963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.655291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.656097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:36.658279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:36.745011 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2234/4443] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:36 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:36.749781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:36.769299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e27a7-9d8b-4d06-8f9b-166efa5004ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:36.882932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:36.883821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.884258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.884601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.885439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:36.887860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:36.917336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2210/4444] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:36 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:36.925217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:36.955036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968bffd-e689-49ef-901b-0809c87eff13 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:36.965410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:36.966167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:36.966681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:36.967048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:36.968181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:36.970686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:36.992541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:37.013867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2235/4445] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:37.019839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d1dfd-ccdf-4e99-9294-2ea2a1373c03 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:37.026679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:37.027689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:37.028295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:37.028784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:37.029677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:37.031628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:37.040789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:37.054997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:37.056338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2211/4446] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:37.065126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:37.070063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664bc6-771d-413d-b78d-ac1e85428987 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:37.071943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:37.085655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:37.086977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:37.087365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:37.087855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] PATH_INFO: `/v3/projects/14a59186aa064bcdb8e7551ce8fbb5ac/users/d1efc5e8e97143a0810a7960aadd04bd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:37.103891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199095e-da11-42b7-9f3a-24a8cb0e9226 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:37.123740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:37.125271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:37.126036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:37.127057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] PATH_INFO: `/v3/projects/ea5a66c05d85412f8d71d7a29c26095e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:37.131230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a59186aa064bcdb8e7551ce8fbb5ac, user_id=d1efc5e8e97143a0810a7960aadd04bd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:37.131485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5a66c05d85412f8d71d7a29c26095e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:37.136635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:37.137933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd5c35-2e24-4ca9-8230-2b684ffbb0a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:37.189346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2236/4447] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:37 2022] PUT /identity/v3/projects/14a59186aa064bcdb8e7551ce8fbb5ac/users/d1efc5e8e97143a0810a7960aadd04bd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:37.203606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d29a-77f0-419d-a072-eeef12fcbbcf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:37.204995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d29a-77f0-419d-a072-eeef12fcbbcf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:37.209890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d29a-77f0-419d-a072-eeef12fcbbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:37.287677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8ae7d29a-77f0-419d-a072-eeef12fcbbcf None None] MFA Rules not processed for user `d1efc5e8e97143a0810a7960aadd04bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:37.289246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ae7d29a-77f0-419d-a072-eeef12fcbbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:37.303046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5a66c05d85412f8d71d7a29c26095e', 'request_id': 'req-0e70861e-44fb-4291-b750-3752d8ca4920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.326911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5a66c05d85412f8d71d7a29c26095e', 'request_id': 'req-0e70861e-44fb-4291-b750-3752d8ca4920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.343115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5a66c05d85412f8d71d7a29c26095e', 'request_id': 'req-0e70861e-44fb-4291-b750-3752d8ca4920'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.379268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] The token cache is being invalidate because project ea5a66c05d85412f8d71d7a29c26095e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:37.379877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.381957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.391655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2212/4448] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:37 2022] DELETE /identity/v3/projects/ea5a66c05d85412f8d71d7a29c26095e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:37.393341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:37.394825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:37.401257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:37.451615 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2237/4449] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:37.514210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70861e-44fb-4291-b750-3752d8ca4920 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:37.520618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:37.522162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:37.522506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:37.522864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] PATH_INFO: `/v3/users/fd58d5436f4a45e2bd66de50b1a62fc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:37.524244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd58d5436f4a45e2bd66de50b1a62fc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:37.526521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:37.648734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd58d5436f4a45e2bd66de50b1a62fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.650540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd58d5436f4a45e2bd66de50b1a62fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.675416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd58d5436f4a45e2bd66de50b1a62fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.677101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd58d5436f4a45e2bd66de50b1a62fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.709573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd58d5436f4a45e2bd66de50b1a62fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:37.741806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2213/4450] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:37 2022] DELETE /identity/v3/users/fd58d5436f4a45e2bd66de50b1a62fc6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:38.402030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69cde-8749-452c-b5e9-26ca2f2ce220 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:38.402975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69cde-8749-452c-b5e9-26ca2f2ce220 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:38.403670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b69cde-8749-452c-b5e9-26ca2f2ce220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:38.450730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:38.454482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:38.458297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-36b69cde-8749-452c-b5e9-26ca2f2ce220 None None] MFA Rules not processed for user `82f7fda07c394cce95c6f317ad334d68`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:38.459841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-36b69cde-8749-452c-b5e9-26ca2f2ce220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:38.493945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:38.661681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2238/4451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:38.687465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f12ea-900e-47d9-b29e-8e34f36032c8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:38.721391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:38.722789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:38.723076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:38.723589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] PATH_INFO: `/v3/projects/c2bdc0415f254cdca6785b5ed07a6103` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:38.724910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2bdc0415f254cdca6785b5ed07a6103)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:38.726883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:38.848041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bdc0415f254cdca6785b5ed07a6103', 'request_id': 'req-87831700-6dac-4fa0-aae1-c0a98b6ba283'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:38.857087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bdc0415f254cdca6785b5ed07a6103', 'request_id': 'req-87831700-6dac-4fa0-aae1-c0a98b6ba283'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:38.865190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bdc0415f254cdca6785b5ed07a6103', 'request_id': 'req-87831700-6dac-4fa0-aae1-c0a98b6ba283'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:38.883688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] The token cache is being invalidate because project c2bdc0415f254cdca6785b5ed07a6103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:38.883983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:38.884717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:38.886428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2214/4452] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:38 2022] DELETE /identity/v3/projects/c2bdc0415f254cdca6785b5ed07a6103 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:38.894206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd683f77-ecdc-416e-81ed-f562cbbe3823 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:38.894531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd683f77-ecdc-416e-81ed-f562cbbe3823 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:38.894925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd683f77-ecdc-416e-81ed-f562cbbe3823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:38.927374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dd683f77-ecdc-416e-81ed-f562cbbe3823 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:38.928658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd683f77-ecdc-416e-81ed-f562cbbe3823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:38.998411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.001262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:39.079997 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2239/4453] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:39.085628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.085628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.085628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.122564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:39.124288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:39.161788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2240/4454] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:39.162827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.176612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0755d-921e-4211-b354-94447c2875d1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.183368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.184143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.184435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.184754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.185507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:39.185816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.187555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.213601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2241/4455] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:39.214651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.216791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87831700-6dac-4fa0-aae1-c0a98b6ba283 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.231552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.235446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.235867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.236302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.239793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:39.240690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e5b1-d11f-4ddf-9e49-d71c384583f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.251720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.253637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.254180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.255174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.256422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.259492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.284113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:39.346768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.348494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2242/4456] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:39 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:39.352089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd96bda-2034-4c5e-a571-24d1fffd1162 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.353138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.365922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2215/4457] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:39.424716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:39.435274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.435790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.436476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.464003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] MFA Rules not processed for user `d1efc5e8e97143a0810a7960aadd04bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:39.465438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:39.465750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e90c-ea48-4263-8ebc-1294bc9a042f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.481427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.484381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.484734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.486555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.488647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.494232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.557091 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2243/4458] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:39 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:39.561786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.573408 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2216/4459] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:39.574994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812830b-2b48-49dc-bd12-bf1e619ddfcf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.584522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.585168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.585452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.585727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.586467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.588180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.605333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2244/4460] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:39.607156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.623743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9a5ad-3801-4a7e-a351-6de9ba60067a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.629208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.630870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.631163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.632175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.632985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.634732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42efd46-3c31-4e24-9032-1e8a4218e689 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.656528 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2217/4461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:39.656888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.673559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1967ca-f1de-401e-9049-0a230fb10135 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.679194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.680138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.680420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.680910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] PATH_INFO: `/v3/projects/5bc94097cf6a486e929d3e0a31b05fcf/users/cbf091646cf6471aa3418d4f4f1262c3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.702764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc94097cf6a486e929d3e0a31b05fcf, user_id=cbf091646cf6471aa3418d4f4f1262c3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.707170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.730177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2245/4462] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:39 2022] PUT /identity/v3/projects/5bc94097cf6a486e929d3e0a31b05fcf/users/cbf091646cf6471aa3418d4f4f1262c3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:39.754693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.757446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.758427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.824337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] MFA Rules not processed for user `cbf091646cf6471aa3418d4f4f1262c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:39.826255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:39.941714 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2218/4463] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:39.947214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.958894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea6a3-8634-458b-bde0-25d2f268fa91 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:39.964556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf091646cf6471aa3418d4f4f1262c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bc94097cf6a486e929d3e0a31b05fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:39.972544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:39.973103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:39.973501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] PATH_INFO: `/v3/domains/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:39.975737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:39.980241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec9490-5d58-406a-b69d-3cf0c192e555 tempest-DefaultDomainTestJSON-166792032 tempest-DefaultDomainTestJSON-166792032-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:39.987527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:39.988521 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2246/4464] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:04:40.055130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:40.097530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1cb82-ba74-4565-864d-41c9924522c3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:40.110144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:40.112364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:40.113025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:40.113025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] PATH_INFO: `/v3/users/cbf091646cf6471aa3418d4f4f1262c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:40.115454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf091646cf6471aa3418d4f4f1262c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:40.118404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:40.213582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf091646cf6471aa3418d4f4f1262c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:40.214853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf091646cf6471aa3418d4f4f1262c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:40.223153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf091646cf6471aa3418d4f4f1262c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:40.224157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf091646cf6471aa3418d4f4f1262c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:40.238646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf091646cf6471aa3418d4f4f1262c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:40.261898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2219/4465] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:39 2022] DELETE /identity/v3/users/cbf091646cf6471aa3418d4f4f1262c3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:40.268336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:40.269038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:40.270663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:40.328962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:40.330045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:40.411921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:40.415130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:40.454006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2247/4466] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:40.465250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:40.467498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:40.572154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bebc9e-3151-4d45-af0d-32232b063914 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:40.579308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26f9e-64a8-433a-a0d7-63f1b27d1eca None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:40.582169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:40.583062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:40.583699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:40.584148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:40.586881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:40.587770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:40.588174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:40.588290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:40.588713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:40.606581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:40.608342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:40.633489 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2248/4467] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:40.681010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:40.683057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637da3-b148-4e9b-baab-0009a5de34cd service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:40.722518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:40.767147 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2220/4468] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:41.146973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.148720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:41.178363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f9b60-85c2-41d8-8ee9-9b11880ef5c6 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.187086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.189044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.189311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.190042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] PATH_INFO: `/v3/projects/5bc94097cf6a486e929d3e0a31b05fcf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.192118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc94097cf6a486e929d3e0a31b05fcf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.197932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.231681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:41.284319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc94097cf6a486e929d3e0a31b05fcf', 'request_id': 'req-f8bb6740-5bbc-467d-8b15-cc508b40dcef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:41.292237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc94097cf6a486e929d3e0a31b05fcf', 'request_id': 'req-f8bb6740-5bbc-467d-8b15-cc508b40dcef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:41.299197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc94097cf6a486e929d3e0a31b05fcf', 'request_id': 'req-f8bb6740-5bbc-467d-8b15-cc508b40dcef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:41.319556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] The token cache is being invalidate because project 5bc94097cf6a486e929d3e0a31b05fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:41.319990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:41.320641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f8bb6740-5bbc-467d-8b15-cc508b40dcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:41.323991 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2249/4469] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:41 2022] DELETE /identity/v3/projects/5bc94097cf6a486e929d3e0a31b05fcf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:41.329620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.331430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.331875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.367447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:41.369042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:41.474610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.475212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.475212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.479118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2221/4470] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:41.497160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:41.498719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:41.514441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.522767 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2250/4471] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:41.527390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de3917-3f52-4108-81cc-5ecc7955b3b1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.535729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.536735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.537192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.537633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.538549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:41.539034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.540879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.560394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.571648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2222/4472] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:41.578012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4496-0482-43f7-aea5-57475ad1c268 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.584893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.585995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.586495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.586977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.588350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.590630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.641034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2251/4473] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:41 2022] POST /identity/v3/projects => generated 359 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:41.645803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.665521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ece3f-df97-4842-a9a1-8d132fa28b06 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.762026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.762719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.763652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.763652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.764163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.766107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.792398 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2223/4474] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:41 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:41.796186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.808433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60592e-fd9c-4bc1-a465-f3e273934352 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.813824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.814381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.814995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.815439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.817148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.819236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.834033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2252/4475] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:41.838875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.852408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5fa2e-48ab-4283-8b09-f54fe9f752f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.858367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.859055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.875726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.877647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:41.880536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:41.885932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b6008-f8fd-4195-9ae5-fbc1c19b27fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:41.930872 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2224/4476] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:41.935075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:41.955595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6e17c-f831-472a-a177-b5d1f0399279 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:41.968152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:41.969650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:41.970247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:41.970725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] PATH_INFO: `/v3/projects/764ad3cd11b94f6bb9a2ecb4cf4a5943/users/7dfcccee814747f9813019c3951bc2b9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.006270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764ad3cd11b94f6bb9a2ecb4cf4a5943, user_id=7dfcccee814747f9813019c3951bc2b9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:42.010940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:42.045771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217237d-cc1d-4b00-a40b-dd8711abcefe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.046346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217237d-cc1d-4b00-a40b-dd8711abcefe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.046836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217237d-cc1d-4b00-a40b-dd8711abcefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.048390 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2253/4477] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:41 2022] PUT /identity/v3/projects/764ad3cd11b94f6bb9a2ecb4cf4a5943/users/7dfcccee814747f9813019c3951bc2b9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:42.101706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b217237d-cc1d-4b00-a40b-dd8711abcefe None None] MFA Rules not processed for user `7dfcccee814747f9813019c3951bc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:42.103089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b217237d-cc1d-4b00-a40b-dd8711abcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.199027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:42.201498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.204878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.228811 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2225/4478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:42.249541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584697c8-ab0a-4d7f-8c3a-3325b5594e3c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.250069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584697c8-ab0a-4d7f-8c3a-3325b5594e3c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.250465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584697c8-ab0a-4d7f-8c3a-3325b5594e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.312707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-584697c8-ab0a-4d7f-8c3a-3325b5594e3c None None] MFA Rules not processed for user `7dfcccee814747f9813019c3951bc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:42.314251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-584697c8-ab0a-4d7f-8c3a-3325b5594e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.328811 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2226/4479] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:42.334429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.334788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.335169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.362294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] MFA Rules not processed for user `7dfcccee814747f9813019c3951bc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:42.364526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.368989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2227/4480] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:42.372901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.403278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f5cf1-de84-43f0-974c-cd278744fb72 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:42.410637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:42.411736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.412279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.412848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.433873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorizing `identity:check_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:42.436563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:42.469710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2228/4481] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Jun 4 21:04:42 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:42.474120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.496723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b47c-f773-42fb-904a-95a99e464018 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:42.503770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:42.505293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.505770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.506222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] PATH_INFO: `/v3/users/d1efc5e8e97143a0810a7960aadd04bd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.506354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae74b94-9c56-43d8-aaf7-0c9320eada4a tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:42.519558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:42.520340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.520523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.521096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.524188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1efc5e8e97143a0810a7960aadd04bd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:42.526395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:42.539958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:42.541754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:42.557123 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2229/4482] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Jun 4 21:04:42 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:42.560683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.576014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ac113-3717-451c-9be9-80ebc28d2551 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:42.589129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:42.589795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.590270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.590726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.613041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:42.625832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:42.659487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1efc5e8e97143a0810a7960aadd04bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:42.662847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:42.667745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2230/4483] 10.222.0.18 () {56 vars in 1265 bytes} [Sat Jun 4 21:04:42 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:42.671616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.684665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1efc5e8e97143a0810a7960aadd04bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:42.687222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1efc5e8e97143a0810a7960aadd04bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:42.688788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1efc5e8e97143a0810a7960aadd04bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:42.691651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed62ca4-412d-4ef1-8d20-84c91d5058fd tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:42.702139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:42.703088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.703371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.704068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.724966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.743859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a300f100-a72d-40de-ac05-7e8b534e884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1efc5e8e97143a0810a7960aadd04bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-81f9ae13-4c8a-4083-879a-a0e4ec645cec tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jun 04 21:04:42.763201 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 04 21:04:42.764396 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:04:42.765514 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:04:42.772298 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2231/4484] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Jun 4 21:04:42 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:04:42.776687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.776976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.777261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.781027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2254/4485] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:42 2022] DELETE /identity/v3/users/d1efc5e8e97143a0810a7960aadd04bd => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:42.786131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:42.786659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:42.787146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:42.811143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:42.813020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.848377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] MFA Rules not processed for user `7dfcccee814747f9813019c3951bc2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:42.850378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.862064 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2232/4486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:42.863361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:42.867493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:42.951922 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2255/4487] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:43.001789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:43.004823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:43.054478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a34b5-a7aa-4313-a924-25f5724803cc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.071476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.073578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.075965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.079449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.104746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:43.110591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:43.128670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2233/4488] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Jun 4 21:04:42 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:43.132594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:43.134028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba089e-e30e-4c1f-94f4-2d783cc45b22 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.140227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.141167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.143963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.144431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.157330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9372d-36d0-4f25-91bf-81615efb91c9 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.162384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:43.164209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:43.167467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.168350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.168839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.169203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.184684 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2256/4489] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:43.189715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:43.192284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:43.228869 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2234/4490] 10.222.0.18 () {56 vars in 1265 bytes} [Sat Jun 4 21:04:43 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:43.235237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:43.248261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e74ca-2d66-4f97-ae83-9686920b0d03 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.253426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dfcccee814747f9813019c3951bc2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.254168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.254455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.254795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.257417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-473ad730-db2a-4c50-9e29-00b00d103803 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 04 21:04:43.278386 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 04 21:04:43.279497 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:04:43.281182 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2257/4491] 10.222.0.18 () {56 vars in 1262 bytes} [Sat Jun 4 21:04:43 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:04:43.288710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:43.290256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:43.320053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2090-8cd7-4ab6-9da3-42f2796f89d5 tempest-TokensV3Test-537637907 tempest-TokensV3Test-537637907-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.326259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.327534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.327875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.328256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] PATH_INFO: `/v3/users/7dfcccee814747f9813019c3951bc2b9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.329955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dfcccee814747f9813019c3951bc2b9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:43.333241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:43.430290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dfcccee814747f9813019c3951bc2b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:43.431387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dfcccee814747f9813019c3951bc2b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:43.438313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:43.441866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dfcccee814747f9813019c3951bc2b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:43.444605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dfcccee814747f9813019c3951bc2b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:43.469697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dfcccee814747f9813019c3951bc2b9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:43.497884 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2235/4492] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:43 2022] DELETE /identity/v3/users/7dfcccee814747f9813019c3951bc2b9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:43.502696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.503263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.503347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.526294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:43.527854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:43.610573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2258/4493] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:43.697442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:43.699312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:43.848912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ae80-8d78-476a-b875-9826176e6b8e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:43.861801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:43.862759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:43.863170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:43.863743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:43.892281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:43.894038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:43.924721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2236/4494] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:45.124842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:45.131672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.153422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:45.188413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb5bd4-bde0-4c7f-b7bf-ca01b3d947c5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:45.208451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:45.209338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.209622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.209929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] PATH_INFO: `/v3/projects/14a59186aa064bcdb8e7551ce8fbb5ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.211466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a59186aa064bcdb8e7551ce8fbb5ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:45.213600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:45.322692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a59186aa064bcdb8e7551ce8fbb5ac', 'request_id': 'req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.338110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a59186aa064bcdb8e7551ce8fbb5ac', 'request_id': 'req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.342201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:45.343745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.349991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a59186aa064bcdb8e7551ce8fbb5ac', 'request_id': 'req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.365772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332c513-e0a8-42b3-af05-7f46da025ded service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:45.383283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] The token cache is being invalidate because project 14a59186aa064bcdb8e7551ce8fbb5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:45.383767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.384809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-aa6f9194-0c8b-4e5d-a66b-f3b59aa728b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.388272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2259/4495] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:45 2022] DELETE /identity/v3/projects/14a59186aa064bcdb8e7551ce8fbb5ac => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:45.394317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9b80-499e-4db8-bb05-1d64f8fec84e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.394600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9b80-499e-4db8-bb05-1d64f8fec84e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.394872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9b80-499e-4db8-bb05-1d64f8fec84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.452862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3a9d9b80-499e-4db8-bb05-1d64f8fec84e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:45.454680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a9d9b80-499e-4db8-bb05-1d64f8fec84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.522018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:45.522826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.523109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.523373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] PATH_INFO: `/v3/projects/764ad3cd11b94f6bb9a2ecb4cf4a5943` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.525396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764ad3cd11b94f6bb9a2ecb4cf4a5943)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:45.527328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:45.587808 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2260/4496] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:45.589345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.589582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.589963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.605628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'request_id': 'req-b1534054-e39d-4547-9ad0-432508feb320'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.612012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:45.613352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.615663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'request_id': 'req-b1534054-e39d-4547-9ad0-432508feb320'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.634206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764ad3cd11b94f6bb9a2ecb4cf4a5943', 'request_id': 'req-b1534054-e39d-4547-9ad0-432508feb320'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.657187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] The token cache is being invalidate because project 764ad3cd11b94f6bb9a2ecb4cf4a5943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:45.658185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.660567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b1534054-e39d-4547-9ad0-432508feb320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:45.668465 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2237/4497] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:45 2022] DELETE /identity/v3/projects/764ad3cd11b94f6bb9a2ecb4cf4a5943 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:45.672005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.672695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.673214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.686161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:45.706343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:45.710152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.716583 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2261/4498] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:45.717628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:45.742025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfae0f-dd06-49d7-87e9-425152daa835 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:45.742025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:45.742025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.742025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.742512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.742512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:45.742512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:45.742512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606e268-034e-4e21-a71d-9595710483ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:45.750437 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2238/4499] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:45.763185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2262/4500] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:45.763693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:45.777559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efeeea-eed8-426a-ba8c-a7fee277000e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:45.784928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:45.786430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.786979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.787706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.788948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:45.794013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:45.828543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.828837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.829116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.840976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2239/4501] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/projects => generated 397 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:45.845124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:45.866067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:45.867347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:45.892489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:45.979426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e102284-3c3f-483b-9c28-92ecff9d2c12 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:45.985328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:45.986036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:45.987023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:45.987255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:45.988342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:45.989982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.017033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2263/4502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:46.022717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.028305 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2240/4503] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:45 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:46.031449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.037799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55febe1f-9e65-42c6-9a4c-34a8949f4af4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.054590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfdfe5-4165-45a4-9178-f375ef88d2ec admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.067686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.068395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.068677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.068955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.069844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:46.070151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.072452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.076712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.077892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.078975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.084016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.086312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.090551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.103747 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2264/4504] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:46.114558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.122286 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2241/4505] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:46.123664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.136187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c64283-4227-42fc-8f0b-c833497672e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.142528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5c93-56a3-4645-bfc8-4bf425472cc6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.153402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.154696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.155148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.155648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.156759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.157139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.157985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.158202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.158660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.160366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.163954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.170580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.181069 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2242/4506] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:46.188186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.201944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360788d2-1c54-491f-97ec-d01743f7c9b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.217507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.218639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.218832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.219232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] PATH_INFO: `/v3/projects/b660d4778d47463e937498f98177da91/users/5c799c84ab97494bb59cc4a4b4353c51/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.243180 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2265/4507] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:46 2022] POST /identity/v3/projects => generated 361 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:46.247904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.266813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b660d4778d47463e937498f98177da91, user_id=5c799c84ab97494bb59cc4a4b4353c51, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.275069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.310612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2243/4508] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:46 2022] PUT /identity/v3/projects/b660d4778d47463e937498f98177da91/users/5c799c84ab97494bb59cc4a4b4353c51/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:46.310612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.318408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:46.388731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd94cc-97af-4780-9dab-da363efd3e3f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.435702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c12fc-ad36-4347-afbd-75091988a480 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.445682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.445682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.446033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.446548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.449399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:46.493641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.494735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.494735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.495124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.497712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.499895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6925540-9405-42b9-a2d0-1c8e00e469f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.506594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:46.531472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2266/4509] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:46 2022] POST /identity/v3/users => generated 281 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:46.532939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.533320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.533578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.556741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:46.558012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:46.561093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.563693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.571748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2267/4510] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:46.571748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.582481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7a70b-1b5f-468d-aaef-32c54ea009f5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.588322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.589006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.589287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.589636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.590391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.592454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.594953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:46.595378 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2244/4511] 10.222.0.18 () {60 vars in 1396 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3307 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:46.596778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.600233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:46.617965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03b088-5716-40d4-a5ab-0d415e1440ac service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.622174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.623370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.623782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.624267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.632101 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2268/4512] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:46.635809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.639722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.641575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.655387 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2245/4513] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:46.658566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b442-b7e6-4334-8cce-120c91c87da7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.669187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.669946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.670379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.670661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.671427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.673482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68a646-98b1-4f64-b75a-f6555e5bc1d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.687335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2269/4514] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:46.692032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:46.709654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8e0e0-7481-4788-ac42-0ea560e49164 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:46.718296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:46.720392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.721098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.721618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] PATH_INFO: `/v3/projects/c9d0dffb5048456caad82d53cdb67b44/users/d2db2ee85e2343aa9512f259d7ba1e3c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.745505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d0dffb5048456caad82d53cdb67b44, user_id=d2db2ee85e2343aa9512f259d7ba1e3c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:46.750185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:46.778340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2246/4515] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:46 2022] PUT /identity/v3/projects/c9d0dffb5048456caad82d53cdb67b44/users/d2db2ee85e2343aa9512f259d7ba1e3c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:04:46.789092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb328d-e249-4ad1-a7f3-89358d80e259 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:46.789386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb328d-e249-4ad1-a7f3-89358d80e259 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:46.789648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb328d-e249-4ad1-a7f3-89358d80e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:46.830824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dfeb328d-e249-4ad1-a7f3-89358d80e259 None None] MFA Rules not processed for user `d2db2ee85e2343aa9512f259d7ba1e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:46.833043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfeb328d-e249-4ad1-a7f3-89358d80e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:46.973658 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2270/4516] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:46.987413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:47.074046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc5fc-32fa-4a73-bca0-6e60e79065d7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:47.095016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:47.097976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:47.098285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:47.098731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] PATH_INFO: `/v3/users/d2db2ee85e2343aa9512f259d7ba1e3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:47.100517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2db2ee85e2343aa9512f259d7ba1e3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:47.103391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:47.220169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2db2ee85e2343aa9512f259d7ba1e3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:47.224726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2db2ee85e2343aa9512f259d7ba1e3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:47.249977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2db2ee85e2343aa9512f259d7ba1e3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:47.254362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2db2ee85e2343aa9512f259d7ba1e3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:47.301824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2db2ee85e2343aa9512f259d7ba1e3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:47.346592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2247/4517] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:46 2022] DELETE /identity/v3/users/d2db2ee85e2343aa9512f259d7ba1e3c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:47.352183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fce8-9177-4874-a7c5-2acf69512ec7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:47.352716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fce8-9177-4874-a7c5-2acf69512ec7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:47.352839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21fce8-9177-4874-a7c5-2acf69512ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:47.412101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fa21fce8-9177-4874-a7c5-2acf69512ec7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:47.415940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fa21fce8-9177-4874-a7c5-2acf69512ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:47.627573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2271/4518] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:47.681898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:47.684140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:47.698578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:47.933509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33b680-68ea-4d68-a888-d132bcf8c017 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:47.953081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:47.953803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:47.954092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:47.954373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:47.984442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:47.992085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:48.028515 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2248/4519] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:48.142929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.143560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.144681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.206596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] MFA Rules not processed for user `5c799c84ab97494bb59cc4a4b4353c51`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:48.207896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.311090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2272/4520] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:48.476787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:48.478505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.509640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515c0b-aad5-47bd-b280-42dfc607d083 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:48.527350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:48.528697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.528697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.528899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] PATH_INFO: `/v3/projects/c9d0dffb5048456caad82d53cdb67b44` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.530207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d0dffb5048456caad82d53cdb67b44)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:48.532200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:48.625744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d0dffb5048456caad82d53cdb67b44', 'request_id': 'req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:48.626620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:48.628374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.635977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d0dffb5048456caad82d53cdb67b44', 'request_id': 'req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:48.644905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d0dffb5048456caad82d53cdb67b44', 'request_id': 'req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:48.654518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3aa65-6cc7-4e01-8b37-7885acb6c9eb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:48.658247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:48.669438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] The token cache is being invalidate because project c9d0dffb5048456caad82d53cdb67b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:48.669644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:48.670822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f46d6a75-e5d3-4f9f-b594-2e7f7b53f8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:48.672961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2249/4521] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:48 2022] DELETE /identity/v3/projects/c9d0dffb5048456caad82d53cdb67b44 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:48.678932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.679908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.680293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.709359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:48.710743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.762203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:48.762945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.763226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.763624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.770380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.790534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:48.792309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad72a-070a-45d2-91c3-f8efdb028fad service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:48.815697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2273/4522] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:04:48.861345 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2250/4523] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:04:48.870103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.870464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.870674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.896052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:48.897641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:48.929493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:48.945614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e638f2c-a77b-47b1-916c-17337ff4439c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:48.947664 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2274/4524] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:48.959803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:48.961203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:48.962004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:48.964670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:48.967357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:04:48.967790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:48.972353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:48.995429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:48.997056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:49.003291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2251/4525] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:04:49.007728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:49.026036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014aca-c9c2-47fd-a60f-172c80e8696e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.039373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.041223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.041513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.041899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.042772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.044996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.063063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:49.100448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2252/4526] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:49 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:49.104576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:49.151718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ca3b-c47d-4a3f-89c5-7330281a5d89 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.190214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f66720-7e57-4fe1-9629-a14fc0ab29d0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.198931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.199684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.200057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.200597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.202107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.205385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7a99a-0d68-4f14-b480-b3d4a2717eb6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.235809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2253/4527] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:49 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:49.237850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.238152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.238448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.263488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] MFA Rules not processed for user `82f7fda07c394cce95c6f317ad334d68`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:49.265093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:49.350263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2254/4528] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:49.355411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:49.360379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.362272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.362820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.363083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.365372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b30f2-0207-4305-9c6c-741bdba630a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.369322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:49.371930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.372887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.373319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.373831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.374824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.377427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.393834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2255/4529] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:49.398934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:49.430551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7598e3-88c0-4f07-b343-f54b8b39b133 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.466237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.468509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:49.473455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.474376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.476892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.481897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.489389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.506702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2256/4530] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:49.508439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:49.526863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.529482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09c36-cae8-48a2-b1e9-8f2621ef19fc service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.535365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876e97-54ac-4d8b-8a74-fd1ec73e94ae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:49.551855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:49.553213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.555283 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2275/4531] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:49.571740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.572922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] PATH_INFO: `/v3/projects/75d0e7c51fb54238bb2f2c4884ffd8df/users/6b7c0bea84eb40be85dcaa59c335dddd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.610089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0e7c51fb54238bb2f2c4884ffd8df, user_id=6b7c0bea84eb40be85dcaa59c335dddd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:49.614652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:49.679393 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2257/4532] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:49 2022] PUT /identity/v3/projects/75d0e7c51fb54238bb2f2c4884ffd8df/users/6b7c0bea84eb40be85dcaa59c335dddd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:49.699446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:49.700309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:49.701595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:49.779371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] MFA Rules not processed for user `6b7c0bea84eb40be85dcaa59c335dddd`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:49.785011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:49.982667 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2276/4533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:49.982994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.090361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:50.126102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05710b0d-ddab-4529-93d4-45f601dd86c5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.155428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.156303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.156532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.157010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.157747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.164492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.241251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2258/4534] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:04:49 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:04:50.245458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.269558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf1466-930a-485e-b545-6a4a39a1e9f1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.381712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.382463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.382747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.383104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.383951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.385934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.428805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2277/4535] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:04:50 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:04:50.430389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.446752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d29c-bccc-4f43-95a4-c66c3b67040a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.453491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.454187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.454469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.454746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.455757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.458261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.478636 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2259/4536] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:50.483240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.499973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca603-ae65-4c82-a95f-885be509a638 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.514547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.516056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.516056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.516460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] PATH_INFO: `/v3/projects/d897340d9b484479973ec8170c590eb9/users/3fa738b74555411db2b362138bbfbba5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.566475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d897340d9b484479973ec8170c590eb9, user_id=3fa738b74555411db2b362138bbfbba5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.569773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.594631 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2278/4537] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:50 2022] PUT /identity/v3/projects/d897340d9b484479973ec8170c590eb9/users/3fa738b74555411db2b362138bbfbba5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:50.599026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.620873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9dec5-f0f7-42ff-8a89-6560c543a86e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.743376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.746756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.747908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.747908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.749127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.755645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ea8a-a479-4eda-ac31-a0c63eed260f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.777846 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2260/4538] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:04:50.782017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:50.800916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc358-8e70-4d11-9482-584e1fff5a3f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:50.849409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:50.850679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.851248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.851798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] PATH_INFO: `/v3/projects/d897340d9b484479973ec8170c590eb9/users/3fa738b74555411db2b362138bbfbba5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.855139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d897340d9b484479973ec8170c590eb9, user_id=3fa738b74555411db2b362138bbfbba5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:50.861310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:50.907277 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2279/4539] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:04:50 2022] PUT /identity/v3/projects/d897340d9b484479973ec8170c590eb9/users/3fa738b74555411db2b362138bbfbba5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:50.916110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:50.916498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:50.916789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:50.968810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] MFA Rules not processed for user `3fa738b74555411db2b362138bbfbba5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:50.971207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:51.115779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2261/4540] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:51.135987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:51.138805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:51.209304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:51.286841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74c893-3595-4d6b-993a-e0c248849f9b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:51.294501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:51.295816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:51.298641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:51.299539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:51.327405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:51.329506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:51.346814 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2280/4541] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:54.489540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:54.614758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:54.670207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31867dc-90a0-4ee4-b654-f4f8b757c054 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:54.681701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:54.683059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:54.685312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:54.686081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:54.690669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:54.838370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:54.841182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:54.877875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2262/4542] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:56.023719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:56.026062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:56.080165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf76967-67fd-4433-8f03-e21a7bdf7f11 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:56.106244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:56.106925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:56.111359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:56.111670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:56.345891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:56.350260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb929f-d6f2-4fb3-9b01-0b14818508a2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:56.399073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2281/4543] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:58.119264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:58.244362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4a365-7404-4eb1-966f-b60dfd6cfadc service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:58.251266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:58.253023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:58.253316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:58.253600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] PATH_INFO: `/v3/users/6b7c0bea84eb40be85dcaa59c335dddd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:58.259799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7c0bea84eb40be85dcaa59c335dddd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:58.262735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:58.356805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7c0bea84eb40be85dcaa59c335dddd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:58.359299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7c0bea84eb40be85dcaa59c335dddd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:58.376489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7c0bea84eb40be85dcaa59c335dddd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:58.380625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7c0bea84eb40be85dcaa59c335dddd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:58.407010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7c0bea84eb40be85dcaa59c335dddd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:58.411771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:58.437120 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2263/4544] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:58 2022] DELETE /identity/v3/users/6b7c0bea84eb40be85dcaa59c335dddd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:58.442584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:58.444667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:58.445136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:58.468812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:04:58.470311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:58.559413 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2282/4545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:04:58.568069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:58.574123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:58.670880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993203-1bc9-4999-8c2b-0b51a4c0af52 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:58.676371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:58.677067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:58.677353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:58.677635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:58.689796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:58.691245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:58.704083 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2264/4546] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:04:59.065889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:59.070628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:04:59.102035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637daa5-8345-44c3-98fb-7273b858812a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:59.112080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:59.113015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:59.113314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:59.113595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] PATH_INFO: `/v3/projects/75d0e7c51fb54238bb2f2c4884ffd8df` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:59.116227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d0e7c51fb54238bb2f2c4884ffd8df)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:59.118712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:59.194389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d0e7c51fb54238bb2f2c4884ffd8df', 'request_id': 'req-a4049873-446a-42e5-be84-f6a9aa7fbcbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.201655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d0e7c51fb54238bb2f2c4884ffd8df', 'request_id': 'req-a4049873-446a-42e5-be84-f6a9aa7fbcbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.204885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:59.210829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d0e7c51fb54238bb2f2c4884ffd8df', 'request_id': 'req-a4049873-446a-42e5-be84-f6a9aa7fbcbe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.233330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] The token cache is being invalidate because project 75d0e7c51fb54238bb2f2c4884ffd8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:04:59.234502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.235391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.239437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2283/4547] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:59 2022] DELETE /identity/v3/projects/75d0e7c51fb54238bb2f2c4884ffd8df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:04:59.244197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:04:59.259606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46686a-7732-4040-a410-e2f85d665d29 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:04:59.344340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:04:59.345315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:04:59.345958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:04:59.346266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] PATH_INFO: `/v3/users/3fa738b74555411db2b362138bbfbba5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:04:59.347578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa738b74555411db2b362138bbfbba5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:04:59.349620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:04:59.410218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa738b74555411db2b362138bbfbba5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.410889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa738b74555411db2b362138bbfbba5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.419696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa738b74555411db2b362138bbfbba5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.420597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa738b74555411db2b362138bbfbba5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.433823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-af1810fd-88ba-46ec-87a3-46ba9f114bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa738b74555411db2b362138bbfbba5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:04:59.450715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2265/4548] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:04:59 2022] DELETE /identity/v3/users/3fa738b74555411db2b362138bbfbba5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:00.036686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.039178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:00.054540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4049873-446a-42e5-be84-f6a9aa7fbcbe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.153327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.154642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.155120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.155617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] PATH_INFO: `/v3/projects/d897340d9b484479973ec8170c590eb9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.157116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d897340d9b484479973ec8170c590eb9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.160686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.246688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd897340d9b484479973ec8170c590eb9', 'request_id': 'req-f198b59f-4dd3-444f-9ed4-befa529e201a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:00.261636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd897340d9b484479973ec8170c590eb9', 'request_id': 'req-f198b59f-4dd3-444f-9ed4-befa529e201a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:00.270383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd897340d9b484479973ec8170c590eb9', 'request_id': 'req-f198b59f-4dd3-444f-9ed4-befa529e201a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:00.292520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] The token cache is being invalidate because project d897340d9b484479973ec8170c590eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:00.292822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:00.293568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f198b59f-4dd3-444f-9ed4-befa529e201a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:00.298702 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2284/4549] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:00 2022] DELETE /identity/v3/projects/d897340d9b484479973ec8170c590eb9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:00.301022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.301801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.302190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.326971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:00.328387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:00.340942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:00.419029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.420226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.420611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.423262 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2266/4550] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:00.442701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:00.444235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:00.461533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.469968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2285/4551] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:00.472739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd840655-8978-40ae-9938-5919d1524e33 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.478373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.479058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.479855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.480141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.481437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:00.481711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.484965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.514816 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2267/4552] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:00.519889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.535605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53efea-4e8e-43bb-919b-401dca96900d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.543338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.544271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.544732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.545442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.547254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.550522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.589028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2286/4553] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:00 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:00.589696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.601818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d0c0-ec8b-4579-b8ac-8a4fd2d7a1f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.717326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.718716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.719043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.719325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.720085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.722875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.754955 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2268/4554] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:00 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:00.756215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.776563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29389b5-8747-45fe-9744-e5366f473bff admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.786237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.786945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.787285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.788316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.788785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.791883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.811177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2287/4555] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:05:00.814687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.836196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1621e-bac1-429f-94ff-dc061db859e5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.847011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.848570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.848570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.848846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.851096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.853837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dabf1-ee7d-4573-8d50-1ff3483e6a96 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.872742 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2269/4556] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:00.878589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:00.894435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be0e6a-40ef-4060-9dbd-c862e1869f16 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:00.902149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:00.903564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:00.904162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:00.904454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] PATH_INFO: `/v3/projects/e986b2c583244a518d735a2a6b30811b/users/32b4c88962bb40af9bc5e376db484186/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:00.933796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e986b2c583244a518d735a2a6b30811b, user_id=32b4c88962bb40af9bc5e376db484186, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:00.938401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:00.993571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2288/4557] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:00 2022] PUT /identity/v3/projects/e986b2c583244a518d735a2a6b30811b/users/32b4c88962bb40af9bc5e376db484186/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:05:01.009156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:01.010199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:01.010800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:01.083369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] MFA Rules not processed for user `32b4c88962bb40af9bc5e376db484186`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:01.085793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:01.136718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:01.140780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:01.200013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:01.311982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72b7e7-c1d5-4c13-bbab-0dcbe480b2b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:01.327972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:01.330448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:01.330946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:01.331415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] PATH_INFO: `/v3/users/5c799c84ab97494bb59cc4a4b4353c51` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:01.332913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c799c84ab97494bb59cc4a4b4353c51)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:01.335073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:01.344000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2270/4558] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:01.396701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:01.398520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:01.434421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:01.468570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c799c84ab97494bb59cc4a4b4353c51'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:01.483589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c799c84ab97494bb59cc4a4b4353c51'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:01.484573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c799c84ab97494bb59cc4a4b4353c51'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:01.485773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c799c84ab97494bb59cc4a4b4353c51'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:01.506627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-315b1668-19e4-4eca-a8d8-10384ff3a066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c799c84ab97494bb59cc4a4b4353c51'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:01.544272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2289/4559] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:01 2022] DELETE /identity/v3/users/5c799c84ab97494bb59cc4a4b4353c51 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:01.619641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176d634-bc13-4f07-8ec9-290c45ccb75a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:01.790702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:01.791388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:01.791704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:01.791985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:01.797220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:01.961972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:01.963494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f107fb8-ec01-41d3-b47a-8a082bb7341a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:01.994181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2271/4560] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:02.531841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:02.532358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:02.532358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:02.534010 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2290/4561] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:05:02.545488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:02.545926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:02.546100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:02.665692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:02.671469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:02.696742 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2272/4562] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:02.714618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:02.721463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:02.748375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:02.750068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:02.753945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5f1c0-8788-4111-9fee-3edf1fb7ae78 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:02.776507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:02.779818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:02.780299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:02.781287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:02.837411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:02.842456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2ab95-f6aa-45e5-9c00-b274686188ca service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:02.870723 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2291/4563] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:02.891933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9757-81f2-4290-8047-09c0df637d98 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:02.898848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:02.904914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:02.905207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:02.905503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] PATH_INFO: `/v3/projects/b660d4778d47463e937498f98177da91` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:02.906843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b660d4778d47463e937498f98177da91)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:02.909171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:02.923629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:03.065828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b660d4778d47463e937498f98177da91', 'request_id': 'req-9ff55648-8df0-4cfc-ab7d-58adc6634539'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:03.074322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b660d4778d47463e937498f98177da91', 'request_id': 'req-9ff55648-8df0-4cfc-ab7d-58adc6634539'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:03.089271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b660d4778d47463e937498f98177da91', 'request_id': 'req-9ff55648-8df0-4cfc-ab7d-58adc6634539'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:03.115173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] The token cache is being invalidate because project b660d4778d47463e937498f98177da91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:03.115968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:03.117112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ff55648-8df0-4cfc-ab7d-58adc6634539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:03.119433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2273/4564] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:02 2022] DELETE /identity/v3/projects/b660d4778d47463e937498f98177da91 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:03.125813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.126102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.126383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.151039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:03.152335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:03.247711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.248068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.248276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.250307 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2292/4565] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:03.275799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:03.277617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:03.313185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.313415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2274/4566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:03.330363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad2d66-27da-4d58-a5b6-b46e32e17451 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.343670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.344522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.344902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.345317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.346365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:03.346595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.348491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.386570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2293/4567] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:05:03.390747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.415142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915900b-f764-4bdb-983d-c1ce6ffcc5df None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.420568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.421336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.421627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.421901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.422607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.424974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.475101 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2275/4568] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:03 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:03.475627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.485400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:03.490670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab9f-e40e-42d1-9f0f-6adeeafc80d5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.636040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.637331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.637331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.638455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.639747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.642283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.691787 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2294/4569] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:03 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:03.695664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.709303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d294b19-b452-4ca0-a370-62d79fcbd4c5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.715698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.717311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.717824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.718320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.719324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.723002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.751963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2276/4570] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:05:03.756020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.770949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc40e32-9735-44de-8498-18a5862e0d77 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.779745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.781747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.783122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.786588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.787956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.792850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf516a-b890-4ba3-b90a-9f05ab356904 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.829342 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2295/4571] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:03.832049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:03.846587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1a494-ef29-409d-8dae-0ba39794a2f6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:03.859799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:03.860738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.861178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.861480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] PATH_INFO: `/v3/projects/ee106eb4506843ffa58a26f486d2e0dd/users/1e858abe021e480686f6458e5b27ad24/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.886716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee106eb4506843ffa58a26f486d2e0dd, user_id=1e858abe021e480686f6458e5b27ad24, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:03.890915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:03.926497 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2277/4572] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:03 2022] PUT /identity/v3/projects/ee106eb4506843ffa58a26f486d2e0dd/users/1e858abe021e480686f6458e5b27ad24/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:03.933215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:03.933804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:03.934179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:03.959151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:03.962742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:04.084865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2296/4573] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:04.149965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:04.154969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:04.253623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a061-506d-4c24-a77c-b34f26eb5d33 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:04.258399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:04.258550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:04.258898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:04.259264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:04.272002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:04.273764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:04.288185 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2278/4574] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:11.601589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:11.605726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:11.642080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb64ffb-9ab2-4aa3-9d5e-1d75ccefcb2a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:11.658843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:11.659538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:11.661093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:11.661093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:11.690967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:11.751166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:11.752900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:11.784962 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2297/4575] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:11.958743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:11.960350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:12.082062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:12.208577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef5f6-438d-44b3-a29a-02711fb37d0f service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:12.215019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:12.239621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:12.241800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:12.242269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:12.244577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:12.303894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:12.306298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:12.333598 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2279/4576] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:14.195182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:14.196816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:14.223549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114f28-a169-4958-b67b-9ed9ac0da38b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:14.230189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:14.231328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:14.231946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:14.232429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] PATH_INFO: `/v3/users/21ae179d22a140f7a6ebccaeea7932db` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:14.233848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ae179d22a140f7a6ebccaeea7932db)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:14.236985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:14.334212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ae179d22a140f7a6ebccaeea7932db'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:14.350462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ae179d22a140f7a6ebccaeea7932db'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:14.351491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ae179d22a140f7a6ebccaeea7932db'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:14.353147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ae179d22a140f7a6ebccaeea7932db'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:14.368986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:14.384892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-203bc79a-c4fd-4dd8-9ef8-fd6c0a1b5eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ae179d22a140f7a6ebccaeea7932db'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:14.408186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2298/4577] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:14 2022] DELETE /identity/v3/users/21ae179d22a140f7a6ebccaeea7932db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:15.678556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:15.709395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d7427-b8ca-4993-a76a-bb8c2e97a146 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:15.718898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:15.719460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:15.719460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:15.775406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] MFA Rules not processed for user `1e858abe021e480686f6458e5b27ad24`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:15.777055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:15.864860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:15.866412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:15.866865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:15.867251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] PATH_INFO: `/v3/projects/41a6c9f3ddbf4fb48fc2d1272c612739` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:15.868743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a6c9f3ddbf4fb48fc2d1272c612739)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:15.871066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:15.942577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2299/4578] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:15.958067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:15.960538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:15.967267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a6c9f3ddbf4fb48fc2d1272c612739', 'request_id': 'req-91a5ae8e-9029-4c85-9b71-e5742ba2d162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:15.977494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a6c9f3ddbf4fb48fc2d1272c612739', 'request_id': 'req-91a5ae8e-9029-4c85-9b71-e5742ba2d162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:15.985355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a6c9f3ddbf4fb48fc2d1272c612739', 'request_id': 'req-91a5ae8e-9029-4c85-9b71-e5742ba2d162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:16.017135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] The token cache is being invalidate because project 41a6c9f3ddbf4fb48fc2d1272c612739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:16.018196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:16.020812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91a5ae8e-9029-4c85-9b71-e5742ba2d162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:16.025066 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2280/4579] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:15 2022] DELETE /identity/v3/projects/41a6c9f3ddbf4fb48fc2d1272c612739 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:16.030000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061431-9be9-4d51-bc99-1982dba989fc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.030391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061431-9be9-4d51-bc99-1982dba989fc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.032072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061431-9be9-4d51-bc99-1982dba989fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.093156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1a061431-9be9-4d51-bc99-1982dba989fc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:16.099305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1a061431-9be9-4d51-bc99-1982dba989fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:16.147673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76cf4-9abe-4e9c-88db-93f00001a715 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.237481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:16.284519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2281/4580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:16.299644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.299916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.300524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.332562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.333250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.335295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.335629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.346148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:16.367544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:16.380712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:16.381361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:16.419609 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2282/4581] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:16.421851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:16.448166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3947417-78c6-44db-bc71-aa59fca8d8f9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.466334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.467489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.470211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.471480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.472539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:16.476042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.477833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:16.510944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2283/4582] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:05:16.514259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:16.526063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.540296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:16.549761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c667bb7-51ca-4c99-80a9-58cf7a605207 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.562808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.563522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.563872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.564201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.565024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.592003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2300/4583] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:05:16.594171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:16.659192 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2284/4584] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:16 2022] POST /identity/v3/projects => generated 397 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:16.663177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:16.678100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cdd99-dd02-4f21-8a8c-923194113759 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.773879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.775104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.777060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.777506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.779473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.783393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:16.848048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2301/4585] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:16 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:16.852028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:16.869566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846634d-2dd3-4d4b-9170-4bd0e387431b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.882837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.883858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.885564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.886088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.891646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.894764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:16.910469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2285/4586] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:05:16.926066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:16.944072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e8ee-ec31-45e2-973d-d04bb9d419e5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:16.968403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:16.970384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:16.972314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:16.972895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:16.973992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:16.978866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1be87-54e2-4669-8750-529c31846e99 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:17.012222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2302/4587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:17.017059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:17.032792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea240fa-cb3c-45a3-a647-c117d91ad68e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:17.039328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:17.040968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:17.041646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:17.042141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] PATH_INFO: `/v3/projects/c84706a406b74729ad9fa567b79e26a7/users/65d70f6f9632426b8f71b9f3b87b43ec/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:17.065147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84706a406b74729ad9fa567b79e26a7, user_id=65d70f6f9632426b8f71b9f3b87b43ec, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:17.072978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:17.110393 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2286/4588] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:17 2022] PUT /identity/v3/projects/c84706a406b74729ad9fa567b79e26a7/users/65d70f6f9632426b8f71b9f3b87b43ec/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:17.115446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:17.115938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:17.116471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:17.163122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:17.164350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:17.286948 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2303/4589] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:17.653711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:17.655827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:17.749081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c5865-3d85-4b9c-b008-a38b5b31104d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:17.753355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:17.754189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:17.754710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:17.756078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:17.767615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:17.769405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01835bd-63f6-482e-97b9-9c1c5d3258f6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:17.785961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2287/4590] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:20.670864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:20.672400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:20.688974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8fae0-85db-4573-b429-6299d80e346e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:20.695165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:20.696557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:20.697060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:20.697549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] PATH_INFO: `/v3/users/5b4c3539c5534d2c844944f9be3f9963` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:20.710486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4c3539c5534d2c844944f9be3f9963)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:20.713739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:20.781440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:20.887268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4c3539c5534d2c844944f9be3f9963'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:20.944659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4c3539c5534d2c844944f9be3f9963'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:20.948618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4c3539c5534d2c844944f9be3f9963'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:20.951565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4c3539c5534d2c844944f9be3f9963'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:21.005326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4c3539c5534d2c844944f9be3f9963'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:21.047714 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2304/4591] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:20 2022] DELETE /identity/v3/users/5b4c3539c5534d2c844944f9be3f9963 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:21.055298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:21.056062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:21.056353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:21.105316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:21.106869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:21.369365 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2288/4592] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:21.401308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:21.403083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:21.552820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bbffd-708e-45e0-8a71-305c76e182e8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:21.566005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:21.567606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:21.568077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:21.570534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:21.605348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:21.614454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:21.640892 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2305/4593] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:21.797846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:21.803132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:21.821057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:21.936026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4dd59-38f7-4b7a-8c3e-1fe5190b92f0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:21.943701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:21.944561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:21.944874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:21.945141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:21.947176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:21.966790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:21.968980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8419f-e7f9-4ef2-b933-47550b8794e5 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:21.977066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:21.984171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.029168 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2289/4594] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:22.036724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52144e-d4ca-4343-9396-e5046015c093 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:22.043295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:22.044493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.045110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.046237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] PATH_INFO: `/v3/users/056d2db6425347eabfc1d1cb7802db75` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.048796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056d2db6425347eabfc1d1cb7802db75)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:22.051067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:22.080594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848c3c-0404-4c99-b4e0-57fa2c78d70e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.082568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848c3c-0404-4c99-b4e0-57fa2c78d70e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.083073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848c3c-0404-4c99-b4e0-57fa2c78d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.126195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-db848c3c-0404-4c99-b4e0-57fa2c78d70e None None] MFA Rules not processed for user `65d70f6f9632426b8f71b9f3b87b43ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:22.128214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db848c3c-0404-4c99-b4e0-57fa2c78d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.159624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056d2db6425347eabfc1d1cb7802db75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.172367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056d2db6425347eabfc1d1cb7802db75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.173525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056d2db6425347eabfc1d1cb7802db75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.174405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056d2db6425347eabfc1d1cb7802db75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.208655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056d2db6425347eabfc1d1cb7802db75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.214624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2290/4595] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:22.225911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.226290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.227484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.250028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2306/4596] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:21 2022] DELETE /identity/v3/users/056d2db6425347eabfc1d1cb7802db75 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:22.283401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] MFA Rules not processed for user `65d70f6f9632426b8f71b9f3b87b43ec`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:22.285024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.406831 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2291/4597] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:22.418028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:22.421810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:22.423993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.424668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.456524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:22.505806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:22.549967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea3587-6570-4253-9523-930a1c715ea1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:22.557270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:22.558786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.559273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.559777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] PATH_INFO: `/v3/users/32b4c88962bb40af9bc5e376db484186` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.562878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b4c88962bb40af9bc5e376db484186)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:22.565904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:22.621583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b0a99-a9bd-4b08-a1ea-bf3e37158ae2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:22.632031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:22.632786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.634619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.634980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.649281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:22.651481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:22.679819 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2307/4598] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:22.680832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:22.682613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.698451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b4c88962bb40af9bc5e376db484186'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.699623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b4c88962bb40af9bc5e376db484186'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.709957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b4c88962bb40af9bc5e376db484186'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.711989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b4c88962bb40af9bc5e376db484186'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.717010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104b0f-fd15-41c3-9d79-ccf01e394856 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:22.734869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:22.738667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.738958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.739248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] PATH_INFO: `/v3/projects/29ca718638c842a98bb90cc3adb3979f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.741274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ca718638c842a98bb90cc3adb3979f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:22.743701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:22.749122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5873acc3-5d4b-4347-a1ed-5cfe351e1329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b4c88962bb40af9bc5e376db484186'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.797593 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2292/4599] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:22 2022] DELETE /identity/v3/users/32b4c88962bb40af9bc5e376db484186 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:22.801593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:22.801821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:22.802189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:22.836631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:22.837767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.860819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ca718638c842a98bb90cc3adb3979f', 'request_id': 'req-a34a78e9-7db7-4715-81b2-f84241ebf695'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.881055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ca718638c842a98bb90cc3adb3979f', 'request_id': 'req-a34a78e9-7db7-4715-81b2-f84241ebf695'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.899302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ca718638c842a98bb90cc3adb3979f', 'request_id': 'req-a34a78e9-7db7-4715-81b2-f84241ebf695'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.923695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] The token cache is being invalidate because project 29ca718638c842a98bb90cc3adb3979f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:22.924480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.926549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:22.932845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2308/4600] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:22 2022] DELETE /identity/v3/projects/29ca718638c842a98bb90cc3adb3979f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:22.933725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:22.935124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:22.987161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2293/4601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:23.007655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:23.008937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:23.065727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a78e9-7db7-4715-81b2-f84241ebf695 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:23.075760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:23.076969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:23.077439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:23.077872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] PATH_INFO: `/v3/users/416e81041f5545889211b6f6f777a5cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:23.081907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416e81041f5545889211b6f6f777a5cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:23.088810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:23.169128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:23.173340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334ffdc-5db1-43ea-bbb0-daed7fca1e90 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:23.181894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:23.182684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:23.182972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:23.183253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:23.195466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:23.199300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:23.201294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d818d-d13b-4a82-9b87-4a8528152b65 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:23.214543 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2294/4602] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:05:23.246165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416e81041f5545889211b6f6f777a5cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:23.258028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416e81041f5545889211b6f6f777a5cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:23.259071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416e81041f5545889211b6f6f777a5cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:23.259931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416e81041f5545889211b6f6f777a5cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:23.286664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416e81041f5545889211b6f6f777a5cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:23.312874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2309/4603] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:22 2022] DELETE /identity/v3/users/416e81041f5545889211b6f6f777a5cb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:23.816350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:23.816655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:23.816924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:23.845150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] MFA Rules not processed for user `1e858abe021e480686f6458e5b27ad24`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:23.846729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:23.943562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2295/4604] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:24.001141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:24.003003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:24.062400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:24.065094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:24.307552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec403256-c730-492d-9dd9-65c44b43b086 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:24.322393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:24.323399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.323799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.327226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] PATH_INFO: `/v3/projects/54d9ccdbd9754f61ab39f91d928842fb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.330073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d9ccdbd9754f61ab39f91d928842fb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:24.336175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:24.345328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9637c-c0ee-4143-8c15-18c70b95ab43 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:24.353427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:24.354757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.355530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.356724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] PATH_INFO: `/v3/projects/e986b2c583244a518d735a2a6b30811b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.358638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e986b2c583244a518d735a2a6b30811b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:24.362244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:24.470551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d9ccdbd9754f61ab39f91d928842fb', 'request_id': 'req-d148ef62-a82e-452c-8f65-68fb7bf11c5d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.479542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e986b2c583244a518d735a2a6b30811b', 'request_id': 'req-a5cac294-c020-4269-870b-723b9238dca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.486678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d9ccdbd9754f61ab39f91d928842fb', 'request_id': 'req-d148ef62-a82e-452c-8f65-68fb7bf11c5d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.494097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e986b2c583244a518d735a2a6b30811b', 'request_id': 'req-a5cac294-c020-4269-870b-723b9238dca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.534167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d9ccdbd9754f61ab39f91d928842fb', 'request_id': 'req-d148ef62-a82e-452c-8f65-68fb7bf11c5d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.552247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e986b2c583244a518d735a2a6b30811b', 'request_id': 'req-a5cac294-c020-4269-870b-723b9238dca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.589971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] The token cache is being invalidate because project 54d9ccdbd9754f61ab39f91d928842fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:24.590360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.593469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.598248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2310/4605] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:23 2022] DELETE /identity/v3/projects/54d9ccdbd9754f61ab39f91d928842fb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:24.599074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] The token cache is being invalidate because project e986b2c583244a518d735a2a6b30811b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:24.599380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.600305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:24.601109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5cac294-c020-4269-870b-723b9238dca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.605566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:24.606887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2296/4606] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:24 2022] DELETE /identity/v3/projects/e986b2c583244a518d735a2a6b30811b => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:24.608598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e77-e1c7-4ba4-9b01-e2f474539233 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.610480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e77-e1c7-4ba4-9b01-e2f474539233 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.610783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed340e77-e1c7-4ba4-9b01-e2f474539233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.678937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ed340e77-e1c7-4ba4-9b01-e2f474539233 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:24.681522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed340e77-e1c7-4ba4-9b01-e2f474539233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:24.698486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:24.754244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ef62-a82e-452c-8f65-68fb7bf11c5d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:24.757400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:24.880656 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2297/4607] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:24.887180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabad-18e4-4967-acbc-27c7e7045cd9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.887180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabad-18e4-4967-acbc-27c7e7045cd9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.888887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcabad-18e4-4967-acbc-27c7e7045cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.907890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:24.908834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.909674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.910141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] PATH_INFO: `/v3/projects/8e8d612beb2b4d758bbae05a31ba753c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.911540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8d612beb2b4d758bbae05a31ba753c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:24.914069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:24.940228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-04dcabad-18e4-4967-acbc-27c7e7045cd9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:24.942076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-04dcabad-18e4-4967-acbc-27c7e7045cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:24.963730 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2298/4608] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:24.969564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13ef8-513c-437d-8cc5-a5b4c13e9fa5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:24.970371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13ef8-513c-437d-8cc5-a5b4c13e9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:24.970811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13ef8-513c-437d-8cc5-a5b4c13e9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:24.989907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8d612beb2b4d758bbae05a31ba753c', 'request_id': 'req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:24.997139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8d612beb2b4d758bbae05a31ba753c', 'request_id': 'req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:25.003727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8d612beb2b4d758bbae05a31ba753c', 'request_id': 'req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:25.010627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-36e13ef8-513c-437d-8cc5-a5b4c13e9fa5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:25.029081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] The token cache is being invalidate because project 8e8d612beb2b4d758bbae05a31ba753c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:25.029345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:25.031903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a53fe3c0-fd90-483e-b464-1a2cc41dffc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:25.033061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-36e13ef8-513c-437d-8cc5-a5b4c13e9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:25.034257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2311/4609] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:24 2022] DELETE /identity/v3/projects/8e8d612beb2b4d758bbae05a31ba753c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:25.035394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.035710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.036266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.076236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:25.080922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:25.136709 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2299/4610] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:25.137443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.137756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.138023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.160428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:25.161733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:25.178533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2300/4611] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:25.178533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.185721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd9deb-5793-463a-aef4-a9d720f08d7d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.195878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.197615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.197904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.198188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.198925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:25.199247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.200949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab3362-9979-428e-b4fa-859b9540cb34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.218959 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2301/4612] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:25.221028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.221334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.221615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.244350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:25.246077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:25.261975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2302/4614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:25.261975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.262561 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2312/4614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:25.262561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.276034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc688b-2bce-429a-9b77-867df1f4f969 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.295870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.296658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.298259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9483a-9f07-40f0-bd00-39b153786d89 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.298415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.298708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.302180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.304236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.313065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.313820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.314114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.314401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.315145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:25.315461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.317310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.320843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:25.342454 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2313/4615] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:25.342454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.368336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2e33d-a9d0-4673-8f3b-b813016fa873 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.380659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.381294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.381581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.383984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.387127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:25.387375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.389159 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2303/4616] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:25.392877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.392977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.439566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2314/4617] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:25.439566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.463767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945a07-e139-4cfb-a8b1-e0212dd499c6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.546938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768aead-cec0-493e-a4a8-fec356306ada admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.552808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.553591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.553879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.554157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.554908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.557398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.634758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2304/4618] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/projects => generated 367 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:25.637453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.649483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:25.690896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.691563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.692251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.692535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.693272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.700802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.769917 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2315/4619] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:25.770702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.781197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70509e-0684-4fca-ac96-52e0dd93d2b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.789726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.790423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.790993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.791288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.792108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.794107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.794700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80431fb-fdb7-4e73-b96d-9f3c241734a1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.809212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.809976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.810266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.810814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.811526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.821774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.841472 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2305/4620] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:25.842873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.858507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2316/4621] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:25.859237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:25.884634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7be79-22b2-4fe2-b610-9d577f0dbd37 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.945422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883ce96-5a05-46b8-87da-8768a86bc04d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:25.955627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.956570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.957034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.957495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.959152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.961602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.976337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:25.977171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:25.977662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:25.978091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:25.978995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:25.981300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:25.985571 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2306/4622] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:25.986167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.008486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614040-d371-4d93-85da-d95a9b8c8b73 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.018505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2317/4623] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:25 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:26.019808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.020403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.022266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.023057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.023925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.025694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.029172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.033052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae620d2d-877a-4e03-bbc7-be96bcc3c3ae admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.038689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.039367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.040038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.040321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.041088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.043327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.052437 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2307/4624] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:26.054359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.060260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2318/4625] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:26.061819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.073828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ca25a-17b7-4155-b5fc-a47c4b73d86a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.074622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98665ee-8b11-427e-8888-aeea41c265e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.082227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.082923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.083267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.083771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.084272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.084955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.086148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.086835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.087466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.088291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.090046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.093598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.101760 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2319/4626] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:26.102615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.115825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881755c5-296c-44ad-90bd-4c3b3f8f5a2f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.116668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2308/4627] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:26.118566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.135038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.137188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.137895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.139726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] PATH_INFO: `/v3/projects/19a8826f63e64a8ca9bcd72dcb21a38b/users/841b177180eb4dcea5acbd6b2acdd474/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.146583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec83c9-2aad-4948-887f-6336a040feea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.154887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.156592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.157039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.157620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] PATH_INFO: `/v3/projects/1f0909bee9c54ff5b0d5ae80fa14ec72/users/04eb11cc58d746098c11aa82d3c5e77c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.166811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a8826f63e64a8ca9bcd72dcb21a38b, user_id=841b177180eb4dcea5acbd6b2acdd474, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.170735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.185492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:26.185890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0909bee9c54ff5b0d5ae80fa14ec72, user_id=04eb11cc58d746098c11aa82d3c5e77c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.192364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.195856 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2320/4628] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:26 2022] PUT /identity/v3/projects/19a8826f63e64a8ca9bcd72dcb21a38b/users/841b177180eb4dcea5acbd6b2acdd474/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:26.197551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.223774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2309/4629] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:26 2022] PUT /identity/v3/projects/1f0909bee9c54ff5b0d5ae80fa14ec72/users/04eb11cc58d746098c11aa82d3c5e77c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:26.224710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.232976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.286074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:26.322746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef82253-07bf-4d9d-a569-0daf840a8618 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.330158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.330158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.330158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.330519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.332789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.355626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.367499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72654c-44df-4be8-bbaf-7f0cd01a441e service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.396651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2310/4630] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:26.397946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.400525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.400826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.423885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ea210-7438-4b42-a106-b454810104ac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.478036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] MFA Rules not processed for user `841b177180eb4dcea5acbd6b2acdd474`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:26.478036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.562010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.562936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.563227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.563599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.568492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.571187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e76b3-8c43-4c6e-ac1a-03cfc098ddc7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.604225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2321/4631] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:26.615105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754026-2821-4534-8875-a571303fdebb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.615405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754026-2821-4534-8875-a571303fdebb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.615883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754026-2821-4534-8875-a571303fdebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.676045 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2311/4632] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:26.677920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:26.707323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b3754026-2821-4534-8875-a571303fdebb None None] MFA Rules not processed for user `04eb11cc58d746098c11aa82d3c5e77c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:26.708844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3754026-2821-4534-8875-a571303fdebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.716714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92702a0-ed04-46df-9cbd-98f67e8d848e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:26.728355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:26.729569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.731257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.731383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] PATH_INFO: `/v3/projects/ad1d00f471f64d32b83682d1909e0125/users/1847f13f71814bc4a18366a2484e9d0c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.766116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1d00f471f64d32b83682d1909e0125, user_id=1847f13f71814bc4a18366a2484e9d0c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:26.774821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7ef55-68ca-4439-8e9c-a52fd7d568b8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:26.823633 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2312/4633] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:26 2022] PUT /identity/v3/projects/ad1d00f471f64d32b83682d1909e0125/users/1847f13f71814bc4a18366a2484e9d0c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:26.830301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.830806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.831285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.862401 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2322/4634] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:26.863679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:26.864024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:26.864541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:26.897872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] MFA Rules not processed for user `841b177180eb4dcea5acbd6b2acdd474`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:26.901769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] MFA Rules not processed for user `1847f13f71814bc4a18366a2484e9d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:26.902105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.903555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:26.942145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:27.035723 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2323/4635] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:27.038082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.042898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:27.056524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2313/4636] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:27.057061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.159251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:27.192094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9164b-eead-4cff-a4d5-47a7b0984c8a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.196524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.197390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.197840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.198274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.206605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3160-b7bd-4d09-9659-8e3db0b3ce4c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.211383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.214015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.214015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.214015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.214279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.216181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.260739 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2314/4637] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:27 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:27.261971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.264074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:27.291064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.292603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.306047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2324/4638] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:27.307175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.320021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688edb0-f42a-430d-8f7b-4724531c0a2d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.433737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.434864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.434864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.435031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.435757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.443898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.505754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2325/4639] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:27 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:27.514522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.524064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0e81-0723-45d6-b77a-b9ccc8846a54 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.526783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:27.533572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0803e-6b35-4ed6-8703-537cbd9f9b7e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.536451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.537228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.537583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.537865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.543999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.546794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.547156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.547565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.549343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.554463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.573072 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2326/4640] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:27.580442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.594930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb026e-b454-4a62-9fcc-1593c8f5733a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.603976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.604549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.604860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.605143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] PATH_INFO: `/v3/projects/8c024d688a6c4f5d899c2140ff7e0935/users/84f1bae624574a208bf623559dcdc60f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.634476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c024d688a6c4f5d899c2140ff7e0935, user_id=84f1bae624574a208bf623559dcdc60f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.638798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.652893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.655206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.666788 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2315/4641] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:27.667415 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2327/4642] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:27 2022] PUT /identity/v3/projects/8c024d688a6c4f5d899c2140ff7e0935/users/84f1bae624574a208bf623559dcdc60f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:27.671589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.684505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913326-d3af-4ab0-8761-21051896e6fa service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.804530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.805420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.805823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.806321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.807331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.810204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2bd2-9a45-4d76-843a-64af1ee31746 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.813617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:27.839991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:27.857747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030490fb-273d-49d7-af5c-e497fbc22333 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:27.858346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2316/4643] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:27.868861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:27.870219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.870783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.871358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] PATH_INFO: `/v3/projects/8c024d688a6c4f5d899c2140ff7e0935/users/84f1bae624574a208bf623559dcdc60f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.879783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c024d688a6c4f5d899c2140ff7e0935, user_id=84f1bae624574a208bf623559dcdc60f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:27.883830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:27.915083 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2328/4644] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:27 2022] PUT /identity/v3/projects/8c024d688a6c4f5d899c2140ff7e0935/users/84f1bae624574a208bf623559dcdc60f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:27.927432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:27.927772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:27.928076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:27.981429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] MFA Rules not processed for user `84f1bae624574a208bf623559dcdc60f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:27.982755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:28.151124 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2317/4645] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:28.158706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:28.173016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4e01-8930-4db5-9bd3-bb0ff7449161 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:28.178780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:28.179611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.179966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.180525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.181770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:28.182167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:28.184005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:28.227397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:28.232028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2329/4646] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:28.237722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76c622-fedd-4f71-8b38-09523ff61dd4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:28.247381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:28.248106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.248391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.248670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.249355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:28.251637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:28.326528 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2318/4647] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:28 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:28.330711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:28.348772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e448355-40aa-42ff-b75d-fb01915260a8 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:28.473686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:28.474313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.474606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.475621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.476421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:28.478294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:28.485490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefefc-2c88-483b-af7f-2177aff05339 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:28.501430 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2330/4648] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:28.513121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:28.514910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:28.669781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332254-9d01-440c-93a7-2c7be7ec2155 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:28.683669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:28.685178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.685823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.686333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.708993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:28.710960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:28.760343 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2319/4649] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:28.790669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd37cef-8238-47ff-b232-28c247f27470 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.791026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd37cef-8238-47ff-b232-28c247f27470 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.791311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd37cef-8238-47ff-b232-28c247f27470 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.793209 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2331/4650] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 21:05:28.819548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:05:28.845331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:28.872660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31770d66-afd0-4647-9a6b-1d121aba2db0 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:28.904609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:28.905419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:28.905419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:28.905735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects/45b2217342274f14980ebd2ae8689e08` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:28.906988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:get_project(project_id=45b2217342274f14980ebd2ae8689e08)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:28.909489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:28.921000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2320/4651] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:05:28 2022] GET /identity/v3/projects/45b2217342274f14980ebd2ae8689e08 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:05:29.310270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193460-ad70-460d-abb8-e41278688721 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.312497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193460-ad70-460d-abb8-e41278688721 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.313030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8193460-ad70-460d-abb8-e41278688721 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.315563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2332/4652] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:05:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:05:29.321194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:05:29.385612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:29.420485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b651ff4-4133-415e-b20f-d5db87f3cf15 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:29.447301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:29.453773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.454228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.454573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects/45b2217342274f14980ebd2ae8689e08` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.456418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:get_project(project_id=45b2217342274f14980ebd2ae8689e08)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:29.460324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:29.468959 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2321/4653] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:05:29 2022] GET /identity/v3/projects/45b2217342274f14980ebd2ae8689e08 => generated 371 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:29.558124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8193460-ad70-460d-abb8-e41278688721 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:29.592349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8193460-ad70-460d-abb8-e41278688721 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:29.602423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:29.603430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.604077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.604620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.605617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:29.606670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:29.611201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:29.662417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2333/4654] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:29.666632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:29.679915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b4d-d8c6-4a75-9ea9-34883e524aa1 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:29.688616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:29.689633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.690039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.690488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.691303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:29.693771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05bead-54cc-4e95-9539-5cd1f0a14a85 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:29.756202 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2322/4655] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:29 2022] POST /identity/v3/users => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:29.760231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:29.777655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e1cf5-8575-4dbe-ae12-9a505c2b393d tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:29.784331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:29.785023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.785317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.785656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.786409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:29.786729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:29.788591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:29.808551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2334/4656] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:29.826798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab08a-8f98-4b6e-af4d-3867079c0f63 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.827091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab08a-8f98-4b6e-af4d-3867079c0f63 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.827370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab08a-8f98-4b6e-af4d-3867079c0f63 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.829087 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2323/4657] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:05:29.841863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:05:29.869358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:29.898287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edd512-8968-4682-ba95-a08535b5d95c tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:29.904561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:29.906347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:29.906347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:29.906672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects/45b2217342274f14980ebd2ae8689e08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:29.908540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:get_project(project_id=45b2217342274f14980ebd2ae8689e08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:29.910595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:29.912877 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2335/4658] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:05:29 2022] GET /identity/v3/projects/45b2217342274f14980ebd2ae8689e08 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:30.154955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d47-530f-4bab-9d8c-e902c85f760f None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:30.155251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d47-530f-4bab-9d8c-e902c85f760f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:30.155553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93102d47-530f-4bab-9d8c-e902c85f760f None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:30.159877 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2324/4659] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:05:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:05:30.173604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:05:30.207125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:30.234191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c100-3511-4cda-a988-94357cde2c5f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:30.250539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:30.252644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:30.254377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:30.255368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects/45b2217342274f14980ebd2ae8689e08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:30.258565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:get_project(project_id=45b2217342274f14980ebd2ae8689e08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:30.266384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:30.270899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2336/4660] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:05:30 2022] GET /identity/v3/projects/45b2217342274f14980ebd2ae8689e08 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:30.352114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102d47-530f-4bab-9d8c-e902c85f760f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:30.382450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93102d47-530f-4bab-9d8c-e902c85f760f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:30.390399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:30.393353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:30.394905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:30.395457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/users/a3f8a46083744db7817e11c78a4d13b3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:30.405147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:30.421717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3f8a46083744db7817e11c78a4d13b3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:30.426740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:30.529422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f8a46083744db7817e11c78a4d13b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.530302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f8a46083744db7817e11c78a4d13b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.542056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f8a46083744db7817e11c78a4d13b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.542963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f8a46083744db7817e11c78a4d13b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.561055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f8a46083744db7817e11c78a4d13b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.591562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2325/4661] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:30 2022] DELETE /identity/v3/users/a3f8a46083744db7817e11c78a4d13b3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:30.596407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:30.598490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:30.626941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69865d76-0913-45e3-8de1-8e49e8f58f0e tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:30.701436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:30.715898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84f1bae624574a208bf623559dcdc60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c024d688a6c4f5d899c2140ff7e0935', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:30.716963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:30.717821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:30.718417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] PATH_INFO: `/v3/projects/45b2217342274f14980ebd2ae8689e08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:30.721584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45b2217342274f14980ebd2ae8689e08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:30.725243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:30.809653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b2217342274f14980ebd2ae8689e08', 'request_id': 'req-84d1cee3-1480-4b30-b55c-26ecabeea613'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.820731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b2217342274f14980ebd2ae8689e08', 'request_id': 'req-84d1cee3-1480-4b30-b55c-26ecabeea613'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.831443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b2217342274f14980ebd2ae8689e08', 'request_id': 'req-84d1cee3-1480-4b30-b55c-26ecabeea613'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.857108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] The token cache is being invalidate because project 45b2217342274f14980ebd2ae8689e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:30.865364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.866386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-84d1cee3-1480-4b30-b55c-26ecabeea613 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:30.872486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2337/4662] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:30 2022] DELETE /identity/v3/projects/45b2217342274f14980ebd2ae8689e08 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:30.878767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:30.880348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:31.022659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15f298-3a93-4590-96a0-7a8212a72dcc tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:31.142843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:31.144576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:31.144818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:31.145099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] PATH_INFO: `/v3/users/1847f13f71814bc4a18366a2484e9d0c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:31.148618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1847f13f71814bc4a18366a2484e9d0c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:31.152493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:31.242100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:31.316494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1847f13f71814bc4a18366a2484e9d0c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:31.318130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1847f13f71814bc4a18366a2484e9d0c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:31.335824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1847f13f71814bc4a18366a2484e9d0c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:31.337028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1847f13f71814bc4a18366a2484e9d0c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:31.369125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1847f13f71814bc4a18366a2484e9d0c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:31.395595 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2326/4663] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:30 2022] DELETE /identity/v3/users/1847f13f71814bc4a18366a2484e9d0c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:31.400729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:31.401331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:31.401686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:31.420583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:31.421898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:31.484130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2338/4664] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:31.494506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:31.495960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:31.574225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fff6-f56a-4396-afcc-74de511a1e53 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:31.580279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:31.581351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:31.581832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:31.582284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:31.596395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:31.598384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:31.612043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2327/4665] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:33.254424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:33.256435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:33.279758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6fdc7-d7f5-4bb2-9481-3491ac897289 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:33.289783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:33.293711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:33.294034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:33.294434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] PATH_INFO: `/v3/projects/ad1d00f471f64d32b83682d1909e0125` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:33.300421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1d00f471f64d32b83682d1909e0125)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:33.300421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:33.444291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1d00f471f64d32b83682d1909e0125', 'request_id': 'req-a02dda27-23ca-4619-9f5f-d01a7efdc944'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.458556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1d00f471f64d32b83682d1909e0125', 'request_id': 'req-a02dda27-23ca-4619-9f5f-d01a7efdc944'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.476048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1d00f471f64d32b83682d1909e0125', 'request_id': 'req-a02dda27-23ca-4619-9f5f-d01a7efdc944'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.506321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] The token cache is being invalidate because project ad1d00f471f64d32b83682d1909e0125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:33.506673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.508736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.512641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2339/4666] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:33 2022] DELETE /identity/v3/projects/ad1d00f471f64d32b83682d1909e0125 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:33.518699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:33.530621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c81b8-dad0-4471-9d24-3db2b96e0ab1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:33.633193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:33.634306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:33.634771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:33.635207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] PATH_INFO: `/v3/users/84f1bae624574a208bf623559dcdc60f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:33.636756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f1bae624574a208bf623559dcdc60f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:33.639118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:33.757851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:33.761379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f1bae624574a208bf623559dcdc60f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.763251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f1bae624574a208bf623559dcdc60f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.785178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f1bae624574a208bf623559dcdc60f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.786425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f1bae624574a208bf623559dcdc60f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.817924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4a66c0-e991-4b7f-9d4f-0cb800e7677e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f1bae624574a208bf623559dcdc60f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:33.854318 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2328/4667] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:33 2022] DELETE /identity/v3/users/84f1bae624574a208bf623559dcdc60f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:35.045483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:35.049187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:35.112105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dda27-23ca-4619-9f5f-d01a7efdc944 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:35.122809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:35.251430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:35.252899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.253425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.254056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] PATH_INFO: `/v3/projects/8c024d688a6c4f5d899c2140ff7e0935` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.255658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c024d688a6c4f5d899c2140ff7e0935)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:35.258130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:35.371489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c024d688a6c4f5d899c2140ff7e0935', 'request_id': 'req-8c98e652-8191-4568-af22-74823cf8c2bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:35.394180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c024d688a6c4f5d899c2140ff7e0935', 'request_id': 'req-8c98e652-8191-4568-af22-74823cf8c2bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:35.420509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c024d688a6c4f5d899c2140ff7e0935', 'request_id': 'req-8c98e652-8191-4568-af22-74823cf8c2bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:35.450593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] The token cache is being invalidate because project 8c024d688a6c4f5d899c2140ff7e0935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:35.450972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:35.451725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c98e652-8191-4568-af22-74823cf8c2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:35.454246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2340/4668] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:35 2022] DELETE /identity/v3/projects/8c024d688a6c4f5d899c2140ff7e0935 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:35.460235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.460742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.460867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.485652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:35.487061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:35.571465 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2329/4669] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:35.579983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.580279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.580560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.606939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:35.608724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:35.620397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2341/4670] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:35.624450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:35.638449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c3b0-21a7-4650-90db-26bcba62b89c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:35.648926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:35.649825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.650297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.650781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.651729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:35.652461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:35.654499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:35.669886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2330/4671] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:35.674173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:35.689936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa337-b790-42e8-9933-112554a79ff1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:35.703369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:35.704818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.705472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.705957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.706946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:35.710157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:35.768693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:35.769502 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2342/4672] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:35 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:35.784029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e734a59-d437-4895-bc6f-eb98bf3e22d3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:35.888646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:35.889947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.890470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.891006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.892326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:35.894744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:35.923886 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2331/4673] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:35 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:05:35.929159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:35.948261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f180-4637-473b-b4aa-363e20c41177 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:35.953243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:35.954227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:35.954803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:35.960929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:35.961785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:35.968492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.000229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2343/4674] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:36.006928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.023071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055268a1-267a-4875-9351-f23f78407ca7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.029997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.034339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.034650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.034933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.035780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.037577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627a50-02e0-4e8c-bd5f-8b53a0c9de67 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.070442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.079080 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2332/4675] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:36.089075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1efc2-11a7-4d49-acd6-85cc10c7de90 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.095368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.096167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.096607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.096956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] PATH_INFO: `/v3/projects/1d1e59ed0baa4711bef7dc6059ed7208/users/6c8144dbe9274b64967674258aa62739/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.118995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1e59ed0baa4711bef7dc6059ed7208, user_id=6c8144dbe9274b64967674258aa62739, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.123170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.175014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2344/4676] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:36 2022] PUT /identity/v3/projects/1d1e59ed0baa4711bef7dc6059ed7208/users/6c8144dbe9274b64967674258aa62739/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:36.176218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.176593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.176767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.224671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] MFA Rules not processed for user `6c8144dbe9274b64967674258aa62739`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:36.227969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:36.253971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:36.365299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.368822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2333/4677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:36.428487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:36.501354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd8378-c025-40db-abeb-16914e36631f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.509984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.510861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.511623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.512311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.513305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.516969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.566931 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2345/4678] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:36 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:36.571203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.590219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62001635-fff7-481c-8c58-864af4a21ac5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.689541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.690321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.690841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.691011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.691902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.694419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.720081 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2334/4679] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:36 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:36.721403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.733914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a720-2176-45b2-80b0-1a4137f929bf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.742301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.743465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.744191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.744625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.745900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.749294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.769284 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2346/4680] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:36.773561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.789247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37021d0b-273e-4471-9a02-334b786b3106 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.794232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.795649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.795649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.796262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] PATH_INFO: `/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c/users/d066d741cf9941a4976cd3b51134993c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.820722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb9ba4cad4841019f7ba92b59b15f1c, user_id=d066d741cf9941a4976cd3b51134993c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.824139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.845409 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2335/4681] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:36 2022] PUT /identity/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c/users/d066d741cf9941a4976cd3b51134993c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:36.849384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.864151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dc5ef-341d-49a8-b2b4-6c18f2006431 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.947417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.948842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.948842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.949070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.949710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.951338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295f134-4a5f-4355-9ddb-7f49decae790 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:36.965467 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2347/4682] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:36.969495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:36.985937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa801a41-7375-4fab-bea0-9916cce185a1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:36.991018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:36.992187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:36.992475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:36.992749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] PATH_INFO: `/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c/users/d066d741cf9941a4976cd3b51134993c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:36.994807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb9ba4cad4841019f7ba92b59b15f1c, user_id=d066d741cf9941a4976cd3b51134993c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:36.997641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e522a-906a-488e-baeb-f6d26a3b2790 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:37.014044 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2336/4683] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:36 2022] PUT /identity/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c/users/d066d741cf9941a4976cd3b51134993c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:37.026299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:37.027353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:37.027701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:37.060441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] MFA Rules not processed for user `d066d741cf9941a4976cd3b51134993c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:37.062990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:37.194146 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2348/4684] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:37.208764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:37.211075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:37.211663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:37.256410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] MFA Rules not processed for user `6c8144dbe9274b64967674258aa62739`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:37.257798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:37.357676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2337/4685] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:37.518753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:37.527137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:37.579888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:37.690492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccb13e-f310-45e3-bd42-3d2b1d5245f5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:37.700259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:37.701809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:37.702825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:37.703943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:37.722097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:37.723827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:37.736429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2349/4686] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:47.346485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:47.730532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=21 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:48.024674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:48.026464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.066071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:48.067813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.135088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b737c0-f51b-4c0f-9eb2-f019e023f3c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:48.141842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:48.142976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:48.143447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:48.144063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:48.152169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.185473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:48.187361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:48.202638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476945-9f07-4eb0-b1d3-c53abb2fa7df service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:48.214777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:48.215817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:48.216097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:48.216379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] PATH_INFO: `/v3/users/04eb11cc58d746098c11aa82d3c5e77c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:48.216940 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2338/4687] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:48.217998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04eb11cc58d746098c11aa82d3c5e77c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:48.220986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:48.314433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04eb11cc58d746098c11aa82d3c5e77c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.325059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04eb11cc58d746098c11aa82d3c5e77c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.326035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04eb11cc58d746098c11aa82d3c5e77c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.326718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04eb11cc58d746098c11aa82d3c5e77c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.347458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:48.348911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.354925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb7f22a-3def-4569-a356-104f25c93907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04eb11cc58d746098c11aa82d3c5e77c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.370527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2abba2-b583-45ca-bade-c47667f77b70 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:48.395360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:48.395679 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2350/4688] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:48 2022] DELETE /identity/v3/users/04eb11cc58d746098c11aa82d3c5e77c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:48.396773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:48.397746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:48.398141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] PATH_INFO: `/v3/users/65d70f6f9632426b8f71b9f3b87b43ec` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:48.398314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:48.398580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:48.398861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:48.402404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d70f6f9632426b8f71b9f3b87b43ec)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:48.404535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:48.434238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:48.437580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.506395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d70f6f9632426b8f71b9f3b87b43ec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.507656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d70f6f9632426b8f71b9f3b87b43ec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.523756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d70f6f9632426b8f71b9f3b87b43ec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.524514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d70f6f9632426b8f71b9f3b87b43ec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.537293 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2351/4689] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:48.542678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d70f6f9632426b8f71b9f3b87b43ec'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:48.548676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:48.550436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:48.565598 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2339/4690] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:05:48 2022] DELETE /identity/v3/users/65d70f6f9632426b8f71b9f3b87b43ec => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:05:48.581243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:48.633844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3bcc0-c09c-42c3-a869-ca4059500deb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:48.714111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:48.714971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:48.715788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:48.716172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:48.801727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:48.802863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cc321-1061-49d6-8666-805d2cdccdd8 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:48.822570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2352/4691] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:49.000484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.002680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:49.031120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0f38e-0970-4bf3-b27b-97f6a4b075c4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.037509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.038862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.038862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.039131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] PATH_INFO: `/v3/projects/c84706a406b74729ad9fa567b79e26a7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.041251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84706a406b74729ad9fa567b79e26a7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.043340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.104047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84706a406b74729ad9fa567b79e26a7', 'request_id': 'req-9a93959a-82f0-473c-a5ac-5343078659e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.113194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84706a406b74729ad9fa567b79e26a7', 'request_id': 'req-9a93959a-82f0-473c-a5ac-5343078659e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.115462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:49.121193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84706a406b74729ad9fa567b79e26a7', 'request_id': 'req-9a93959a-82f0-473c-a5ac-5343078659e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.158091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] The token cache is being invalidate because project c84706a406b74729ad9fa567b79e26a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:49.158389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.159617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9a93959a-82f0-473c-a5ac-5343078659e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.161233 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2340/4692] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:48 2022] DELETE /identity/v3/projects/c84706a406b74729ad9fa567b79e26a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:49.166488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.166795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.167082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.190510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:49.191682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:49.288438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2353/4693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:49.289096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.289392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.289672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.310583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:49.312768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:49.326981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.327733 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2341/4694] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:49.337922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeada98-57d1-4970-9697-4e0879ee1c81 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.344964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.345588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.345974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.346353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.347300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:49.347797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.349991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.368342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.373368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2354/4695] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:49.379303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540626c-b732-4db2-af1d-82d3cffaeb60 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.386354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.387278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.387278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.387631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.388447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.390963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.437252 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2342/4696] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:49.441964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.457619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ff04-5512-4b6a-84c8-d1b628cbff77 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.479681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:49.562003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.562844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.563567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.563865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.564619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.566915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.592531 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2355/4697] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:49.597460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.615750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db249275-7828-4a80-a0c2-79d8d66b4e38 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.622850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.625954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:49.638675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.642045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.644012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.644403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.645988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.663375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f87878-b354-4acd-a050-58cb673776e5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.664750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.671037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.673197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.673528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.673813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] PATH_INFO: `/v3/projects/1f0909bee9c54ff5b0d5ae80fa14ec72` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.675696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0909bee9c54ff5b0d5ae80fa14ec72)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.677719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.694807 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2343/4698] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:49.698887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.718486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615a791-72d3-47aa-8eab-3ca153072767 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.732862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.733656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.734005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.734375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.735245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.736976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.763651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2344/4699] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:49.764910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:49.771493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0909bee9c54ff5b0d5ae80fa14ec72', 'request_id': 'req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.781556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0909bee9c54ff5b0d5ae80fa14ec72', 'request_id': 'req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.783467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19a97-56eb-47d4-81e6-da2d8d78d16e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:49.788797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0909bee9c54ff5b0d5ae80fa14ec72', 'request_id': 'req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.818844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] The token cache is being invalidate because project 1f0909bee9c54ff5b0d5ae80fa14ec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:05:49.820687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.821928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6c80d3a-ff53-4062-ad61-3c02135ca9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:05:49.825710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2356/4700] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:05:49 2022] DELETE /identity/v3/projects/1f0909bee9c54ff5b0d5ae80fa14ec72 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:49.831680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7701d-d95f-4705-a99e-8706cb844c55 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.832010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7701d-d95f-4705-a99e-8706cb844c55 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.832291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7701d-d95f-4705-a99e-8706cb844c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.873999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-caf7701d-d95f-4705-a99e-8706cb844c55 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:49.876918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-caf7701d-d95f-4705-a99e-8706cb844c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:49.932546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:49.935182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.935469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:49.935770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] PATH_INFO: `/v3/projects/887ac9932d584f4b99b7b168721d9552/users/e2235426d43a4e98973a97ea8e45c1f4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:49.963427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887ac9932d584f4b99b7b168721d9552, user_id=e2235426d43a4e98973a97ea8e45c1f4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:49.966182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b28552-066e-4b81-b3b9-075ac7e3bc65 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:49.993158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2345/4701] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:49 2022] PUT /identity/v3/projects/887ac9932d584f4b99b7b168721d9552/users/e2235426d43a4e98973a97ea8e45c1f4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:05:49.999366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:49.999717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.000005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.017650 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2357/4702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:50.024862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:50.025941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.026206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:50.026336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.026528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.056192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:50.057477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:50.103434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:50.120380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2346/4703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:50.140275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.142470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:50.174645 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2358/4704] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:05:50.177125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.186027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:50.191562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e6abd-5803-403d-8c8d-4c296e590ebd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.197804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.198501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.199038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.199783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.201501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:05:50.201501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.203794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.244177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2359/4705] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:05:50.248418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.275253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e62e-63b6-4b7e-bf14-f80548eb0f87 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.284601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ec9b-f3d9-4acf-a608-6e394221c4fb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.285604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.286595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.286883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.287156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.288042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.291182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.295831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.297034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.298788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.299265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.326792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.328199 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2360/4706] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:50 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:50.329171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.332374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.356859 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2347/4707] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:50.419612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3814e8-b2fa-4948-a1f4-45a20ce062ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.425952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.426965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.427480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.428043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.428861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.431169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.471940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2361/4708] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:50 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:50.473317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.484734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48e8-76c2-450d-b429-32fff48bf049 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.498023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.499396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.499396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.499396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.500118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.501899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.517379 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2348/4709] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:50.521117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.542356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263ded-c3a8-4b31-904e-887d4c49400a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.557798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.558672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.558810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.559169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.559985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.563107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16601f6-a267-43db-9626-d72e11b3ce91 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.577377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2362/4710] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:50.581599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.598903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ab06-e6a7-4236-819d-daeed21bf59b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:50.605351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:50.606415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.606821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.607220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] PATH_INFO: `/v3/projects/ef9cacabe3c647c78aee94db67f82472/users/6518cce1f95a445ab09ba2708c3374d6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.627135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9cacabe3c647c78aee94db67f82472, user_id=6518cce1f95a445ab09ba2708c3374d6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:50.631090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:50.661893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2349/4711] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:50 2022] PUT /identity/v3/projects/ef9cacabe3c647c78aee94db67f82472/users/6518cce1f95a445ab09ba2708c3374d6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:50.664717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:50.665219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:50.665641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:50.710069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] MFA Rules not processed for user `6518cce1f95a445ab09ba2708c3374d6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:50.711362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:50.826346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:50.835595 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2363/4712] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:50.837056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:50.994916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad799bd8-e018-4f74-846e-5cb029ec8105 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.004149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.004857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.005144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.005425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.006139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.014594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.067181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2350/4713] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:05:50 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:51.071039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:51.087280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a446-c7f1-450c-ba97-01b828682864 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.281842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.282791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.283045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.283257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.285345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.287259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.336028 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2364/4714] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:05:51 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:05:51.339048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:51.354478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ce4a-1074-4013-8db6-d8f9c4f4f697 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.382275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.385543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.386085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.386543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.398940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.403008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.430317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2351/4715] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:51.434581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:51.453719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e612c1-e4e8-48b2-b036-87a84d6794b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.472523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.473452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.473745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.474028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] PATH_INFO: `/v3/projects/54728106e9074528b6a32c2a00ff8418/users/6592591b3bcc4b2db7e9d7dcf9a2500d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.524304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54728106e9074528b6a32c2a00ff8418, user_id=6592591b3bcc4b2db7e9d7dcf9a2500d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.528166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.563858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2365/4716] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:51 2022] PUT /identity/v3/projects/54728106e9074528b6a32c2a00ff8418/users/6592591b3bcc4b2db7e9d7dcf9a2500d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:51.565082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:51.577145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12dcf6-c140-4518-870d-e4bb3a48b0cb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.667646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.668611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.668992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.669364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.670946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.672999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ec802-2fac-4189-9d14-b147bf3e7131 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.677313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:51.698035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:51.714581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2352/4717] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:05:51.718931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d1f41-6a90-4600-ae95-93c5306d10a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:51.724939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:51.725905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.726190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.726469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] PATH_INFO: `/v3/projects/54728106e9074528b6a32c2a00ff8418/users/6592591b3bcc4b2db7e9d7dcf9a2500d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.729233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] RBAC: Authorizing `identity:create_grant(project_id=54728106e9074528b6a32c2a00ff8418, user_id=6592591b3bcc4b2db7e9d7dcf9a2500d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:51.733601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8377c-c844-4feb-88b6-504d7ad362df admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:51.741282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01843c9-7372-42dd-9917-d66bf5444e3a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.741584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01843c9-7372-42dd-9917-d66bf5444e3a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.742010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01843c9-7372-42dd-9917-d66bf5444e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.800815 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2366/4718] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:05:51 2022] PUT /identity/v3/projects/54728106e9074528b6a32c2a00ff8418/users/6592591b3bcc4b2db7e9d7dcf9a2500d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:05:51.815487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:51.815487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:51.815487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:51.847114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f01843c9-7372-42dd-9917-d66bf5444e3a None None] MFA Rules not processed for user `e2235426d43a4e98973a97ea8e45c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:51.856088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f01843c9-7372-42dd-9917-d66bf5444e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:51.860910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] MFA Rules not processed for user `6592591b3bcc4b2db7e9d7dcf9a2500d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:51.864172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:52.033998 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2353/4719] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:52.043996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2c13-169b-4b58-bb47-40f3df0fa406 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:52.044289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2c13-169b-4b58-bb47-40f3df0fa406 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:52.044577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b2c13-169b-4b58-bb47-40f3df0fa406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:52.055047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2367/4720] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:52.077462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:52.077462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:52.086105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-385b2c13-169b-4b58-bb47-40f3df0fa406 None None] MFA Rules not processed for user `e2235426d43a4e98973a97ea8e45c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:52.087373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-385b2c13-169b-4b58-bb47-40f3df0fa406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:52.114708 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2354/4721] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:52.116678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:52.117510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:52.117968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:52.161508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] MFA Rules not processed for user `e2235426d43a4e98973a97ea8e45c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:52.162844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:52.181642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:52.195049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2355/4722] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:52.235274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716e68-d8c8-4df5-a88b-20db22a407e5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:52.240316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:52.240984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:52.241266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:52.241557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:52.256261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:52.258274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:52.272832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2368/4723] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:05:52.462876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:52.475428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d0573-e417-4c29-a21c-85b29098ce26 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:52.481776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:52.483726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:52.484295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:52.485590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:52.520421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:05:52.522394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:52.606209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:52.608726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980fa5-1fea-4dc1-8809-50547e3cc2af service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:52.632715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2356/4724] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:05:52.678821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7cbce-b1d5-4053-a8f2-a53de57a2db3 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:05:52.688978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:05:52.689951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:52.690451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:52.690738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:52.705016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:05:52.708458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703639ac-3ef8-4c1e-b5ca-96e8e0b155de service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:05:52.720008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2369/4725] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:05:53.827392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:53.827954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:53.828391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:53.861000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] MFA Rules not processed for user `e2235426d43a4e98973a97ea8e45c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:53.866066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:53.880264 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2357/4726] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:05:55.477454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12025-df14-48b3-9986-1ff86be3d4a1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:05:55.478002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12025-df14-48b3-9986-1ff86be3d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:05:55.479777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12025-df14-48b3-9986-1ff86be3d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:05:55.521806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-21f12025-df14-48b3-9986-1ff86be3d4a1 None None] MFA Rules not processed for user `e2235426d43a4e98973a97ea8e45c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:05:55.524131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-21f12025-df14-48b3-9986-1ff86be3d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:05:55.544553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2370/4727] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:03.848154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=71 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:05.506133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=50 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:10.342596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:10.345250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:10.489006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967f5d9-39f0-4f0d-aebe-109177042ea3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:10.499974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:10.501727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:10.506661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:10.507028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] PATH_INFO: `/v3/users/841b177180eb4dcea5acbd6b2acdd474` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:10.511660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841b177180eb4dcea5acbd6b2acdd474)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:10.519588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:10.633140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841b177180eb4dcea5acbd6b2acdd474'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:10.634033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841b177180eb4dcea5acbd6b2acdd474'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:10.645731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841b177180eb4dcea5acbd6b2acdd474'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:10.652191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841b177180eb4dcea5acbd6b2acdd474'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:10.675429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841b177180eb4dcea5acbd6b2acdd474'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:10.710674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2358/4728] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:10 2022] DELETE /identity/v3/users/841b177180eb4dcea5acbd6b2acdd474 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:10.715480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:10.715991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:10.716093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:10.777387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:10.783501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:10.892345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2371/4729] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:10.923061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:10.925272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:11.037927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4a2d-6eba-4590-b5fb-c194e6a38690 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:11.043232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:11.044709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:11.045133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:11.047214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:11.087405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:11.089963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e8400-cd18-44ec-9bfa-55b6693bc086 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:11.111492 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2359/4730] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:11.902855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:11.905193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:11.921851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d6ac-60dd-43c4-8e17-89521b9b33b7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:11.930530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:11.931466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:11.931796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:11.932075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] PATH_INFO: `/v3/projects/19a8826f63e64a8ca9bcd72dcb21a38b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:11.934058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a8826f63e64a8ca9bcd72dcb21a38b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:11.936460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.011565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a8826f63e64a8ca9bcd72dcb21a38b', 'request_id': 'req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:12.019537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a8826f63e64a8ca9bcd72dcb21a38b', 'request_id': 'req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:12.026630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a8826f63e64a8ca9bcd72dcb21a38b', 'request_id': 'req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:12.048103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] The token cache is being invalidate because project 19a8826f63e64a8ca9bcd72dcb21a38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:12.048669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:12.049661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37a8a3fc-271f-4d6b-9b8f-bd624ff7f33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:12.052092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2372/4731] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:11 2022] DELETE /identity/v3/projects/19a8826f63e64a8ca9bcd72dcb21a38b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:12.057818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.058858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.059294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.083105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:12.085015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:12.120768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:12.251930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2360/4732] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:06:12.259919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.260643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.260643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.289503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:12.291113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:12.303341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2373/4733] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:12.312204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.326714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741c06e-b75f-4597-a1a5-d8e137d43f29 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:12.337959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:12.339619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.349908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.350309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.354325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:06:12.356902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:12.386972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.424377 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2361/4734] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:06:12.425770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.439300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace67-8e86-46dc-9ac2-7df65be5c02a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:12.450363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:12.451785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.454239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.454548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.456134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:12.461585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.526001 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2374/4735] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:12 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:12.533589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.559815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ac6d4-618a-4305-9fc6-5947d9430b7a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:12.707122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:12.708589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.709237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.709713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.711478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:12.720872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.800317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.801558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2362/4736] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:12 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:12.815801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a043c76-d296-4b57-ab70-fce9d76e5aaf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:12.843431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:12.844328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.844812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.845101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.846020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:12.855142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.884321 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2375/4737] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:12.887310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.912365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ab646-24f7-4ea2-a303-8e4d9a79ec56 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:12.933981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:12.936868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:12.937373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:12.937768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:12.938819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:12.944737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e077134-9572-4851-b442-dc443b33aa55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:12.969390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2363/4738] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:12.972985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:12.991556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870851-2d9f-4ee1-8487-fc65997253f2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:13.006220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:13.008358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:13.008827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:13.010085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] PATH_INFO: `/v3/projects/cfea83c42bb443459619d4d679aa1769/users/f290b5d01a074e2c9859488bd4ff1162/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:13.071784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfea83c42bb443459619d4d679aa1769, user_id=f290b5d01a074e2c9859488bd4ff1162, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:13.077214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:13.121673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2376/4739] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:12 2022] PUT /identity/v3/projects/cfea83c42bb443459619d4d679aa1769/users/f290b5d01a074e2c9859488bd4ff1162/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:13.128339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:13.128952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:13.129325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:13.166431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:13.168600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:13.360843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2364/4740] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:13.390198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:13.396901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:13.455075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:13.517122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe96b92-adf1-40b2-a518-ac38bf4bbe01 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:13.522247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:13.522921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:13.523213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:13.523742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:13.538219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:13.540488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:13.569083 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2377/4741] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:06:17.538738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:17.540929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:17.569144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3082e-095d-4d25-9411-1d5fb255abf5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:17.591646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:17.595597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:17.598587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:17.600249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] PATH_INFO: `/v3/users/82f7fda07c394cce95c6f317ad334d68` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:17.604190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f7fda07c394cce95c6f317ad334d68)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:17.612679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:17.689683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:17.736245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f7fda07c394cce95c6f317ad334d68'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:17.737402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f7fda07c394cce95c6f317ad334d68'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:17.746583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f7fda07c394cce95c6f317ad334d68'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:17.748230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f7fda07c394cce95c6f317ad334d68'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:17.785796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f7fda07c394cce95c6f317ad334d68'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:17.810866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2365/4742] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:17 2022] DELETE /identity/v3/users/82f7fda07c394cce95c6f317ad334d68 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:18.397719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:18.415629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18865d4b-2d5a-4acb-b41d-7f89c4e537fa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:18.604279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:18.605198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:18.605457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:18.605738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] PATH_INFO: `/v3/projects/5c275250b53146a2a6fbd1c15b484560` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:18.612605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c275250b53146a2a6fbd1c15b484560)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:18.614480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:18.679892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:18.681429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:18.722136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c275250b53146a2a6fbd1c15b484560', 'request_id': 'req-9522085e-9012-4676-b8d9-b71b497ee5df'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:18.744877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c275250b53146a2a6fbd1c15b484560', 'request_id': 'req-9522085e-9012-4676-b8d9-b71b497ee5df'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:18.759772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c275250b53146a2a6fbd1c15b484560', 'request_id': 'req-9522085e-9012-4676-b8d9-b71b497ee5df'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:18.788502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] The token cache is being invalidate because project 5c275250b53146a2a6fbd1c15b484560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:18.788805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:18.789934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9522085e-9012-4676-b8d9-b71b497ee5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:18.799529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2378/4743] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:18 2022] DELETE /identity/v3/projects/5c275250b53146a2a6fbd1c15b484560 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:18.802469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb9ca-4cd9-4397-ab7a-499969d5ccc1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:18.802750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb9ca-4cd9-4397-ab7a-499969d5ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:18.803033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb9ca-4cd9-4397-ab7a-499969d5ccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:18.845980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-439fb9ca-4cd9-4397-ab7a-499969d5ccc1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:18.848697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-439fb9ca-4cd9-4397-ab7a-499969d5ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:18.916240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306847-5593-412e-9fe7-61d051642d7b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:18.974018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:19.006018 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2379/4744] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:19.015819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.016417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.017672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.053839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:19.055929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:19.063977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.065388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.065834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.066281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.069805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2380/4745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:19.074626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.078092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:19.087206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe272c3-a56d-41df-9f84-622125511f58 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.094108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.095114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.095452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.096035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.096833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:06:19.097191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.099709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.120673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2381/4746] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:06:19.121768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.150466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767858-c7fd-4de0-9dfb-586b8caae05e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.162125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.162826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.163091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.163363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.167137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.170400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.222145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:19.279391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2382/4747] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:19 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:19.282414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.324170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.326517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.381978 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2366/4748] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:19.464068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444ad6-f0f7-4f67-a5cf-d43c2d95ad2a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.478389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.480005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.480377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.481217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.486339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.488824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.531830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2383/4749] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:19 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:19.536449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.586542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadbc4f-c362-469b-812d-64b08b299d74 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.599603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.600322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.600623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.600903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.601811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.603739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.628505 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2367/4750] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:06:19.633807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.671287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9b8b7-76a6-4985-b13f-d05fcade6657 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.689466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.692991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.695211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.695599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.698159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.703776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc563-21c3-4045-98fc-cbb2440f59f0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.745819 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2384/4751] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:19.749676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:19.767709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aee9e9-7888-4383-b68d-63539433346a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:19.788457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:19.789387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.789679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.789957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] PATH_INFO: `/v3/projects/22890ef5f2374c7580a9ab7bea24fb6f/users/0b94e34548fe42b0b1e5a0addb3a8962/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.834392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22890ef5f2374c7580a9ab7bea24fb6f, user_id=0b94e34548fe42b0b1e5a0addb3a8962, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:19.837613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:19.868703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2368/4752] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:19 2022] PUT /identity/v3/projects/22890ef5f2374c7580a9ab7bea24fb6f/users/0b94e34548fe42b0b1e5a0addb3a8962/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:19.874136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e44a-14b1-4ef4-ad70-60b2db789a7f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:19.875328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e44a-14b1-4ef4-ad70-60b2db789a7f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:19.875328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e44a-14b1-4ef4-ad70-60b2db789a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:19.929867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f5d5e44a-14b1-4ef4-ad70-60b2db789a7f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:19.931832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f5d5e44a-14b1-4ef4-ad70-60b2db789a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:20.113308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2385/4753] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:20.132519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:20.134418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:20.269942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51381379-771e-43c7-9486-b493db33b821 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:20.281445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:20.282252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:20.282536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:20.282817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:20.304681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:20.306153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d4863-dd0e-495c-bbdc-084978f8c19e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:20.343946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2369/4754] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:22.699498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:22.701177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:22.701693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:22.837387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] MFA Rules not processed for user `0b94e34548fe42b0b1e5a0addb3a8962`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:22.838773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:22.910646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:23.141271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2386/4755] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:23.152236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb851e-f9e5-42c1-83c7-0605dfddccae None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:23.152814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb851e-f9e5-42c1-83c7-0605dfddccae None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:23.152814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb851e-f9e5-42c1-83c7-0605dfddccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:23.175958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0efb851e-f9e5-42c1-83c7-0605dfddccae None None] MFA Rules not processed for user `0b94e34548fe42b0b1e5a0addb3a8962`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:23.179349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0efb851e-f9e5-42c1-83c7-0605dfddccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:23.196798 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2370/4756] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:23.325893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:23.329990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:23.479086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5ded-657a-4a3a-acf8-192b291644f1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:23.493116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:23.497216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:23.497903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:23.499097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:23.517739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:23.519388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:23.532317 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2387/4757] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:24.925829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c14a-7128-45bf-b94a-e3853e908d91 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:24.926993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c14a-7128-45bf-b94a-e3853e908d91 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:24.928528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97c14a-7128-45bf-b94a-e3853e908d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:24.979373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ee97c14a-7128-45bf-b94a-e3853e908d91 None None] MFA Rules not processed for user `f290b5d01a074e2c9859488bd4ff1162`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:24.981035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ee97c14a-7128-45bf-b94a-e3853e908d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:25.123882 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2371/4758] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:25.171716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:25.198151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efcbb1-b642-4cab-8218-5a2962a6632d service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:25.230032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:25.230657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:25.231675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:25.231932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:25.245387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:25.247011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:25.281153 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2388/4759] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:29.873082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947496-5300-46d1-ae56-77f5d8c45cae None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:29.873672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947496-5300-46d1-ae56-77f5d8c45cae None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:29.873672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18947496-5300-46d1-ae56-77f5d8c45cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:29.912411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-18947496-5300-46d1-ae56-77f5d8c45cae None None] MFA Rules not processed for user `f290b5d01a074e2c9859488bd4ff1162`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:29.913730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18947496-5300-46d1-ae56-77f5d8c45cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:29.932007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2372/4760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:35.262345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=58 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:38.984142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:38.986220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:39.014862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b306f12-f7e2-4456-a5f6-7b7c81d2330e service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:39.021860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:39.023164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:39.023631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:39.024052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] PATH_INFO: `/v3/users/6518cce1f95a445ab09ba2708c3374d6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:39.026171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6518cce1f95a445ab09ba2708c3374d6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:39.028444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:39.128165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6518cce1f95a445ab09ba2708c3374d6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:39.144699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6518cce1f95a445ab09ba2708c3374d6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:39.146326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6518cce1f95a445ab09ba2708c3374d6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:39.149746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6518cce1f95a445ab09ba2708c3374d6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:39.173125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6518cce1f95a445ab09ba2708c3374d6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:39.220859 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2389/4761] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:38 2022] DELETE /identity/v3/users/6518cce1f95a445ab09ba2708c3374d6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:39.227654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:39.228867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:39.229563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:39.288060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:39.292513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:39.323614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:39.461730 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2373/4762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:39.482238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:39.483991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:39.583085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8550f-d910-4126-8d27-55e9d2614e74 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:39.590961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:39.591877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:39.592448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:39.592963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:39.612396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:39.614098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:39.633345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2390/4763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:40.289598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:40.291752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:40.316689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029efb-1574-43f9-b6b0-7c4993035601 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:40.339361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:40.342565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:40.343893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:40.345335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] PATH_INFO: `/v3/projects/ef9cacabe3c647c78aee94db67f82472` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:40.348091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9cacabe3c647c78aee94db67f82472)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:40.356314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:40.449677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9cacabe3c647c78aee94db67f82472', 'request_id': 'req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.457366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9cacabe3c647c78aee94db67f82472', 'request_id': 'req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.466052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9cacabe3c647c78aee94db67f82472', 'request_id': 'req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.492396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] The token cache is being invalidate because project ef9cacabe3c647c78aee94db67f82472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:40.493047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.493992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.498977 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2374/4764] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:40 2022] DELETE /identity/v3/projects/ef9cacabe3c647c78aee94db67f82472 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:40.502961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:40.528321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506444da-45eb-4a76-9be9-a973aabb727c service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:40.651956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:40.655007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:40.656233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:40.656965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] PATH_INFO: `/v3/users/6592591b3bcc4b2db7e9d7dcf9a2500d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:40.661646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6592591b3bcc4b2db7e9d7dcf9a2500d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:40.664257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:40.730449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:40.804305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6592591b3bcc4b2db7e9d7dcf9a2500d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.818162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6592591b3bcc4b2db7e9d7dcf9a2500d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.832835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6592591b3bcc4b2db7e9d7dcf9a2500d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.834397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6592591b3bcc4b2db7e9d7dcf9a2500d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.855060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4c193f51-62fe-44a1-a83c-dc866c148f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6592591b3bcc4b2db7e9d7dcf9a2500d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:40.904570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2391/4765] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:40 2022] DELETE /identity/v3/users/6592591b3bcc4b2db7e9d7dcf9a2500d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:42.111535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:42.118618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:42.158910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa896c3-7e94-4b3f-bef6-9f7899cae89c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:42.326272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:42.329271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:42.329724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:42.330177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] PATH_INFO: `/v3/projects/54728106e9074528b6a32c2a00ff8418` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:42.332059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54728106e9074528b6a32c2a00ff8418)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:42.334208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:42.433960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:42.444484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54728106e9074528b6a32c2a00ff8418', 'request_id': 'req-8d085200-3505-4ab6-8a28-5fa820bca63e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:42.468086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54728106e9074528b6a32c2a00ff8418', 'request_id': 'req-8d085200-3505-4ab6-8a28-5fa820bca63e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:42.487260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54728106e9074528b6a32c2a00ff8418', 'request_id': 'req-8d085200-3505-4ab6-8a28-5fa820bca63e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:42.508994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] The token cache is being invalidate because project 54728106e9074528b6a32c2a00ff8418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:42.509413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:42.512553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8d085200-3505-4ab6-8a28-5fa820bca63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:42.515252 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2375/4766] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:42 2022] DELETE /identity/v3/projects/54728106e9074528b6a32c2a00ff8418 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:42.521977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:42.522992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:42.523592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:42.557500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:42.558980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:42.668578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2392/4767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:06:42.676983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:42.677315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:42.677647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:42.708784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:42.710370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:42.723715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2376/4768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:42.727493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:42.742246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56dca5-f865-4c21-bc2e-d2871e1c745e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:42.754020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:42.755066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:42.756705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:42.757456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:42.758620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:06:42.759555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:42.761580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:42.777552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2393/4769] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:06:42.782594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:42.800433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4886c1-8bab-463a-acff-9fd6521adcb2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:42.807804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:42.809279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:42.809728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:42.810546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:42.812194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:42.814501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:42.865257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2377/4770] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:42 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:42.870752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:42.883666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187e50-e1a2-4c4c-b10c-7f666b3b9ea4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.004725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.006192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.006639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.007282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.008415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.012162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:43.044614 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2394/4771] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:42 2022] POST /identity/v3/users => generated 282 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:43.048533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:43.072477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af721-0db9-47a3-8a09-ccd164b83916 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.087944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.088871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.089503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.090001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.092112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.097976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:43.132887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:43.134719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2378/4772] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:43.157606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52166c-95a4-4770-8d7d-260c98e43ba6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.169162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.169994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.170280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.170800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.172034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.176489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2fb1-0a61-4919-ba4e-9ff3e0029a8d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:43.190559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:43.210907 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2395/4773] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:43.214556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:43.234881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce94d5-9c6b-4ece-98fd-204415a46b22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.254270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.255361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.255620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.255904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] PATH_INFO: `/v3/projects/80676ad9c04049219a8f186021055d68/users/902dcd09c8644f259e5209a610faa21b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.298649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80676ad9c04049219a8f186021055d68, user_id=902dcd09c8644f259e5209a610faa21b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.307612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:43.348710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2379/4774] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:43 2022] PUT /identity/v3/projects/80676ad9c04049219a8f186021055d68/users/902dcd09c8644f259e5209a610faa21b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:43.361659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.363886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.363886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.422750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] MFA Rules not processed for user `902dcd09c8644f259e5209a610faa21b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:43.424878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:43.595433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2396/4775] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:43.600457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:43.736698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aafd21-17c5-4904-9b3c-f9bee7c29d91 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.742985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.743940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.744292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.744631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.748234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.750742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:43.800457 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2380/4776] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:43 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:43.803495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:43.820822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beeeeb-4fab-49ea-8781-dd6d3df95968 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:43.951269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:43.953584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:43.955812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:43.956308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:43.964551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:43.969239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.004681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2397/4777] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:43 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:06:44.008283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:44.026756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3a99-407f-46d3-a087-280e82d4c8a7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:44.042416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:44.043569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.045048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.045753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.049382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:44.055877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.090895 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2381/4778] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:44.095653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:44.111831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24122-5116-4d9c-9268-0f3c50e7e6cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:44.135911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:44.139225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.141097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.141679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] PATH_INFO: `/v3/projects/4787a385bfdb46678abdc8cba322e9cd/users/2983b935518742a6bc15609df74e00c3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.182505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4787a385bfdb46678abdc8cba322e9cd, user_id=2983b935518742a6bc15609df74e00c3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:44.185575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.212090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2398/4779] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:44 2022] PUT /identity/v3/projects/4787a385bfdb46678abdc8cba322e9cd/users/2983b935518742a6bc15609df74e00c3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:44.215327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:44.246416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03056ebc-ef14-4ae6-9912-8c1141e1a2f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:44.309717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:44.350581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:44.351770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.352157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.352838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.353833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:44.355723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956dde1-949d-4cb1-9a48-33c6de815e45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.369216 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2382/4780] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:44.378514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:44.408852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951773a8-7bdd-4a56-a766-0c1fedae6d1d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:44.434260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:44.446908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.448309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.448740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] PATH_INFO: `/v3/projects/4787a385bfdb46678abdc8cba322e9cd/users/2983b935518742a6bc15609df74e00c3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.457594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4787a385bfdb46678abdc8cba322e9cd, user_id=2983b935518742a6bc15609df74e00c3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:44.464395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.489404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2399/4781] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:44 2022] PUT /identity/v3/projects/4787a385bfdb46678abdc8cba322e9cd/users/2983b935518742a6bc15609df74e00c3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:06:44.498064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.498629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.500498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.565945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] MFA Rules not processed for user `2983b935518742a6bc15609df74e00c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:44.567497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:44.715390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2383/4782] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:44.737233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:44.739868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:44.835395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:44.861963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2471af3-bd64-479b-bd21-f166ad570a51 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:44.868728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:44.868728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:44.868728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:44.868728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:44.889578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:44.891552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:44.914044 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2400/4783] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:06:45.017456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:45.031688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29f450-3993-40d4-b46e-1dd1a79d126d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:45.035638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:45.036659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:45.037037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:45.037381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:45.116540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:45.118654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612c774-46db-4857-ac39-7f73fbac3029 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:45.145234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2384/4784] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:48.371043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:48.469838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62f0d-29d2-4f57-8556-cd2bfb49a7c9 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:48.476991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:48.477943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:48.478997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:48.479565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] PATH_INFO: `/v3/users/902dcd09c8644f259e5209a610faa21b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:48.481607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902dcd09c8644f259e5209a610faa21b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:48.484468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:48.567257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902dcd09c8644f259e5209a610faa21b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:48.577913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902dcd09c8644f259e5209a610faa21b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:48.579038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902dcd09c8644f259e5209a610faa21b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:48.580293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902dcd09c8644f259e5209a610faa21b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:48.598573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902dcd09c8644f259e5209a610faa21b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:48.639326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2401/4785] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:48 2022] DELETE /identity/v3/users/902dcd09c8644f259e5209a610faa21b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:48.647085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:48.647750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:48.647750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:48.704712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:48.706283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:48.804716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:48.829780 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2385/4786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:48.896462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:48.897868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:48.995332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb65cb-feaf-4c8b-a2f5-21086e42d421 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:49.001702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:49.002380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:49.002667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:49.002956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:49.016674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:49.018294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:49.035408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2402/4787] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:50.322117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:50.324198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:50.340911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb1417-81f9-4765-b411-57475a4440fd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:50.356099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:50.357157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:50.357579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:50.357946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] PATH_INFO: `/v3/projects/80676ad9c04049219a8f186021055d68` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:50.365164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80676ad9c04049219a8f186021055d68)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:50.367746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:50.460208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80676ad9c04049219a8f186021055d68', 'request_id': 'req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.484210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80676ad9c04049219a8f186021055d68', 'request_id': 'req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.492663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:50.495444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:50.508678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80676ad9c04049219a8f186021055d68', 'request_id': 'req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.522298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8229b-be17-4406-8e25-24ad03391f3b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:50.532020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:50.533278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] The token cache is being invalidate because project 80676ad9c04049219a8f186021055d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:50.533777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.535252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.540913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2386/4788] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:50 2022] DELETE /identity/v3/projects/80676ad9c04049219a8f186021055d68 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:50.545465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:50.549185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:50.625564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:50.626965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:50.627575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:50.628518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] PATH_INFO: `/v3/users/0b94e34548fe42b0b1e5a0addb3a8962` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:50.630681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b94e34548fe42b0b1e5a0addb3a8962)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:50.633398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:50.656980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4dea-7e02-4c74-9351-d7f673f1cfd3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:50.663812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:50.665006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:50.665829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:50.667392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] PATH_INFO: `/v3/users/2983b935518742a6bc15609df74e00c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:50.670275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2983b935518742a6bc15609df74e00c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:50.673424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:50.742767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b94e34548fe42b0b1e5a0addb3a8962'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.756790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b94e34548fe42b0b1e5a0addb3a8962'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.758066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b94e34548fe42b0b1e5a0addb3a8962'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.758721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b94e34548fe42b0b1e5a0addb3a8962'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.782727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b94e34548fe42b0b1e5a0addb3a8962'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.785005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2983b935518742a6bc15609df74e00c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.786023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2983b935518742a6bc15609df74e00c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.796706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2983b935518742a6bc15609df74e00c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.797815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2983b935518742a6bc15609df74e00c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.810529 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2403/4789] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:50 2022] DELETE /identity/v3/users/0b94e34548fe42b0b1e5a0addb3a8962 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:50.834647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2983b935518742a6bc15609df74e00c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:50.857215 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2387/4790] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:06:50 2022] DELETE /identity/v3/users/2983b935518742a6bc15609df74e00c3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:51.803903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:51.808162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:51.914828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f389a8b-e4b8-400b-ab2b-f65d49d1d0e7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:51.982481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:51.992678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:51.995600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.004386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:52.079455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.080367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.080654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.080932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] PATH_INFO: `/v3/projects/22890ef5f2374c7580a9ab7bea24fb6f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.082677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22890ef5f2374c7580a9ab7bea24fb6f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.085199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.156360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d0ac-a92d-4c4c-9ad9-dc3259af75fc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.189153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22890ef5f2374c7580a9ab7bea24fb6f', 'request_id': 'req-9f2de9d8-86a7-4252-8082-5c706368216c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.208845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22890ef5f2374c7580a9ab7bea24fb6f', 'request_id': 'req-9f2de9d8-86a7-4252-8082-5c706368216c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.226447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22890ef5f2374c7580a9ab7bea24fb6f', 'request_id': 'req-9f2de9d8-86a7-4252-8082-5c706368216c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.251636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] The token cache is being invalidate because project 22890ef5f2374c7580a9ab7bea24fb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:52.254293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.256037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2de9d8-86a7-4252-8082-5c706368216c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.258140 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2404/4791] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:51 2022] DELETE /identity/v3/projects/22890ef5f2374c7580a9ab7bea24fb6f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:52.263624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd100e-c22d-469f-ab20-59a674189faf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.264116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd100e-c22d-469f-ab20-59a674189faf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.264587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd100e-c22d-469f-ab20-59a674189faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.295674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9fdd100e-c22d-469f-ab20-59a674189faf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:52.298003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9fdd100e-c22d-469f-ab20-59a674189faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.301433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.303942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.304420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.304871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] PATH_INFO: `/v3/projects/4787a385bfdb46678abdc8cba322e9cd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.306793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4787a385bfdb46678abdc8cba322e9cd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.311083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.320594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2405/4792] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:52.324972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.325627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.329038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.372411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:52.376073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.393231 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2406/4793] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:52.401612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:52.415641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171e2e-2bcd-4b4b-97dc-a8c0bdbddccc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.454179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4787a385bfdb46678abdc8cba322e9cd', 'request_id': 'req-951559e7-435a-4c68-85e2-c377c5ad2480'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.464813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4787a385bfdb46678abdc8cba322e9cd', 'request_id': 'req-951559e7-435a-4c68-85e2-c377c5ad2480'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.485971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4787a385bfdb46678abdc8cba322e9cd', 'request_id': 'req-951559e7-435a-4c68-85e2-c377c5ad2480'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.531360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] The token cache is being invalidate because project 4787a385bfdb46678abdc8cba322e9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:06:52.531854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.537819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-951559e7-435a-4c68-85e2-c377c5ad2480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:06:52.539757 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2388/4794] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:06:51 2022] DELETE /identity/v3/projects/4787a385bfdb46678abdc8cba322e9cd => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:52.544972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b198c-8587-4a2c-88ba-041762bc6478 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.546033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b198c-8587-4a2c-88ba-041762bc6478 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.546521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b198c-8587-4a2c-88ba-041762bc6478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.560930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.563244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.564179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.564632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.565583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:06:52.566045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.568313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.585596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2407/4795] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:06:52.596382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:52.598962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.601600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-061b198c-8587-4a2c-88ba-041762bc6478 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:52.602933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-061b198c-8587-4a2c-88ba-041762bc6478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.616046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7191bc9-5195-47a9-8474-7f5070493674 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.623730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.628224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.637059 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2389/4796] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:52.639552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.639552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.639929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.641870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.642713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.645011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.650994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.678898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:52.680306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:52.697515 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2390/4797] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:52.701924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:52.716693 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2408/4798] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:52.719258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:52.722160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e331b8a-fefb-4211-ada6-b29ac59950cb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.769380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:52.779334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:52.816544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.817404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.817872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.818191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.819258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:06:52.819674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.821546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.898980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d2cd8-6f1a-44f8-9300-06867b37563f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.899906 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2391/4799] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:06:52.901662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:52.907488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.908368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.908911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.909287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.910145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.913557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.922238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcf946-e714-4cb9-ba2a-650ee922860b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:52.957592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:52.958292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:52.958585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:52.959060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:52.959819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:52.961892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:52.972712 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2409/4800] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:06:52.974787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.000509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f108-56d9-4007-ae07-0ebaef7051e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.007381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.008244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.008686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.009178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.010930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.013010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2392/4801] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:52 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:53.017424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.024620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.028673 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2410/4802] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:53.032617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.045514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4da2b3-0ff8-48af-a0cb-8788b6150596 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.151684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948848e1-bd8b-42ec-9a80-3ded6a86e55f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.158930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.159933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.160359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.160827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.161852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.164089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.168675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.169404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.169698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.169984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.170962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.172445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.185311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2411/4803] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:53.190055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.195735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2393/4804] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:53 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:53.200022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.204261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca39d-e0a7-49e2-ae92-16b41010aaf1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.219480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3199d-29d2-4c02-a1f7-678a1bc68c10 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.221711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.224143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.224515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.224864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] PATH_INFO: `/v3/projects/4695654467fe498e8535cd245a1de975/users/fb1e49a5a78544f0b59e135153a8771c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.231120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.232271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.232785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.233313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.236231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.238665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.248290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4695654467fe498e8535cd245a1de975, user_id=fb1e49a5a78544f0b59e135153a8771c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.252232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b995cd0-e094-4623-afc4-e9ef91896f14 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.259687 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2394/4805] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:53.262428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.278503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5328cc-e683-4aa0-b6d3-765f9190a58e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.281444 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2412/4806] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:53 2022] PUT /identity/v3/projects/4695654467fe498e8535cd245a1de975/users/fb1e49a5a78544f0b59e135153a8771c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:53.288057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.288606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.288999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.325252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:53.327072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:53.415164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.417157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.419387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.419387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.419387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.422178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.439645 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2413/4807] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:53.442336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2395/4808] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:53.445098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.451743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.457039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:53.458129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c3bd-d700-46f4-99e0-5207023877ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.464594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.465558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.466143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.466496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] PATH_INFO: `/v3/projects/b6190607daae4497896d8e5e2805c027/users/b9f8b3c9c3e246a1b5732248f352f6f7/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.486605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:53.490923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:53.501109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6190607daae4497896d8e5e2805c027, user_id=b9f8b3c9c3e246a1b5732248f352f6f7, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.504757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96335976-f50e-4492-bd26-69704760a486 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.533065 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2414/4809] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:53 2022] PUT /identity/v3/projects/b6190607daae4497896d8e5e2805c027/users/b9f8b3c9c3e246a1b5732248f352f6f7/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:53.543335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.544013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.545280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.582774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] MFA Rules not processed for user `b9f8b3c9c3e246a1b5732248f352f6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:53.584976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:53.593839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac388c1-07e8-4e35-8f2a-f7ac9540c85d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.677860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.679295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.679668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.679949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.724507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2415/4810] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:53.726477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.776589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.782519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.818483 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2396/4811] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:53.871889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fe72e-dab2-4be2-bedc-bb8696cee483 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:53.880105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:53.881317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:53.881975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:53.883804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:53.885618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:53.888678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:53.962435 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2416/4812] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:06:53 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:53.966291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:53.978990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a2f24-9b90-4824-a7d5-3513dbcc4c33 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:54.050943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:54.051689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.051937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.052217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.053080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:54.055202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:54.088839 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2397/4813] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:06:53 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:06:54.093725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:54.110260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cc93f-f474-4909-9f81-42a0f1aadb02 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:54.147163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:54.154842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.157386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.158519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.160990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:54.163294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:54.185449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2417/4814] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:54.189501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:54.210479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd26c-f452-4ab6-b53e-5e2cc1c58cb6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:54.224367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:54.227741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.228054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.228402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] PATH_INFO: `/v3/projects/decbbb81db7e4ca08723c90cca498fdf/users/dc08eb97bbe24940bc8964c74eb280d9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.243152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:54.303188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=decbbb81db7e4ca08723c90cca498fdf, user_id=dc08eb97bbe24940bc8964c74eb280d9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:54.316160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:54.385580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:54.397869 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2398/4815] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:54 2022] PUT /identity/v3/projects/decbbb81db7e4ca08723c90cca498fdf/users/dc08eb97bbe24940bc8964c74eb280d9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:54.402577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c99b1-0866-4f29-ad48-8a39bd469743 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:54.545967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:54.580234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:54.581548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.581844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.583641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.584450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:54.588244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3292af-5a3f-4a2c-aeb6-21fdcbcf9502 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:54.608845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2418/4816] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:06:54.611972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:54.637988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00965-e946-433a-b804-a23a12bdfbcf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:54.645858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:54.647660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.647951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.648232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] PATH_INFO: `/v3/projects/decbbb81db7e4ca08723c90cca498fdf/users/dc08eb97bbe24940bc8964c74eb280d9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.655256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=decbbb81db7e4ca08723c90cca498fdf, user_id=dc08eb97bbe24940bc8964c74eb280d9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:54.661713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:54.711673 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2399/4817] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:06:54 2022] PUT /identity/v3/projects/decbbb81db7e4ca08723c90cca498fdf/users/dc08eb97bbe24940bc8964c74eb280d9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:06:54.722400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297f57-79e5-494d-8fa2-88c1d94206b8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:54.722693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297f57-79e5-494d-8fa2-88c1d94206b8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:54.722971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297f57-79e5-494d-8fa2-88c1d94206b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:54.778551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0b297f57-79e5-494d-8fa2-88c1d94206b8 None None] MFA Rules not processed for user `dc08eb97bbe24940bc8964c74eb280d9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:54.779534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0b297f57-79e5-494d-8fa2-88c1d94206b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:54.881595 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2419/4818] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:06:54.889607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:54.893586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:54.999749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767af5-e258-43bb-8d8d-2b3ef1039a8f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:55.004693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:55.005534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:55.005875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:55.006160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:55.088980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:55.090849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9848c5f-3fd5-4f35-bc68-5782216a1839 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:55.104316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2400/4819] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:55.634025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:55.634476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:55.634615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:55.693105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] MFA Rules not processed for user `fb1e49a5a78544f0b59e135153a8771c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:55.693105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:55.895670 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2420/4820] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:55.900618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:55.901084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:55.901567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:55.927331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] MFA Rules not processed for user `fb1e49a5a78544f0b59e135153a8771c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:06:55.929352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:55.963736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2401/4821] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:06:56.006482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:56.008457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:56.141336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:56.151843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de74e1d-5086-41d8-bf56-8b904812475f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:56.169822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:56.171445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:56.171998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:56.172290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:56.187325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:56.193616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:56.221618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2421/4822] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:06:59.168182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:06:59.171213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:06:59.198916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652467f-adbb-4d54-9cc9-1e162cfe0983 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:06:59.204655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:06:59.205470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:06:59.205883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:06:59.206264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:06:59.238757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:06:59.241094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4effb34-2d41-4a7e-9054-bde80a38f3f4 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:06:59.293176 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2402/4823] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:00.788797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:00.790676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:00.872944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083c87-6aad-4122-9ac8-f2bd353b7d7c service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:00.878389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:00.879291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:00.879605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:00.879883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] PATH_INFO: `/v3/users/6c8144dbe9274b64967674258aa62739` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:00.881105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8144dbe9274b64967674258aa62739)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:00.883072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:01.010551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8144dbe9274b64967674258aa62739'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:01.055363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8144dbe9274b64967674258aa62739'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:01.058286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8144dbe9274b64967674258aa62739'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:01.059677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8144dbe9274b64967674258aa62739'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:01.088570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8144dbe9274b64967674258aa62739'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:01.121277 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2422/4824] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:00 2022] DELETE /identity/v3/users/6c8144dbe9274b64967674258aa62739 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:01.126269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:01.126793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:01.126793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:01.198692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:01.201545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:01.422875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2403/4825] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:01.446206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:01.447983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:01.565794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05a620-2a02-4352-8c6b-ec9a7719bad5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:01.570434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:01.571404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:01.571719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:01.572005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:01.583814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:01.585557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:01.598764 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2423/4826] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:02.517223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:02.519907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:02.542201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee0da-b454-463e-a33d-df1218b6881b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:02.557865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:02.558817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:02.559170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:02.559721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] PATH_INFO: `/v3/projects/1d1e59ed0baa4711bef7dc6059ed7208` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:02.562758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1e59ed0baa4711bef7dc6059ed7208)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:02.564833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:02.569546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:02.644860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1e59ed0baa4711bef7dc6059ed7208', 'request_id': 'req-852a3d3d-67bd-44db-8dd7-1960465e4139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.655713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1e59ed0baa4711bef7dc6059ed7208', 'request_id': 'req-852a3d3d-67bd-44db-8dd7-1960465e4139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.669549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1e59ed0baa4711bef7dc6059ed7208', 'request_id': 'req-852a3d3d-67bd-44db-8dd7-1960465e4139'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.684440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] The token cache is being invalidate because project 1d1e59ed0baa4711bef7dc6059ed7208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:02.684981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.685870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.688376 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2404/4827] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:02 2022] DELETE /identity/v3/projects/1d1e59ed0baa4711bef7dc6059ed7208 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:02.693135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:02.712816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e077b5-65d4-4778-9461-0b0b811fd8a1 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:02.722896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:02.815111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:02.816284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:02.817035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:02.817469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] PATH_INFO: `/v3/users/d066d741cf9941a4976cd3b51134993c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:02.818710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d066d741cf9941a4976cd3b51134993c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:02.821244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:02.884669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd066d741cf9941a4976cd3b51134993c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.895701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd066d741cf9941a4976cd3b51134993c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.896777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd066d741cf9941a4976cd3b51134993c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.898761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd066d741cf9941a4976cd3b51134993c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.915660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7a61560a-9d99-42e6-82f3-5a134bc6dbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd066d741cf9941a4976cd3b51134993c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:02.952264 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2424/4828] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:02 2022] DELETE /identity/v3/users/d066d741cf9941a4976cd3b51134993c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:03.340488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:03.342594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:03.368203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a3d3d-67bd-44db-8dd7-1960465e4139 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:03.445811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:03.447111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:03.447205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:03.447494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] PATH_INFO: `/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:03.449411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb9ba4cad4841019f7ba92b59b15f1c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:03.452046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:03.559199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb9ba4cad4841019f7ba92b59b15f1c', 'request_id': 'req-91f617bf-c536-47fb-8216-507e46646c0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:03.568830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb9ba4cad4841019f7ba92b59b15f1c', 'request_id': 'req-91f617bf-c536-47fb-8216-507e46646c0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:03.576760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb9ba4cad4841019f7ba92b59b15f1c', 'request_id': 'req-91f617bf-c536-47fb-8216-507e46646c0e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:03.609058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] The token cache is being invalidate because project cdb9ba4cad4841019f7ba92b59b15f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:03.609365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:03.610078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91f617bf-c536-47fb-8216-507e46646c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:03.611894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2405/4829] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:03 2022] DELETE /identity/v3/projects/cdb9ba4cad4841019f7ba92b59b15f1c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:03.617298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:03.617591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:03.617872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:03.641684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:03.643373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:03.737159 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2425/4830] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:03.746493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:03.747054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:03.747347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:03.774709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:03.776611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:03.794136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2406/4831] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:03.795145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:03.807869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b416-84a8-4066-b6bd-186db186ed15 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:03.816421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:03.817427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:03.817885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:03.818372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:03.819333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:03.819879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:03.822946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:03.839947 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2426/4832] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:07:03.843221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:03.860443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ed615-38f2-4a94-9168-d63443c7d9d9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:03.873070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:03.876211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:03.876622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:03.878025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:03.878934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:03.880953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:03.897623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:03.939022 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2407/4833] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:03 2022] POST /identity/v3/projects => generated 395 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:03.943376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:03.955930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743951-4fed-47e0-9a7a-91530e6c00e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:03.973953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:04.062924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.064200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.064356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.064860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.065832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.068845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.100691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2427/4834] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:03 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:04.104971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.117308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f4d63-3799-4aec-adb7-3b6011d8f579 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.123173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.124095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.124439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.124788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.125909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.128902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.145483 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2408/4835] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:07:04.149593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.162194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fb14-63c2-4a1b-989c-a3dfa422c458 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.174366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.175038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.175326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.175673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.176585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.183302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efac0f-f835-4143-b1a3-afc6d81aa532 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.198522 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2428/4836] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:04.199949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.215237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f679b-3e43-4907-8588-c9d36ec41126 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.224191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.225642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.225925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.226204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] PATH_INFO: `/v3/projects/0d0859d5ace14f4d8e65cddcc54a9eea/users/a5084e793dce42d580e48f258b41ec50/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.248897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0859d5ace14f4d8e65cddcc54a9eea, user_id=a5084e793dce42d580e48f258b41ec50, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.252022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.268858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2409/4837] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:04 2022] PUT /identity/v3/projects/0d0859d5ace14f4d8e65cddcc54a9eea/users/a5084e793dce42d580e48f258b41ec50/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:04.281581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.281929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.282224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.315068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] MFA Rules not processed for user `a5084e793dce42d580e48f258b41ec50`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:04.317119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:04.419358 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2429/4838] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:04.424344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.529593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3faa-b101-4a83-8b40-906f5b657b1f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.543352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.546736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.547089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.547384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.548176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.552990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.610779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2410/4839] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:04 2022] POST /identity/v3/projects => generated 395 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:04.613086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.629185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d81c93-c507-4fdc-8199-06894e630f2f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.698833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.699874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.700191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.700569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.701407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.703701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.730781 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2430/4840] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:04 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:04.732132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.745336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5d952-18a2-4956-a911-cd50d1f4960d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.750926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.751678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.751953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.752350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.753271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.755445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.775608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2411/4841] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:04.776018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.787821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78379f74-3b52-4a45-a3d1-0a86357312de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.793410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.794352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.794635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.795092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] PATH_INFO: `/v3/projects/7d5bc2af76d2450fb97654b81103bc7a/users/4f04445b619b4d0eb86637f62f609172/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.821670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5bc2af76d2450fb97654b81103bc7a, user_id=4f04445b619b4d0eb86637f62f609172, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.822509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:04.825338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.843682 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2431/4842] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:04 2022] PUT /identity/v3/projects/7d5bc2af76d2450fb97654b81103bc7a/users/4f04445b619b4d0eb86637f62f609172/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:04.847746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.861587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d1d04-0332-49c8-8dad-94206632c0b1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.943392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.944289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.944580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.945010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:04.945852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:04.948512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:04.970922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2412/4843] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:04.975325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:04.989740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c48b5-43a7-432b-9c73-230f6c4d92f4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:04.995375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:04.996676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:04.996858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:04.997138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] PATH_INFO: `/v3/projects/7d5bc2af76d2450fb97654b81103bc7a/users/4f04445b619b4d0eb86637f62f609172/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:05.008577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:05.010652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:05.022724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5bc2af76d2450fb97654b81103bc7a, user_id=4f04445b619b4d0eb86637f62f609172, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:05.031040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a1bbd-4b84-4204-ad68-91fd2562a5f3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:05.055837 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2432/4844] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:04 2022] PUT /identity/v3/projects/7d5bc2af76d2450fb97654b81103bc7a/users/4f04445b619b4d0eb86637f62f609172/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:05.066576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:05.066786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:05.067349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:05.067874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:05.118255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] MFA Rules not processed for user `4f04445b619b4d0eb86637f62f609172`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:05.120409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:05.176146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbfdcd-035c-4987-aeb2-328969605ff1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:05.298242 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2433/4845] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:05.345770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:05.346573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:05.346858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:05.347403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:05.351477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:05.453733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:05.455570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:05.484137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2413/4846] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:05.709192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:05.730242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d995d9c-3cc4-4c6c-8ad6-bc92d85a5420 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:05.738982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:05.740492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:05.740629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:05.740932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:05.754971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:05.757679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:05.776655 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2434/4847] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:06.610917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:06.618194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:06.652442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd1ade-7e68-4c20-8f8d-0c95ceb17612 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:06.690050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:06.690734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:06.691347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:06.691846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:06.807559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:06.834397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:06.836172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f18eb0-3193-4eca-af77-d7f352834cd7 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:06.849266 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2414/4848] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:06.878085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:06.975684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ff21-8d8c-4cd1-8540-362c6e535a90 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:06.984128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:06.985083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:06.985399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:06.985702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] PATH_INFO: `/v3/users/a5084e793dce42d580e48f258b41ec50` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:06.987674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5084e793dce42d580e48f258b41ec50)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:06.989348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:07.070992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5084e793dce42d580e48f258b41ec50'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:07.079618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:07.084584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5084e793dce42d580e48f258b41ec50'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:07.086431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5084e793dce42d580e48f258b41ec50'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:07.087932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5084e793dce42d580e48f258b41ec50'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:07.108637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5084e793dce42d580e48f258b41ec50'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:07.136808 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2435/4849] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:06 2022] DELETE /identity/v3/users/a5084e793dce42d580e48f258b41ec50 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:07.142935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:07.143626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:07.144571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:07.175802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:07.177313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:07.269765 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2415/4850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:07.277643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:07.279260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:07.355531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db76df6-a9bf-4d86-9575-4366d8116fbd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:07.365159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:07.366469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:07.366684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:07.367052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:07.382259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:07.384401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:07.401486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2436/4851] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:08.062206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:08.064494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:08.090498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8da1e9-97ef-4aba-9849-1d2952160e11 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:08.100575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:08.101505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:08.101790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:08.102187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] PATH_INFO: `/v3/projects/0d0859d5ace14f4d8e65cddcc54a9eea` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:08.103634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0859d5ace14f4d8e65cddcc54a9eea)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:08.105591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:08.187497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0859d5ace14f4d8e65cddcc54a9eea', 'request_id': 'req-04486a88-90f5-428d-8a31-7fa78ac22f8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.204185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0859d5ace14f4d8e65cddcc54a9eea', 'request_id': 'req-04486a88-90f5-428d-8a31-7fa78ac22f8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.213573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0859d5ace14f4d8e65cddcc54a9eea', 'request_id': 'req-04486a88-90f5-428d-8a31-7fa78ac22f8f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.231609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] The token cache is being invalidate because project 0d0859d5ace14f4d8e65cddcc54a9eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:08.231984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.232791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.235009 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2416/4852] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:08 2022] DELETE /identity/v3/projects/0d0859d5ace14f4d8e65cddcc54a9eea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:08.239227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:08.255258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541ae82-6766-4038-8aba-12f1ea6041fa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:08.391238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:08.392220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:08.392682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:08.392965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] PATH_INFO: `/v3/users/4f04445b619b4d0eb86637f62f609172` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:08.394437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f04445b619b4d0eb86637f62f609172)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:08.397180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:08.455392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f04445b619b4d0eb86637f62f609172'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.466116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f04445b619b4d0eb86637f62f609172'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.467084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f04445b619b4d0eb86637f62f609172'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.467786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f04445b619b4d0eb86637f62f609172'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.490350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f91533eb-2752-4985-8713-d076e963748a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f04445b619b4d0eb86637f62f609172'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:08.493523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:08.513773 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2437/4853] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:08 2022] DELETE /identity/v3/users/4f04445b619b4d0eb86637f62f609172 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:08.933981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:08.935326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:08.968700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04486a88-90f5-428d-8a31-7fa78ac22f8f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:09.106836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:09.109948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.110503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.111010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] PATH_INFO: `/v3/projects/7d5bc2af76d2450fb97654b81103bc7a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.112963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5bc2af76d2450fb97654b81103bc7a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:09.115021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:09.129816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:09.216810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5bc2af76d2450fb97654b81103bc7a', 'request_id': 'req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:09.236206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5bc2af76d2450fb97654b81103bc7a', 'request_id': 'req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:09.262178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5bc2af76d2450fb97654b81103bc7a', 'request_id': 'req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:09.306167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] The token cache is being invalidate because project 7d5bc2af76d2450fb97654b81103bc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:09.309310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:09.310891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b0cf9001-8a44-4d1b-90ee-e3f44b0457a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:09.316108 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2417/4854] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:08 2022] DELETE /identity/v3/projects/7d5bc2af76d2450fb97654b81103bc7a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:09.321544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.322115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.322272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.369632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:09.370919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:09.515563 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2438/4855] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:09.523835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.525031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.525031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.591446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:09.598549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:09.625158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2418/4856] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:09.630804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:09.658318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066648f-35aa-4eaf-9168-4f570661eeaf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:09.666868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:09.667145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.667825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.668272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.670110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:09.670938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:09.673372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:09.696546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2439/4857] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:09.701013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:09.722413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ad23-2c2c-4d54-b602-417050025bf2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:09.734760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:09.735471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.735812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.736070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.740608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:09.744258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:09.818963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2419/4858] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:09.819820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:09.839443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3aca0-6071-4950-8873-60b7561f936e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:09.985972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:09.987081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:09.987667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:09.988374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:09.989355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:09.992528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:10.040084 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2440/4859] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:09 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:10.044904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:10.072093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd1d3f-847d-4956-8023-373ba2c77c8f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:10.084753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:10.085570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:10.085852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:10.087523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:10.093133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:10.097017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:10.134411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2420/4860] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:10.138501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:10.152387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2f0aa-6d85-43ae-9ddd-ef3472cf0555 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:10.165882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:10.166800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:10.167108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:10.167440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:10.168469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:10.171395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e1e84-a7d4-48a0-b18d-925c6c3cd0c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:10.196899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2441/4861] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:10.197528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:10.230748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a14e6-3fb3-4722-843d-85bc65480b2f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:10.247147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:10.250074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:10.250213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:10.250488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] PATH_INFO: `/v3/projects/0de4591a80b94ed9adfc9ea9649585c9/users/b5d0dd90346a416b9d7f94e499a47f2c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:10.298619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de4591a80b94ed9adfc9ea9649585c9, user_id=b5d0dd90346a416b9d7f94e499a47f2c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:10.310192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:10.348689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c49b4-f30e-4a76-a723-fd506a75245e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:10.349258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c49b4-f30e-4a76-a723-fd506a75245e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:10.349940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c49b4-f30e-4a76-a723-fd506a75245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:10.351415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2421/4862] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:10 2022] PUT /identity/v3/projects/0de4591a80b94ed9adfc9ea9649585c9/users/b5d0dd90346a416b9d7f94e499a47f2c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:10.415047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1c5c49b4-f30e-4a76-a723-fd506a75245e None None] MFA Rules not processed for user `b5d0dd90346a416b9d7f94e499a47f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:10.417549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c5c49b4-f30e-4a76-a723-fd506a75245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:10.544322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:10.629762 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2442/4863] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:10.646594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:10.648696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:10.840483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78895a-71a0-433d-8a9d-e49635d8416e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:10.845628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:10.846464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:10.846823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:10.847176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:10.859930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:10.861660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:10.879728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2422/4864] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:11.018819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:11.019591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:11.020098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:11.046938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:11.047577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:11.153826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2443/4865] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:11.225576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:11.227344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:11.272356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:11.402353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdd67-bf0a-422b-8c4c-93e9b7a4c2bc service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:11.446973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:11.450214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:11.451570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:11.452168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:11.474414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:11.478630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1ce3-2df8-4f1f-ab24-f1fab9c62275 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:11.553747 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2423/4866] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:16.152467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:16.155225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:16.343294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c27b-bb8c-4959-a82b-b2e87bdcafca None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:16.351923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:16.352925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:16.353328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:16.353941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] PATH_INFO: `/v3/users/b9f8b3c9c3e246a1b5732248f352f6f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:16.355721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f8b3c9c3e246a1b5732248f352f6f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:16.358542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:16.461782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f8b3c9c3e246a1b5732248f352f6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:16.471350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f8b3c9c3e246a1b5732248f352f6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:16.472470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f8b3c9c3e246a1b5732248f352f6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:16.473501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f8b3c9c3e246a1b5732248f352f6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:16.491230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f8b3c9c3e246a1b5732248f352f6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:16.519158 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2444/4867] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:16 2022] DELETE /identity/v3/users/b9f8b3c9c3e246a1b5732248f352f6f7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:16.524518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:16.525455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:16.525922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:16.564285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:16.566774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:16.700185 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2424/4868] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:16.729758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:16.731935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:16.751318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:16.831707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c08e4-02c2-41d7-828e-d1d2b860faef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:16.840572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:16.841664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:16.841664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:16.842256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:16.858097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:16.859716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:16.873577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2445/4869] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:17.882922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:17.889945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:17.928329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b81d80-e0d9-492c-bbdc-fc3af1c9996d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:17.943348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:17.976739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:17.977328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:17.980107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] PATH_INFO: `/v3/projects/b6190607daae4497896d8e5e2805c027` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:17.982517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6190607daae4497896d8e5e2805c027)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:17.987603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:18.162091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6190607daae4497896d8e5e2805c027', 'request_id': 'req-72af746b-29ce-4909-bea2-033c5cc3190a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.172158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6190607daae4497896d8e5e2805c027', 'request_id': 'req-72af746b-29ce-4909-bea2-033c5cc3190a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.187462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6190607daae4497896d8e5e2805c027', 'request_id': 'req-72af746b-29ce-4909-bea2-033c5cc3190a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.215452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] The token cache is being invalidate because project b6190607daae4497896d8e5e2805c027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:18.215999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.217241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72af746b-29ce-4909-bea2-033c5cc3190a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.222018 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2425/4870] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:17 2022] DELETE /identity/v3/projects/b6190607daae4497896d8e5e2805c027 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:18.223234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:18.282567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68633cbe-b258-4a08-9589-1dc450630abf service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:18.424292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:18.425139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:18.425431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:18.425710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] PATH_INFO: `/v3/users/dc08eb97bbe24940bc8964c74eb280d9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:18.427811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc08eb97bbe24940bc8964c74eb280d9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:18.429954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:18.593374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc08eb97bbe24940bc8964c74eb280d9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.610708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc08eb97bbe24940bc8964c74eb280d9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.617703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc08eb97bbe24940bc8964c74eb280d9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.619820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc08eb97bbe24940bc8964c74eb280d9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.671593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc08eb97bbe24940bc8964c74eb280d9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:18.701846 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2446/4871] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:18 2022] DELETE /identity/v3/users/dc08eb97bbe24940bc8964c74eb280d9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:19.976087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:19.977064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:19.977564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:20.025989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:20.027675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:20.085783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:20.221147 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2426/4872] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:20.241467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:20.245383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:20.307470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:20.382306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3750535-8ed9-4873-bbc4-e6ddf02124b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:20.389422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:20.390546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:20.391000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:20.391375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:20.402148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:20.404199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:20.415431 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2447/4873] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:20.530198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:20.535911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:20.760799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:20.762596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:20.805908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d247-c98e-4ce0-bbde-75383492ac10 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:20.820396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:20.821550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:20.821983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:20.822416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] PATH_INFO: `/v3/projects/decbbb81db7e4ca08723c90cca498fdf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:20.824223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] RBAC: Authorizing `identity:delete_project(project_id=decbbb81db7e4ca08723c90cca498fdf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:20.826762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:20.916731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34749c0-90d8-4fca-8da1-4e769deb1836 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:20.930451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:20.931830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:20.932300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:20.932888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] PATH_INFO: `/v3/users/b5d0dd90346a416b9d7f94e499a47f2c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:20.936179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d0dd90346a416b9d7f94e499a47f2c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:20.939406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:21.013076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decbbb81db7e4ca08723c90cca498fdf', 'request_id': 'req-9768bab5-944c-44f4-8198-9dc0e8a0392b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.039859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decbbb81db7e4ca08723c90cca498fdf', 'request_id': 'req-9768bab5-944c-44f4-8198-9dc0e8a0392b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.066142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decbbb81db7e4ca08723c90cca498fdf', 'request_id': 'req-9768bab5-944c-44f4-8198-9dc0e8a0392b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.114117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] The token cache is being invalidate because project decbbb81db7e4ca08723c90cca498fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:21.114842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.115859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d0dd90346a416b9d7f94e499a47f2c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.116412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9768bab5-944c-44f4-8198-9dc0e8a0392b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.118888 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2427/4874] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:20 2022] DELETE /identity/v3/projects/decbbb81db7e4ca08723c90cca498fdf => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:21.126186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028bd7-cd45-4879-b84e-e5a76439bec5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.126833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028bd7-cd45-4879-b84e-e5a76439bec5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.127331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028bd7-cd45-4879-b84e-e5a76439bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.137678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d0dd90346a416b9d7f94e499a47f2c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.139886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d0dd90346a416b9d7f94e499a47f2c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.141686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d0dd90346a416b9d7f94e499a47f2c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.173113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-39028bd7-cd45-4879-b84e-e5a76439bec5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:21.183299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42ea2ba4-097d-4f85-8f16-9852c141fba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d0dd90346a416b9d7f94e499a47f2c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:21.184537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-39028bd7-cd45-4879-b84e-e5a76439bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:21.228700 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2448/4875] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:20 2022] DELETE /identity/v3/users/b5d0dd90346a416b9d7f94e499a47f2c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:21.239758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.240058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.240489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.297244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:21.302536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:21.345991 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2428/4876] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:21.356936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.357666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.358143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.378791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:21.425241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:21.433017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:21.460349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:21.539546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2449/4877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:21.620537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:21.621983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:21.622435 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2429/4878] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:21.627276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:21.649083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28e3f-c007-4ff0-bbda-25566097e462 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:21.668003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:21.669090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.669602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.670078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.670986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:21.671366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:21.673076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:21.701574 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2430/4879] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:21.710075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:21.734251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637180f-9a31-43bc-b433-9572d33346ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:21.745965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:21.746889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.747268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.747756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.748770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:21.751176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:21.810001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07abef-e1e7-469d-883b-516e8a3189a6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:21.815565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2431/4880] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:21 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:21.819807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:21.820991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:21.822055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.822672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.823140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.841478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:21.843746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:21.856116 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2450/4881] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:21.926415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7d791-62d1-47a6-b0b4-f4fcfdf4529f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:21.931458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:21.932169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:21.932453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:21.932732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:21.933435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:21.935370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:21.964801 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2432/4882] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:21 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:21.969747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:21.984959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde35c6-fc79-46e0-be4c-afd632b41356 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:22.005864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:22.007003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:22.007530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:22.008074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:22.009150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:22.011298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:22.026783 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2451/4883] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:22.031920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:22.049489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c2ea-eb6a-4fbc-b08d-f0ea3bda58ca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:22.057764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:22.058815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:22.059282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:22.059769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:22.062385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:22.065974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bc60d-8acf-4a35-b742-299d8ed2df74 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:22.082306 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2433/4884] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:07:22.088011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:22.111077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772cbe-d0fb-4890-8cf4-a054ed1e3188 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:22.130211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:22.131172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:22.131466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:22.131765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] PATH_INFO: `/v3/projects/dd9d3208d0ab4944a80883344ecc2401/users/366c6fde120846d89fa9789cd29ca862/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:22.182990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9d3208d0ab4944a80883344ecc2401, user_id=366c6fde120846d89fa9789cd29ca862, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:22.185173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:22.244977 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2452/4885] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:22 2022] PUT /identity/v3/projects/dd9d3208d0ab4944a80883344ecc2401/users/366c6fde120846d89fa9789cd29ca862/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:22.247121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:22.247451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:22.247776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:22.370439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] MFA Rules not processed for user `366c6fde120846d89fa9789cd29ca862`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:22.372664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:22.452720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:22.586151 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2434/4886] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:22.587483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:22.813606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf873a8-9ada-444a-9b0c-00557fbbcbc9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:22.829733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:22.830320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:22.830812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:22.831446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:22.832673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:22.835007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:22.917012 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2453/4887] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:22 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:22.918603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:22.948880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f722d8-3ac4-42f2-a44a-3a2b9fcecdb3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.084173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.086023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:23.098606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.099288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.099812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.100095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.100791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.102725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.158585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2435/4888] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:22 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:23.163118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.169863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:23.193119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e468f-d2d1-4496-8936-ab4c79d7433e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.203339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998fa7-0800-4007-8612-7f97ee1226a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.208952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.209681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.210351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.210810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.210937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.211226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.211593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.211744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] PATH_INFO: `/v3/projects/0de4591a80b94ed9adfc9ea9649585c9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.212578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.213680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de4591a80b94ed9adfc9ea9649585c9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.216038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.216971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.246453 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2436/4889] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:23.247857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.269429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a654-9f91-44e8-ac03-a3d77ebb8fee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.278297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.279802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.280348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.280960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.281987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.285500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.305156 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2437/4890] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:23.306141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.315993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de4591a80b94ed9adfc9ea9649585c9', 'request_id': 'req-1f230313-f744-4f92-9e40-a7456eff95bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:23.325855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de4591a80b94ed9adfc9ea9649585c9', 'request_id': 'req-1f230313-f744-4f92-9e40-a7456eff95bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:23.332362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb016c4-733f-41be-9918-ee83614fab87 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.343525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de4591a80b94ed9adfc9ea9649585c9', 'request_id': 'req-1f230313-f744-4f92-9e40-a7456eff95bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:23.371797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] The token cache is being invalidate because project 0de4591a80b94ed9adfc9ea9649585c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:23.372036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:23.373897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1f230313-f744-4f92-9e40-a7456eff95bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:23.377096 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2454/4891] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:23 2022] DELETE /identity/v3/projects/0de4591a80b94ed9adfc9ea9649585c9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:23.383328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b1e6-497c-4cdf-b702-eacacc779567 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.383656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b1e6-497c-4cdf-b702-eacacc779567 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.383940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b1e6-497c-4cdf-b702-eacacc779567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.420905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2854b1e6-497c-4cdf-b702-eacacc779567 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:23.427929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2854b1e6-497c-4cdf-b702-eacacc779567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:23.488452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.489367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.489683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.489927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] PATH_INFO: `/v3/projects/c35ed957abc244959d177658e670af04/users/bf39e8787e764d5689e736958a90206f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.529817 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2455/4892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:23.532465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.532713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35ed957abc244959d177658e670af04, user_id=bf39e8787e764d5689e736958a90206f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.533245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.533840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.536141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8cefb-7a3b-4b74-aa5b-4404553824ed admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.563865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:23.564939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2438/4893] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:23 2022] PUT /identity/v3/projects/c35ed957abc244959d177658e670af04/users/bf39e8787e764d5689e736958a90206f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:23.565991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:23.578844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.579146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.579428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.644752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] MFA Rules not processed for user `bf39e8787e764d5689e736958a90206f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:23.646925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:23.680259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:23.702767 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2456/4894] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:23.707192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.728757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49217-39d6-4834-9125-529df2cf8cdc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.744909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.746590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.747338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.748073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.749538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:23.750186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.753435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.756194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:23.781568 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2457/4895] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:23.782854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.796615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2439/4896] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:23.801351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.804869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:23.805023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5856-b5ed-41c3-9609-f07cf01eab5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.811728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.813154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.813531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.814043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.815137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.820144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.825365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ceb7-46bc-4553-889b-b4321157ca9b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:23.831578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:23.832269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:23.832606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:23.833443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:23.834216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:23.837398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:23.873999 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2458/4897] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:23.874958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.882898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2440/4898] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:23.884062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:23.957773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c7ecd-addb-475d-9acf-84a8ea82710d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.003431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dd242-212c-427c-aa98-86047ec748d0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.012572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.012974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.013326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.013669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.015751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.020420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.049349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.050439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.050969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.051637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.051797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2441/4899] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:24.052939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.055125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.055990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.072989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af83fa-4c33-4adc-8e7d-bb7ce3338726 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.084892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.085918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.086413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.086872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.088368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.089326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2459/4900] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:23 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:24.094984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.099018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.111189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804723b9-fdc6-4b3d-aa32-15055c1d4a23 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.116465 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2442/4901] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:07:24.117686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.118691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.119157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.119675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.120864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.121051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.123356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.136911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb246-29bc-4788-a02a-e9a443463624 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.143830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2460/4902] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:24.144666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.147994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.149063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.149454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.155544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] PATH_INFO: `/v3/projects/07003980530b45e9aa7dcec68ac46d88/users/b868c7f9aa6548619b1f41e8619a4ff3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.175576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8569bd-9139-4cb2-b706-b6edff8b0b42 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.184459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07003980530b45e9aa7dcec68ac46d88, user_id=b868c7f9aa6548619b1f41e8619a4ff3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.187605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.188592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.189183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.189637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.190080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.192284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.194999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.214329 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2443/4903] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:24 2022] PUT /identity/v3/projects/07003980530b45e9aa7dcec68ac46d88/users/b868c7f9aa6548619b1f41e8619a4ff3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:24.218564 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2461/4904] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:24.220539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.226969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.246116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435c0d-0b49-4e6a-ba30-8d6bf42d7d27 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.301609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:24.316137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:24.322184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13aec8-09ba-44fd-b4ab-0ada8bf12903 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.334778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.341927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.342693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.343112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.344661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.346921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.347171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.350153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.350724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.351181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] PATH_INFO: `/v3/projects/2de85e590d5e45c9bca587e74b6689d6/users/465cff93c4244a4794784ad2885c02e7/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.368743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2444/4905] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:24.369914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.385654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775917e-e9fc-48b6-a0d7-403a98d6a57b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.389566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de85e590d5e45c9bca587e74b6689d6, user_id=465cff93c4244a4794784ad2885c02e7, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.394078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.395359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.396281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.396447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b478b-a655-42e5-a3be-8bfc3a6a99bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.397188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] PATH_INFO: `/v3/projects/07003980530b45e9aa7dcec68ac46d88/users/b868c7f9aa6548619b1f41e8619a4ff3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.399823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07003980530b45e9aa7dcec68ac46d88, user_id=b868c7f9aa6548619b1f41e8619a4ff3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.406972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99190679-e996-4b42-9e5b-128978600b11 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.423083 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2462/4906] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:24 2022] PUT /identity/v3/projects/2de85e590d5e45c9bca587e74b6689d6/users/465cff93c4244a4794784ad2885c02e7/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:24.436814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35e12-a67e-45d4-9936-e6a76117eb04 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.437153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2445/4907] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:24 2022] PUT /identity/v3/projects/07003980530b45e9aa7dcec68ac46d88/users/b868c7f9aa6548619b1f41e8619a4ff3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:24.437654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35e12-a67e-45d4-9936-e6a76117eb04 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.438164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd35e12-a67e-45d4-9936-e6a76117eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.438803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.439171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.439461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.478652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] MFA Rules not processed for user `b868c7f9aa6548619b1f41e8619a4ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:24.480075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.481970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cfd35e12-a67e-45d4-9936-e6a76117eb04 None None] MFA Rules not processed for user `465cff93c4244a4794784ad2885c02e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:24.483314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cfd35e12-a67e-45d4-9936-e6a76117eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.580699 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2446/4908] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:24.588134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.590750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.605081 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2463/4909] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:24.611133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.612086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.612521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.655476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] MFA Rules not processed for user `465cff93c4244a4794784ad2885c02e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:24.656847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.669472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2464/4910] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:24.676191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31156a-44ce-47ad-97eb-38dea77ce226 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.678383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.680044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.680793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.681571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.682698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.683088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.699564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.702484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.723763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2447/4911] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:24.794237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.796893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.819088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9126-779a-4ed1-bd3e-b0b9136ea259 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.827233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.829298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.829596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.829865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.834574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.887853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c831684-33cd-4082-ac56-9ac055abdbfa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:24.903159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:24.904776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:24.905508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:24.906216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:24.913396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.915175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.917079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:24.918868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:24.922027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:24.932308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2465/4912] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:24.933372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:24.935784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:24.938555 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2448/4913] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:24.990184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:25.045700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f37fe-e44d-4409-a3a7-c8876c117076 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:25.066119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:25.067084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:25.068871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:25.069169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] PATH_INFO: `/v3/users/e2235426d43a4e98973a97ea8e45c1f4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:25.070728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2235426d43a4e98973a97ea8e45c1f4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:25.073954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:25.184842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2235426d43a4e98973a97ea8e45c1f4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:25.203087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2235426d43a4e98973a97ea8e45c1f4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:25.204845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2235426d43a4e98973a97ea8e45c1f4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:25.206291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2235426d43a4e98973a97ea8e45c1f4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:25.254937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2235426d43a4e98973a97ea8e45c1f4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:25.298310 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2466/4914] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:24 2022] DELETE /identity/v3/users/e2235426d43a4e98973a97ea8e45c1f4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:25.989769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:25.991367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:26.024999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9880d-9e42-46b4-839d-77d1cf539a06 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:26.117906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:26.119406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:26.119608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:26.119893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] PATH_INFO: `/v3/users/fb1e49a5a78544f0b59e135153a8771c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:26.122132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1e49a5a78544f0b59e135153a8771c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:26.124449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:26.224353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1e49a5a78544f0b59e135153a8771c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.225040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1e49a5a78544f0b59e135153a8771c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.249110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1e49a5a78544f0b59e135153a8771c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.250377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1e49a5a78544f0b59e135153a8771c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.284682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a5f03c25-eecd-4738-a7bd-eb9dda924f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1e49a5a78544f0b59e135153a8771c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.317316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2449/4915] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:25 2022] DELETE /identity/v3/users/fb1e49a5a78544f0b59e135153a8771c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:26.406606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:26.408302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:26.437421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f0d2d-fda8-494b-9cbf-eb3e46bc10e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:26.539180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:26.540620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:26.541254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:26.541811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] PATH_INFO: `/v3/projects/887ac9932d584f4b99b7b168721d9552` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:26.558095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] RBAC: Authorizing `identity:delete_project(project_id=887ac9932d584f4b99b7b168721d9552)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:26.579283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:26.708210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887ac9932d584f4b99b7b168721d9552', 'request_id': 'req-59674a10-3461-4de8-a420-1f655853111b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.715293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887ac9932d584f4b99b7b168721d9552', 'request_id': 'req-59674a10-3461-4de8-a420-1f655853111b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.720144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:26.725073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887ac9932d584f4b99b7b168721d9552', 'request_id': 'req-59674a10-3461-4de8-a420-1f655853111b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.757371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] The token cache is being invalidate because project 887ac9932d584f4b99b7b168721d9552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:26.757788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.758548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:26.760744 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2467/4916] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:26 2022] DELETE /identity/v3/projects/887ac9932d584f4b99b7b168721d9552 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:26.766531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938f48-1915-4c46-8c08-e5a2c617fd24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:26.766837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938f48-1915-4c46-8c08-e5a2c617fd24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:26.767123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938f48-1915-4c46-8c08-e5a2c617fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:26.822425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-de938f48-1915-4c46-8c08-e5a2c617fd24 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:26.824716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-de938f48-1915-4c46-8c08-e5a2c617fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:26.966250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:26.968111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:27.032946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2450/4917] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:27.034621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16934-0520-4726-bdb7-159f878b88de None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.034927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16934-0520-4726-bdb7-159f878b88de None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.035246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16934-0520-4726-bdb7-159f878b88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.082364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-62c16934-0520-4726-bdb7-159f878b88de None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:27.085161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-62c16934-0520-4726-bdb7-159f878b88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:27.125639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2451/4918] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:27.127326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c16934-0520-4726-bdb7-159f878b88de None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.149193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c16934-0520-4726-bdb7-159f878b88de None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.162645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.164306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.164432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.164723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.166560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:27.166873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.172949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.178734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59674a10-3461-4de8-a420-1f655853111b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.187683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:27.196721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.197670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.198068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.198554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] PATH_INFO: `/v3/projects/4695654467fe498e8535cd245a1de975` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.201521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4695654467fe498e8535cd245a1de975)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.204425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.210249 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2452/4919] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:27.211664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.267499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50496f7-652a-4a3a-9486-b1fe90975608 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.281139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.283781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.284077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.284367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.285084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.289699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.322680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4695654467fe498e8535cd245a1de975', 'request_id': 'req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:27.333128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4695654467fe498e8535cd245a1de975', 'request_id': 'req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:27.340970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4695654467fe498e8535cd245a1de975', 'request_id': 'req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:27.360806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2453/4920] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:27.366774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.384131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] The token cache is being invalidate because project 4695654467fe498e8535cd245a1de975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:27.384430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:27.387798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b87b00d-a9ae-4357-bf9e-d9ccd91b810e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:27.392742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2468/4921] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:26 2022] DELETE /identity/v3/projects/4695654467fe498e8535cd245a1de975 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:27.400673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589adaf-1933-401c-941c-1a6868cd5467 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.400829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589adaf-1933-401c-941c-1a6868cd5467 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.401412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589adaf-1933-401c-941c-1a6868cd5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.468779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4589adaf-1933-401c-941c-1a6868cd5467 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:27.473953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4589adaf-1933-401c-941c-1a6868cd5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:27.545913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c4dd3-56e2-4f3b-a4f5-0cbd6cc8dd9e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.551706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.553223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.553828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.554331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.555245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.557480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.609838 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2454/4922] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:27.612591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.616977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:27.641847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5d3e-ed56-4ebc-a699-2201ca2b6284 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.651708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.652700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.656080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.656508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.657544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.659961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.699661 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2455/4923] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:27.702904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.717754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2469/4924] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:27.728175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.728942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.729430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.731664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809773-e319-481f-85bb-a0e3e35a4075 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.754190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.756461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.756970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.758377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.761312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.766157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.800888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:27.802141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:27.824719 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2470/4925] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:27.829262 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2456/4926] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:27.831094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.833133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.854030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89522fb-6d0d-4975-b7b0-8d07681203bf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.860161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.861095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.861582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.862045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.863219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:27.863715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.865538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.866609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce4bf9-7298-4b4d-81be-911b2e410b24 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.875633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.875991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:27.878131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.878554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.878928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] PATH_INFO: `/v3/projects/301e9cee0f0e46c88a533a74a81cc2e3/users/3d8e16f578424cd4835085ce387ec659/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.891061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2471/4927] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:27.898070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:27.921522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301e9cee0f0e46c88a533a74a81cc2e3, user_id=3d8e16f578424cd4835085ce387ec659, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.928421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bdf61-b713-4bd2-a7ed-4ac7c503ed99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.930019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b4a25-2100-4956-8c48-cc45d2ca76fe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:27.946816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:27.950104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.950463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.951551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:27.953001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:27.960465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:27.971999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2457/4928] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:27 2022] PUT /identity/v3/projects/301e9cee0f0e46c88a533a74a81cc2e3/users/3d8e16f578424cd4835085ce387ec659/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:27.983957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed4f-a6f5-498a-bfd5-cb3d214f103f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:27.984364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed4f-a6f5-498a-bfd5-cb3d214f103f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:27.984717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ed4f-a6f5-498a-bfd5-cb3d214f103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.045877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0ea6ed4f-a6f5-498a-bfd5-cb3d214f103f None None] MFA Rules not processed for user `3d8e16f578424cd4835085ce387ec659`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:28.049416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ea6ed4f-a6f5-498a-bfd5-cb3d214f103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:28.072394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2472/4929] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/projects => generated 397 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:28.076551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:28.283874 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2458/4930] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:28.297606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.298714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.299017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.308066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a37925-1a05-4395-b688-35653606053f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:28.340731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] MFA Rules not processed for user `3d8e16f578424cd4835085ce387ec659`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:28.342217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:28.347394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:28.348111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.348398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.348676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.349393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:28.356971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:28.417976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:28.502272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2473/4931] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:28 2022] POST /identity/v3/users => generated 299 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:28.509790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:28.540248 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2459/4932] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:28.541019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c488d53-84f5-42b7-a212-c489ae8da6b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:28.562107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:28.566949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:28.576413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:28.577246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.577534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.577848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.580093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:28.585924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:28.602063 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2474/4933] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:28.606030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:28.633990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcaccd-cb60-4a71-b963-b43e9d7647e4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:28.649780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:28.652465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.653368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.654334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.656007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:28.661376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:28.691348 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2475/4934] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:28.695103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:28.739662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a246-5565-49e2-a6d4-ce57211a53ab admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:28.758633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:28.762417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.762906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.764388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] PATH_INFO: `/v3/projects/0a05b0ff80704e7aa65514929f859836/users/03c2041367a149d4873248ba09b2c591/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.767242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fdbab-7646-495f-a1cd-5dbbf9aa61a1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:28.787543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:28.788379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.788666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.788945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.804661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a05b0ff80704e7aa65514929f859836, user_id=03c2041367a149d4873248ba09b2c591, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:28.808001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1c1b-942e-4659-a086-f23083ce853c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:28.811255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:28.816816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbf789-e440-4b23-b8ed-529ced55f211 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:28.831096 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2476/4935] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:28 2022] PUT /identity/v3/projects/0a05b0ff80704e7aa65514929f859836/users/03c2041367a149d4873248ba09b2c591/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:28.841738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:28.842073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:28.842292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:28.854740 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2460/4936] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:28.925574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:28.933030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.111127 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2477/4937] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:29.125800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792705-b453-493e-96f1-476d17a64da8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:29.125800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792705-b453-493e-96f1-476d17a64da8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:29.125800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26792705-b453-493e-96f1-476d17a64da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:29.178916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-26792705-b453-493e-96f1-476d17a64da8 None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:29.180212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-26792705-b453-493e-96f1-476d17a64da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.196793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:29.198272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.213084 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2461/4938] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:29.229841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:29.323051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26792705-b453-493e-96f1-476d17a64da8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:29.460525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bdb44-08b0-479c-9be6-e8f636dd38a8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:29.474322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:29.474917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:29.475204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:29.478279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] PATH_INFO: `/v3/users/366c6fde120846d89fa9789cd29ca862` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:29.484103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366c6fde120846d89fa9789cd29ca862)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:29.487447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:29.592000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26792705-b453-493e-96f1-476d17a64da8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:29.597386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366c6fde120846d89fa9789cd29ca862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:29.609166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366c6fde120846d89fa9789cd29ca862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:29.610120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366c6fde120846d89fa9789cd29ca862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:29.610808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366c6fde120846d89fa9789cd29ca862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:29.612310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:29.613962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:29.616646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:29.616947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:29.621757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.642751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:29.644841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95f824-3e9e-477a-b7ff-51e224a240b0 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:29.650914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40529508-5437-41b6-a938-418eebf827b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366c6fde120846d89fa9789cd29ca862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:29.661287 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2462/4939] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:29.690233 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2478/4940] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:29 2022] DELETE /identity/v3/users/366c6fde120846d89fa9789cd29ca862 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:29.704081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:29.704081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:29.704081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:29.750481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:29.753102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.766970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550461-88f4-4a73-8261-78be1084e7a5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:29.767590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550461-88f4-4a73-8261-78be1084e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:29.767908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76550461-88f4-4a73-8261-78be1084e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:29.779157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:29.820279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76550461-88f4-4a73-8261-78be1084e7a5 None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:29.821537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76550461-88f4-4a73-8261-78be1084e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.840428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2463/4941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:29.855827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:29.858753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:29.993549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2479/4942] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:30.017689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcefa4-0e04-48c3-87c3-cd0847ddf393 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:30.028475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79835-0c94-486a-9d45-68936dcc11ae None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.028906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79835-0c94-486a-9d45-68936dcc11ae None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.029616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79835-0c94-486a-9d45-68936dcc11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.039600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:30.041073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.041557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.042720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.078951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:30.085259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3fe79835-0c94-486a-9d45-68936dcc11ae None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:30.085589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecf78-c73d-4070-a8c9-0b3b30115e0d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:30.094220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3fe79835-0c94-486a-9d45-68936dcc11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.122187 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2480/4943] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:30.126949 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2464/4944] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:30.169486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.170280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.170648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.202847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:30.205397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.220418 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2481/4945] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:30.261570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf5f69-e23d-4d78-8110-1dc29ee07286 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.261875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf5f69-e23d-4d78-8110-1dc29ee07286 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.262239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf5f69-e23d-4d78-8110-1dc29ee07286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.298832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-15bf5f69-e23d-4d78-8110-1dc29ee07286 None None] MFA Rules not processed for user `03c2041367a149d4873248ba09b2c591`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:30.303802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-15bf5f69-e23d-4d78-8110-1dc29ee07286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.328358 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2465/4946] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:30.365310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:30.366948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.392995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68da4b-380c-42f5-8f9e-965fda293bd9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:30.418696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:30.419916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.420279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.420752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] PATH_INFO: `/v3/users/03c2041367a149d4873248ba09b2c591` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.423700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c2041367a149d4873248ba09b2c591)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:30.425751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:30.444824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:30.510024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c2041367a149d4873248ba09b2c591'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.529746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c2041367a149d4873248ba09b2c591'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.530989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c2041367a149d4873248ba09b2c591'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.532475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c2041367a149d4873248ba09b2c591'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.554091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c2041367a149d4873248ba09b2c591'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.574498 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2482/4947] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:30 2022] DELETE /identity/v3/users/03c2041367a149d4873248ba09b2c591 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:30.579619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.580130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.580546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.619327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:30.621010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.712445 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2466/4948] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:30.742398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:30.744442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.775156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:30.776690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:30.789579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55bf97-d6f9-4db1-be14-f4e6d838aa14 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:30.806097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:30.807451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.807817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.808188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] PATH_INFO: `/v3/projects/dd9d3208d0ab4944a80883344ecc2401` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.809713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9d3208d0ab4944a80883344ecc2401)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:30.812142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:30.843206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbafd2-24a7-4117-b4b0-6799b1d943f6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:30.849056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:30.850034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:30.850478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:30.850902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:30.875303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:30.877678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:30.882196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9d3208d0ab4944a80883344ecc2401', 'request_id': 'req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.896346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2483/4949] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:30.903628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:30.914650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9d3208d0ab4944a80883344ecc2401', 'request_id': 'req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.926478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9d3208d0ab4944a80883344ecc2401', 'request_id': 'req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.951375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] The token cache is being invalidate because project dd9d3208d0ab4944a80883344ecc2401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:30.951714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.952399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:30.954498 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2467/4950] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:30 2022] DELETE /identity/v3/projects/dd9d3208d0ab4944a80883344ecc2401 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:30.959393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:30.985410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8707dc-718d-4868-877d-e1923b6a73c7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:31.067830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:31.069363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:31.074803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:31.074934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] PATH_INFO: `/v3/users/bf39e8787e764d5689e736958a90206f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:31.077184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf39e8787e764d5689e736958a90206f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:31.079478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:31.159858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:31.185881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf39e8787e764d5689e736958a90206f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:31.198272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf39e8787e764d5689e736958a90206f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:31.199122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf39e8787e764d5689e736958a90206f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:31.200150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf39e8787e764d5689e736958a90206f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:31.235196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf39e8787e764d5689e736958a90206f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:31.272941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2484/4951] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:30 2022] DELETE /identity/v3/users/bf39e8787e764d5689e736958a90206f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:31.792269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:31.794620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:31.827174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:31.829391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:31.931474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0eab2-5111-4d92-be68-3c8a6bec2d81 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:31.957633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead38b7-d06e-41f3-a182-6f8e5a15acee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:31.965091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:31.972928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:31.973748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:31.974297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:31.977502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:32.026373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:32.027166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:32.028605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:32.029063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:32.032757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:32.143678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:32.146723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:32.171469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2485/4952] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:32.190496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:32.192124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:32.216761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2468/4953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:32.536209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:32.539250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:32.693400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:32.707202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f7c2-a5e1-446d-b8aa-d5a1d09f08e7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:32.718219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:32.719168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:32.719450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:32.719750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] PATH_INFO: `/v3/projects/0a05b0ff80704e7aa65514929f859836` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:32.721767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a05b0ff80704e7aa65514929f859836)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:32.725612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:32.850012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:32.853483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:32.879099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a05b0ff80704e7aa65514929f859836', 'request_id': 'req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:32.883967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60d79-ee68-4ebc-aac6-f6783055954d service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:32.897448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a05b0ff80704e7aa65514929f859836', 'request_id': 'req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:32.914481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a05b0ff80704e7aa65514929f859836', 'request_id': 'req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:32.949790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] The token cache is being invalidate because project 0a05b0ff80704e7aa65514929f859836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:32.950565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:32.951561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b437e5e6-9c42-47e4-9da2-8d07abbd2e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:32.956201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2486/4954] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:32 2022] DELETE /identity/v3/projects/0a05b0ff80704e7aa65514929f859836 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:32.971022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb7ea-c48d-4bc3-8c15-5e19e17d6d88 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:32.972566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb7ea-c48d-4bc3-8c15-5e19e17d6d88 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:32.973032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eb7ea-c48d-4bc3-8c15-5e19e17d6d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.003932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:33.038259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-700eb7ea-c48d-4bc3-8c15-5e19e17d6d88 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:33.041996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-700eb7ea-c48d-4bc3-8c15-5e19e17d6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:33.078544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.079875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.080760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.081195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] PATH_INFO: `/v3/projects/c35ed957abc244959d177658e670af04` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.083757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35ed957abc244959d177658e670af04)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:33.088446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:33.213459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35ed957abc244959d177658e670af04', 'request_id': 'req-e8114e89-e4ec-4e4b-959b-82a40a4ba431'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.241014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35ed957abc244959d177658e670af04', 'request_id': 'req-e8114e89-e4ec-4e4b-959b-82a40a4ba431'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.243674 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2487/4955] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:33.252344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.252993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.252993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.264804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35ed957abc244959d177658e670af04', 'request_id': 'req-e8114e89-e4ec-4e4b-959b-82a40a4ba431'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.293928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] The token cache is being invalidate because project c35ed957abc244959d177658e670af04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:33.294293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.297806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.300272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:33.302610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:33.306640 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2469/4956] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:32 2022] DELETE /identity/v3/projects/c35ed957abc244959d177658e670af04 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:33.312617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:33.318281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:33.479365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114e89-e4ec-4e4b-959b-82a40a4ba431 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:33.480795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2488/4957] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:33.485353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:33.493537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.494966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.495473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.496024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] PATH_INFO: `/v3/users/b868c7f9aa6548619b1f41e8619a4ff3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.498181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b868c7f9aa6548619b1f41e8619a4ff3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:33.499081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2fc2-39d0-47bd-bf62-f904e332bdc4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:33.501023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:33.512578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.513320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.514207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.514504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.515258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:33.515612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:33.517252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:33.550371 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2489/4958] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:07:33.554749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:33.574684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b745fd-2e7b-4457-868b-5f41f3b1ca82 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:33.600874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.601702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.602057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.602514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.603318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:33.605455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:33.609208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b868c7f9aa6548619b1f41e8619a4ff3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.610954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b868c7f9aa6548619b1f41e8619a4ff3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.619721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b868c7f9aa6548619b1f41e8619a4ff3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.620715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b868c7f9aa6548619b1f41e8619a4ff3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.633405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:33.635957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:33.639201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b868c7f9aa6548619b1f41e8619a4ff3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:33.682590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2490/4959] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:33 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:33.685906 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2470/4960] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:33 2022] DELETE /identity/v3/users/b868c7f9aa6548619b1f41e8619a4ff3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:33.686937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:33.690147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:33.782652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964069-521b-4c79-b3f4-ebf18954a9b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:33.878504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.879678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.880235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.880675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.882307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:33.888737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:33.940661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2491/4961] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:33 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:33.941198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:33.983937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdf7b3-ca32-4ef1-804b-04bfb2368dca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:33.993086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:33.994923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:33.995403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:33.997455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:33.998373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:34.001647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:34.027398 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2471/4962] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:07:34.028673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:34.058167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f308377-7dbf-4eaf-b1d6-a85cb6e22531 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:34.075567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:34.076764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:34.077371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:34.077798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:34.078716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:34.080619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cab9d6-e95f-4b18-8e35-e63e2a2c4d0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:34.093858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2492/4963] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:34.098113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:34.110078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cccbc7-7106-4a5a-a341-50a95eef3e0e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:34.115864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:34.120423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:34.120910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:34.121297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] PATH_INFO: `/v3/projects/f3a52f1d9032436f907a2d30636b5d3d/users/c06fd081dccd4e10bdbb3c7871be811f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:34.152787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a52f1d9032436f907a2d30636b5d3d, user_id=c06fd081dccd4e10bdbb3c7871be811f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:34.158832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d97a-18f6-4f2f-b6e3-ef0b0971fee6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:34.212513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2472/4964] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:34 2022] PUT /identity/v3/projects/f3a52f1d9032436f907a2d30636b5d3d/users/c06fd081dccd4e10bdbb3c7871be811f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:34.223754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:34.224147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:34.224430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:34.269578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] MFA Rules not processed for user `c06fd081dccd4e10bdbb3c7871be811f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:34.271935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:34.394178 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2493/4965] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:34.407390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:34.407733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:34.408040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:34.432114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] MFA Rules not processed for user `c06fd081dccd4e10bdbb3c7871be811f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:34.433335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:34.459722 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2473/4966] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:34.460644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:34.462082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:34.494816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:34.616531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92072ac-a119-47d0-bc34-c7aabd403366 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:34.623294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:34.624381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:34.624861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:34.625350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:34.637223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:34.639860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:34.658257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2494/4967] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:35.028023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:35.030115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.045182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:35.046897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.195597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd251a-7505-4a03-9be8-7ffb4ea92588 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:35.207607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:35.207607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.207607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.207607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] PATH_INFO: `/v3/users/1e858abe021e480686f6458e5b27ad24` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.208139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e858abe021e480686f6458e5b27ad24)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:35.209921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:35.294308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cf5ae-7e27-4384-9413-fc9145e1c7bf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:35.339374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:35.340501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.340964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.345631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.352724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.378393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e858abe021e480686f6458e5b27ad24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.393812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:35.396866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e858abe021e480686f6458e5b27ad24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.398751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:35.398886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e858abe021e480686f6458e5b27ad24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.400724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e858abe021e480686f6458e5b27ad24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.421602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e858abe021e480686f6458e5b27ad24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.430392 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2474/4968] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:35.431437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:35.438715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.461143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a697a0-11f0-4f53-b8a3-591ff0579a72 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:35.474639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:35.476775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.476775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.476775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] PATH_INFO: `/v3/projects/07003980530b45e9aa7dcec68ac46d88` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.478091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07003980530b45e9aa7dcec68ac46d88)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:35.482123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:35.484193 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2495/4969] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:35 2022] DELETE /identity/v3/users/1e858abe021e480686f6458e5b27ad24 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:35.487881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:35.492173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.567119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:35.599583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07003980530b45e9aa7dcec68ac46d88', 'request_id': 'req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.611745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07003980530b45e9aa7dcec68ac46d88', 'request_id': 'req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.625145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07003980530b45e9aa7dcec68ac46d88', 'request_id': 'req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.662922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] The token cache is being invalidate because project 07003980530b45e9aa7dcec68ac46d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:35.663194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.672080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b711637b-6c22-40eb-80a7-d2b25b8d4ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:35.680273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2475/4970] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:35 2022] DELETE /identity/v3/projects/07003980530b45e9aa7dcec68ac46d88 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:35.681849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec031-6402-46a5-9742-77493e6a90ae None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.682189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec031-6402-46a5-9742-77493e6a90ae None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.682411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec031-6402-46a5-9742-77493e6a90ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.743949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-95dec031-6402-46a5-9742-77493e6a90ae None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:35.745443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95dec031-6402-46a5-9742-77493e6a90ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:35.777431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171b2e-b4a0-4fa3-a306-be5466b375fd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:35.786194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:35.945279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2476/4971] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:35.959138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.960121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.960413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.968021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:35.969074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:35.969359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:35.969634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] PATH_INFO: `/v3/users/1ce29cab189247e283afea730e23d7ed` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:35.976404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce29cab189247e283afea730e23d7ed)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:35.978444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.035656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:36.037538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.063342 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2477/4972] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:36.067989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.088162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d670f7-fc7b-4e04-92a5-3fbdfcf7b9a1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.098781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce29cab189247e283afea730e23d7ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.105831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.106527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.106809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.107196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.108136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:36.108457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.110092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.120614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce29cab189247e283afea730e23d7ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.122620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce29cab189247e283afea730e23d7ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.124005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce29cab189247e283afea730e23d7ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.151596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2478/4973] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:36.152621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.161230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.179562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98e862d7-d7d7-493b-965a-8b386cba22e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce29cab189247e283afea730e23d7ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.196506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258491-b1bd-4495-9cff-2f6f6b358126 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.218734 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2496/4974] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:35 2022] DELETE /identity/v3/users/1ce29cab189247e283afea730e23d7ed => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:36.220307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.220805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.221203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.222506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.223190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.223473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.223779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.224662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.226509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.281361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:36.287372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.336394 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2479/4975] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:36 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:36.336394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.350711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.404399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:36.481137 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2497/4976] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:36.481775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.502417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bcf1-f215-4dc9-ae42-28e84041730d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.505677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae4eab-c694-44db-8808-7fb7540d5dc0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.512356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.513329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.514424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.515360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] PATH_INFO: `/v3/projects/ee106eb4506843ffa58a26f486d2e0dd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.516805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee106eb4506843ffa58a26f486d2e0dd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.519022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.519773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.520135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.520302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.521346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.523296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.526977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.584649 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2498/4977] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:36 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:36.584649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.585428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.666770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee106eb4506843ffa58a26f486d2e0dd', 'request_id': 'req-030b09c6-aee8-480c-a9f4-14a09e855e6c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.678315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee106eb4506843ffa58a26f486d2e0dd', 'request_id': 'req-030b09c6-aee8-480c-a9f4-14a09e855e6c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.690207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee106eb4506843ffa58a26f486d2e0dd', 'request_id': 'req-030b09c6-aee8-480c-a9f4-14a09e855e6c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.729028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] The token cache is being invalidate because project ee106eb4506843ffa58a26f486d2e0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:36.729328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.730040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:36.732243 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2480/4978] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:36 2022] DELETE /identity/v3/projects/ee106eb4506843ffa58a26f486d2e0dd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:36.733366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:36.735266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.750481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:36.776813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c2e3-1519-40a4-9f08-2c843a6fff33 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.893989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b09c6-aee8-480c-a9f4-14a09e855e6c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:36.913007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.913719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.914005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.914285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.917248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.922317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b490d5c-eba3-46c6-950a-17aca1cff2d2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.932817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:36.938864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.939631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.942089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.948348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:36.958773 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2481/4979] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:36.963199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:36.963582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:36.963955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:36.965683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:36.967558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:36.983461 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2499/4980] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:36.984427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.009048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:37.010652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:37.010871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da66c9b-c257-4927-bd7b-1e1b59197e32 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.023785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.024842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.025413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.025538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.026214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.028224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27386d9-5e19-462f-8be4-f6f882eec131 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.048036 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2482/4981] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:37.051554 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2500/4982] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:37.053694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.059312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.060328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.064561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.075830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226021d2-1f22-4196-b4dc-27a3ba0a65ad None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.089207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.091718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.092174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.092619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] PATH_INFO: `/v3/projects/e98fc977ca1e415aa56d63e901a9acaa/users/d09873cd5b94494a82b44cd5a3920dbd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.097697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:37.099305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:37.113388 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2501/4983] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:37.119566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.145248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98fc977ca1e415aa56d63e901a9acaa, user_id=d09873cd5b94494a82b44cd5a3920dbd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.162046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c2f77-42e8-49e7-b91f-a23cdfd4d261 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.166464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbcd7a-1b3d-4d0e-b1a4-1328f6f6a2bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.182862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.184673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.184965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.185905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.187083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:37.187389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.197692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.202480 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2483/4984] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:37 2022] PUT /identity/v3/projects/e98fc977ca1e415aa56d63e901a9acaa/users/d09873cd5b94494a82b44cd5a3920dbd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:37.218799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.220107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.220596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.230965 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2502/4985] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:37.235977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.262398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823da2-884a-46d5-b14c-4264e6e8fd80 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.334701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] MFA Rules not processed for user `d09873cd5b94494a82b44cd5a3920dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:37.340585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:37.448164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:37.477926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.478623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.478899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.479183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.479933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.490426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.546560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2503/4986] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:37.551915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.555395 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2484/4987] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:37.566907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.590944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbf0ba-4ec1-4bc2-b56d-857cf6d4eba3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.686627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd075f-806d-4149-955f-e4734ef12023 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.693390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.694089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.694378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.694662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.695604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.697504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.731646 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2504/4988] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:37.733293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.734050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.734410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.735454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.735955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.736825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.742645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.747320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc2d84-13b8-4082-bd2d-c6ab2e2ca1a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.756440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.757521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.757657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.758016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.758865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.759299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:37.760729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.772968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2505/4989] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:37.773899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.803986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:37.814172 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2485/4990] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:37.814172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.839409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05216a-b7a3-417d-9082-e55f06b28424 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.896901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af65b0-7ded-41c0-a27a-aea25f7bf058 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.901869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.902574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.902926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.903265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.904257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.906097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.921232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2486/4991] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:37.921232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.922310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.923271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.923649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.924003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] PATH_INFO: `/v3/projects/baf5ceaed9b646e39bcb18e82146ed3e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.925578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf5ceaed9b646e39bcb18e82146ed3e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.928326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.931485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc98be3-a5f9-4473-84e9-f7b8b10c79df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.937547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:37.938815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:37.939297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:37.939673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:37.940483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:37.942526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:37.974578 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2487/4992] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:37 2022] POST /identity/v3/users => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:37.975456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:37.987116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407305e-7977-40ea-8b18-92f3cc60ac45 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:37.999168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf5ceaed9b646e39bcb18e82146ed3e', 'request_id': 'req-80b0ca72-80d9-4976-8a9d-75993a6ab01f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:38.005948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf5ceaed9b646e39bcb18e82146ed3e', 'request_id': 'req-80b0ca72-80d9-4976-8a9d-75993a6ab01f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:38.008108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:38.016858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf5ceaed9b646e39bcb18e82146ed3e', 'request_id': 'req-80b0ca72-80d9-4976-8a9d-75993a6ab01f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:38.041102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] The token cache is being invalidate because project baf5ceaed9b646e39bcb18e82146ed3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:38.042590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:38.043768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:38.046809 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2506/4993] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:37 2022] DELETE /identity/v3/projects/baf5ceaed9b646e39bcb18e82146ed3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:38.048320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.049672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.065021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.066019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.066785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.067139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] PATH_INFO: `/v3/projects/14f851d439ae4167af07518e3b1354ac/users/ecdc2e5bf2e3492bb5320e054641ec3c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.084138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f851d439ae4167af07518e3b1354ac, user_id=ecdc2e5bf2e3492bb5320e054641ec3c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.086928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc90b3-f676-4840-b53f-f63ff497422e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.105628 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2488/4994] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:37 2022] PUT /identity/v3/projects/14f851d439ae4167af07518e3b1354ac/users/ecdc2e5bf2e3492bb5320e054641ec3c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:38.107382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b711ce-ff62-439f-ad4c-0ddd9932d8e1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.108209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b711ce-ff62-439f-ad4c-0ddd9932d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.108487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b711ce-ff62-439f-ad4c-0ddd9932d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.144877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-26b711ce-ff62-439f-ad4c-0ddd9932d8e1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:38.146351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-26b711ce-ff62-439f-ad4c-0ddd9932d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.149042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0ca72-80d9-4976-8a9d-75993a6ab01f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.200163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:38.221364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2489/4995] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:38.234067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.234460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.246197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.246909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.247196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.247377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.247682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.249206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.251109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8641ce-d556-42a8-9639-f3fc18b07519 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.263995 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2507/4996] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:38.265223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.265517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.265807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.286308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:38.287966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.290055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:38.291283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.296385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2490/4997] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:38.297239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.307851 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2508/4998] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:38.312743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22522-a83b-4840-850d-0d4bd5c7c791 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.312935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.313551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.313937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.314851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.315259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.315572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] PATH_INFO: `/v3/projects/a798a42e9191470789815fe0f1ae0fb2/users/0dc6e2f7c18b4505a524b44873ce778b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.351887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a798a42e9191470789815fe0f1ae0fb2, user_id=0dc6e2f7c18b4505a524b44873ce778b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.356603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.384126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2491/4999] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:38 2022] PUT /identity/v3/projects/a798a42e9191470789815fe0f1ae0fb2/users/0dc6e2f7c18b4505a524b44873ce778b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:38.385172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.394219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb22a4e-2efb-4afa-af97-dff178fb8f3e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.437477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:38.482847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.482847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.482847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.482847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.499886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3519b-bd01-4ac2-92ac-9ab509f2aee0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.508581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.510583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.510738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.511950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.514117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:38.514506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.517146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.544575 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2492/5000] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:38.545577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.560957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162eda-5360-48b6-abf1-8ac8ef5acd19 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.567585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.568784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.568784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.569257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.570488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.572114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.584418 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2493/5001] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:38.585106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.596675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e48bcc-0259-4e90-94d2-5b7ad59b2b6d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.607882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.609466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.609981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.610379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.611555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.612227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.614349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.614733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.630282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2509/5002] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:38.631144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.641518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a35e-e1b0-44c1-9ee9-a923fb41f964 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.648355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.649803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.650200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.650598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] PATH_INFO: `/v3/projects/a798a42e9191470789815fe0f1ae0fb2/users/0dc6e2f7c18b4505a524b44873ce778b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.653110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a798a42e9191470789815fe0f1ae0fb2, user_id=0dc6e2f7c18b4505a524b44873ce778b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.654154 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2494/5003] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:38.656044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.656782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb214b-f0e8-4fc4-810a-6ede6ec2b23e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.676323 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2510/5004] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:38 2022] PUT /identity/v3/projects/a798a42e9191470789815fe0f1ae0fb2/users/0dc6e2f7c18b4505a524b44873ce778b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:38.691713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.692994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.694418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.739927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] MFA Rules not processed for user `0dc6e2f7c18b4505a524b44873ce778b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:38.740356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efe89-d3b0-4b3d-a9e9-b6cb34418cfd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.744007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.781061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:38.847190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.849195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.850255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.850255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.851490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.854002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.883929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2511/5005] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:38.893711 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2495/5006] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:38 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:38.895082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.896811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.900831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:38.917127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77303f-177a-4dfa-9353-2eb5804f1a7f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.927354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.928184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.928470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.928779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.930263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.944070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.964392 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2512/5007] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:38.965862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:38.977993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cb175-b8ce-44b7-a830-6dfd31b4e6e7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.985141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.986187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.987048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.987048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.987988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173b237-4b9c-4c52-8dec-dd39202873e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:38.988162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:38.990308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:38.993984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:38.994786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:38.995212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:38.995647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:38.997779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:39.010052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2513/5008] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:39.012210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:39.026322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a40aa-6ee2-4243-aedb-11155a7eae1c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:39.034033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:39.035630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:39.035920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:39.036223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] PATH_INFO: `/v3/projects/5434a9961d86412595175726d5be3dc2/users/cc273fcf22a84377ba959577ebc8a81c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:39.054926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5434a9961d86412595175726d5be3dc2, user_id=cc273fcf22a84377ba959577ebc8a81c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:39.057875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcac1f5-3a82-4762-9c4f-3c4d62c72bba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:39.091123 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2514/5009] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:39 2022] PUT /identity/v3/projects/5434a9961d86412595175726d5be3dc2/users/cc273fcf22a84377ba959577ebc8a81c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:39.093652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14cc42-d2e2-422e-a2f5-c64929a8cae7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:39.093942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14cc42-d2e2-422e-a2f5-c64929a8cae7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:39.094216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14cc42-d2e2-422e-a2f5-c64929a8cae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:39.121021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:39.123561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:39.124581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:39.133259 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2496/5010] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:39.135629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0b14cc42-d2e2-422e-a2f5-c64929a8cae7 None None] MFA Rules not processed for user `cc273fcf22a84377ba959577ebc8a81c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:39.138878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0b14cc42-d2e2-422e-a2f5-c64929a8cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:39.289451 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2515/5011] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:39.300441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:39.302149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:39.373390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943eee31-bda9-49bb-92a4-5b7f4d2eef8f service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:39.406209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:39.444952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:39.445655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:39.445962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:39.446441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:39.457926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:39.459442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af8801-a6d7-44f9-8673-268f18175de5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:39.469827 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2497/5012] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:40.779342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:40.780069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:40.780069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:40.813398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] MFA Rules not processed for user `ecdc2e5bf2e3492bb5320e054641ec3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:40.814820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:40.959177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2516/5013] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:40.959806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:40.960277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:40.960370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:41.005133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] MFA Rules not processed for user `ecdc2e5bf2e3492bb5320e054641ec3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:41.006235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:41.029217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2498/5014] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:41.405725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:41.407694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:41.431336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:41.433561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:41.523756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ba7f7-044e-47e3-ac8a-06a73b5b7f73 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:41.556608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:41.557457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:41.558595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:41.559031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:41.582641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:41.584515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4cb92-a18c-4d62-a446-1dedad63109a service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:41.598377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2517/5015] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:41.599827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc43c9f-1425-4d6a-ae44-cceb6dac29b3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:41.612841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:41.614264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:41.614264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:41.614615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] PATH_INFO: `/v3/users/3d8e16f578424cd4835085ce387ec659` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:41.616636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8e16f578424cd4835085ce387ec659)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:41.620067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:41.723737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8e16f578424cd4835085ce387ec659'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:41.725116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8e16f578424cd4835085ce387ec659'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:41.735032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8e16f578424cd4835085ce387ec659'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:41.736172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8e16f578424cd4835085ce387ec659'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:41.753122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8e16f578424cd4835085ce387ec659'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:41.783277 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2499/5016] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:41 2022] DELETE /identity/v3/users/3d8e16f578424cd4835085ce387ec659 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:41.788318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:41.789518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:41.790093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:41.838120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:41.840164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:41.886856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:41.967455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2518/5017] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:07:41.994433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:41.998537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:42.080252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:42.103330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68894e9f-7f4e-4e13-9027-9f1ad251052d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:42.110513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:42.111626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:42.113095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:42.114274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:42.134053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:42.136343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a4b8-093a-4d3d-9f94-932e45ee50f9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:42.151705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2500/5018] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:43.014102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.016423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:43.042446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a8189-d0ca-4086-b428-7289ce65f6b1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.072793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.076481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.076882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.077424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] PATH_INFO: `/v3/projects/301e9cee0f0e46c88a533a74a81cc2e3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.092070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301e9cee0f0e46c88a533a74a81cc2e3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.103816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.229224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301e9cee0f0e46c88a533a74a81cc2e3', 'request_id': 'req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:43.248267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301e9cee0f0e46c88a533a74a81cc2e3', 'request_id': 'req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:43.277431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301e9cee0f0e46c88a533a74a81cc2e3', 'request_id': 'req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:43.313180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] The token cache is being invalidate because project 301e9cee0f0e46c88a533a74a81cc2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:43.313507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:43.323826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:43.325965 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2519/5019] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:43 2022] DELETE /identity/v3/projects/301e9cee0f0e46c88a533a74a81cc2e3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:43.332533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3fc7-dc56-4513-afa0-5bc23829dd55 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.333090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3fc7-dc56-4513-afa0-5bc23829dd55 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.333090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3fc7-dc56-4513-afa0-5bc23829dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.361805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b1bf3fc7-dc56-4513-afa0-5bc23829dd55 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:43.363642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b1bf3fc7-dc56-4513-afa0-5bc23829dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:43.367365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.381278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:43.478981 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2501/5020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:43.488320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.488614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.489012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.516230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:43.518538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:43.539567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2502/5021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:43.541442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.548833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa79c-2d3c-46de-8a0d-0facc5b69b81 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.553476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.554145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.554484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.554941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.557993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:43.558507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4f42-4c63-4ee2-a5b7-23007cc6dce0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.567989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.568827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.569307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.569688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.570808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:43.572212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.574102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.578340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.580058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.595285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2503/5022] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:43.596242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.597313 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2520/5023] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:43.609433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f427-1955-4256-95a6-356f003292c3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.616371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.617953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.618395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.618674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.619435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.624440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.673975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2504/5024] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:43 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:43.678416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.694236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cc20d-85f6-4106-a344-1142439ffb54 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.779192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:43.811943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.812724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.813288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.813663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.814715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.817119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.858613 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2521/5025] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:43 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:43.862511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.879821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d98b6-950e-4504-9833-3f3eef9550c0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.894170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.895163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.895458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.896137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.898003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.900146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.922353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2505/5026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:43.926244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:43.937960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298954-d2ca-4478-9d79-f2e685879bb4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:43.944052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:43.944747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:43.945036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:43.945324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:43.946069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:43.947733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0748e-8914-4679-840e-2e62faa22022 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:43.966354 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2522/5027] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:43.970587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:44.002483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980c509-2194-4633-a778-65c72d73d950 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:44.014171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:44.015691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:44.016056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:44.018685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] PATH_INFO: `/v3/projects/3fae3157a11e4b7ab621512cec5442b5/users/797aa51baad940e08e46a861b76e4af6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:44.062180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fae3157a11e4b7ab621512cec5442b5, user_id=797aa51baad940e08e46a861b76e4af6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:44.065371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:44.093494 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2506/5028] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:43 2022] PUT /identity/v3/projects/3fae3157a11e4b7ab621512cec5442b5/users/797aa51baad940e08e46a861b76e4af6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:07:44.098692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:44.099211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:44.099341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:44.132942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:44.141625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:44.315827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2523/5029] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:44.381233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:44.512010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5444b-8f64-4e99-b0fd-cc7627fb13e4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:44.517217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:44.518540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:44.519078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:44.519624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:44.534421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:44.536967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903db7d-e962-419e-b00a-2c5aca41ce01 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:44.569280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:44.570617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:44.574067 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2507/5030] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:44.687253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b52789-3f7c-42bc-b577-cd6161679652 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:44.692232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:44.693530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:44.694040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:44.694820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:44.698731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:44.825149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:44.827679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccf3a5-9262-40c9-a6ed-787a10e55c53 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:44.849595 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2524/5031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:47.998624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:47.999109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:47.999620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:48.060208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:48.070062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] MFA Rules not processed for user `797aa51baad940e08e46a861b76e4af6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:48.071401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:48.180605 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2508/5032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:48.190542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:48.191699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:48.192214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:48.221023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] MFA Rules not processed for user `797aa51baad940e08e46a861b76e4af6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:48.222674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:48.234738 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2525/5033] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:48.253187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:48.255911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:48.355213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:48.365981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:48.385455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d284af2-c434-42c8-90cb-654e59126fec None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:48.399984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:48.401536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:48.403276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:48.404084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:48.406979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:48.418964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856f9c2-5e87-4159-9594-af78ab630517 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:48.428208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:48.430479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:48.430844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:48.432684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:48.436664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:48.438167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030f58-e852-40eb-bc6f-6a969a84c173 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:48.463301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:48.465121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:48.465720 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2526/5034] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:07:48.490473 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2509/5035] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:49.588686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:49.590156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:49.591181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:49.640140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:49.642174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:49.749878 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2527/5036] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:49.770277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:49.772476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:49.991750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b858042-fa36-49da-83bc-7b723b0064d0 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:50.001325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:50.002644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:50.003061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:50.003443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:50.017899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:50.020479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151e0b3-9921-4488-8c05-072d540d5d33 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:50.051262 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2510/5037] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:51.644591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:51.646730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:51.668531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9fea-cbf9-409c-b548-dbc84e1ae4cb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:51.678810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:51.680280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:51.680767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:51.681377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] PATH_INFO: `/v3/users/d09873cd5b94494a82b44cd5a3920dbd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:51.683356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09873cd5b94494a82b44cd5a3920dbd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:51.691922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:51.853782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09873cd5b94494a82b44cd5a3920dbd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:51.874329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09873cd5b94494a82b44cd5a3920dbd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:51.881056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09873cd5b94494a82b44cd5a3920dbd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:51.882496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09873cd5b94494a82b44cd5a3920dbd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:51.909797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09873cd5b94494a82b44cd5a3920dbd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:51.935877 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2528/5038] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:51 2022] DELETE /identity/v3/users/d09873cd5b94494a82b44cd5a3920dbd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:51.941085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681037a-831b-45a2-863e-60857c69c09c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:51.942006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681037a-831b-45a2-863e-60857c69c09c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:51.942460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681037a-831b-45a2-863e-60857c69c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:51.992648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f681037a-831b-45a2-863e-60857c69c09c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:51.997714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f681037a-831b-45a2-863e-60857c69c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:52.022397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:52.173568 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2511/5039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:52.198317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:52.199974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:52.339108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe7f8-2269-4472-bf6c-3cbb170e6bc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:52.344558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:52.346244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:52.347128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:52.347412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:52.385646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:52.386311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:52.402073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2529/5040] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:54.308360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681037a-831b-45a2-863e-60857c69c09c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:54.310780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f681037a-831b-45a2-863e-60857c69c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:54.330452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681037a-831b-45a2-863e-60857c69c09c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:54.337160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:54.338423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:54.338706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:54.339053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] PATH_INFO: `/v3/projects/e98fc977ca1e415aa56d63e901a9acaa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:54.340595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98fc977ca1e415aa56d63e901a9acaa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:54.345001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:54.504302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98fc977ca1e415aa56d63e901a9acaa', 'request_id': 'req-5dceaea5-8d47-4e0a-8518-041454eb7bd1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.518668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98fc977ca1e415aa56d63e901a9acaa', 'request_id': 'req-5dceaea5-8d47-4e0a-8518-041454eb7bd1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.534831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98fc977ca1e415aa56d63e901a9acaa', 'request_id': 'req-5dceaea5-8d47-4e0a-8518-041454eb7bd1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.560983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] The token cache is being invalidate because project e98fc977ca1e415aa56d63e901a9acaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:54.561599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.562455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.564603 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2512/5041] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:54 2022] DELETE /identity/v3/projects/e98fc977ca1e415aa56d63e901a9acaa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:54.568523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:54.584356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91339603-ad55-4283-870b-5a0fe8c2ed19 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:54.599356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:54.693191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:54.694864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:54.695217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:54.695590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] PATH_INFO: `/v3/users/0dc6e2f7c18b4505a524b44873ce778b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:54.697931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc6e2f7c18b4505a524b44873ce778b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:54.701894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:54.826674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc6e2f7c18b4505a524b44873ce778b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.849513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc6e2f7c18b4505a524b44873ce778b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.850554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc6e2f7c18b4505a524b44873ce778b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.851936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc6e2f7c18b4505a524b44873ce778b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.898408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e6865f94-edbf-4788-99ca-345bcf11d511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc6e2f7c18b4505a524b44873ce778b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:54.935874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2530/5042] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:54 2022] DELETE /identity/v3/users/0dc6e2f7c18b4505a524b44873ce778b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:57.414749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:57.415647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:57.442601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dceaea5-8d47-4e0a-8518-041454eb7bd1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:57.571061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:57.571989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:57.572558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:57.573313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] PATH_INFO: `/v3/projects/a798a42e9191470789815fe0f1ae0fb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:57.574755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a798a42e9191470789815fe0f1ae0fb2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:57.577146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:57.675911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:57.686646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a798a42e9191470789815fe0f1ae0fb2', 'request_id': 'req-6fe12075-3b62-4422-b92a-d6c232d9162c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:57.699688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a798a42e9191470789815fe0f1ae0fb2', 'request_id': 'req-6fe12075-3b62-4422-b92a-d6c232d9162c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:57.707676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a798a42e9191470789815fe0f1ae0fb2', 'request_id': 'req-6fe12075-3b62-4422-b92a-d6c232d9162c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:57.724940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] The token cache is being invalidate because project a798a42e9191470789815fe0f1ae0fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:07:57.725240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:57.725891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6fe12075-3b62-4422-b92a-d6c232d9162c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:57.727621 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2513/5043] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:57 2022] DELETE /identity/v3/projects/a798a42e9191470789815fe0f1ae0fb2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:57.734135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:57.734966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:57.739317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:57.758668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:57.760199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:57.909943 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2531/5044] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:57.912019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:57.912554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:57.913038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:57.968994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:57.970248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:57.988211 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2514/5045] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:57.992684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.006934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f92c6-d4a0-456f-a997-bf5742354c3c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.019681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.020407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.021115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.021411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.022159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:07:58.022468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.026496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.077187 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2532/5046] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:07:58.078977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.096115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9413bc-29fa-43ee-a722-3d543d362678 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.111805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.112512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.112797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.113074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.113898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.115904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.180474 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2515/5047] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:07:58 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:07:58.182692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.205696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b9c4c-aca2-449d-b688-07f1c59a80ee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.228099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:58.337222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.337584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.338265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.338550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.339248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.341335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.415254 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2533/5048] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:07:58 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:07:58.416957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.430094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6f30-fba7-49d5-80d8-464e7248b051 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.448831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.449441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.449726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.450001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.451483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.453162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.486348 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2516/5049] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:58.490236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.512620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54f71-23be-48c0-828c-ed0164fd1e0f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.532051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.532817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.533170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.533423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.537261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.544894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70a838-ad41-4a23-bb77-04ffd9e562f6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.573832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2534/5050] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:07:58.577244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.589858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8720c-7430-4c73-a0e2-27738a470888 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.621918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.621918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.621918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.621918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] PATH_INFO: `/v3/projects/1ce5330feda441c8be7f408ebf8f2f97/users/e9f3fa7e57c74dceb5f6dffa2fe7081e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.633676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce5330feda441c8be7f408ebf8f2f97, user_id=e9f3fa7e57c74dceb5f6dffa2fe7081e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.637432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.663979 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2517/5051] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:07:58 2022] PUT /identity/v3/projects/1ce5330feda441c8be7f408ebf8f2f97/users/e9f3fa7e57c74dceb5f6dffa2fe7081e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:58.676064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.676341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.676620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.718035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] MFA Rules not processed for user `e9f3fa7e57c74dceb5f6dffa2fe7081e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:58.719980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:58.810856 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2535/5052] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:58.823313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:58.825232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:58.933801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d084977-534f-40e4-80c5-9d836f94e757 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:58.939531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:58.940119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:58.940589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:58.941033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:58.959870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:58.961702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579be34e-b0e6-4862-829b-e53da049f90b service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:58.973672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2518/5053] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:59.001900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:59.116321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14a1e-1d20-4829-ac93-c1944ab17637 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:59.124006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:59.126821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:59.127112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:59.128875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] PATH_INFO: `/v3/users/e9f3fa7e57c74dceb5f6dffa2fe7081e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:59.131180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f3fa7e57c74dceb5f6dffa2fe7081e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:59.138178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:59.194560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:59.238134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f3fa7e57c74dceb5f6dffa2fe7081e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:59.253167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f3fa7e57c74dceb5f6dffa2fe7081e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:59.254261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f3fa7e57c74dceb5f6dffa2fe7081e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:59.255114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f3fa7e57c74dceb5f6dffa2fe7081e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:59.275462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f3fa7e57c74dceb5f6dffa2fe7081e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:07:59.311686 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2536/5054] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:07:58 2022] DELETE /identity/v3/users/e9f3fa7e57c74dceb5f6dffa2fe7081e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:07:59.317058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:59.317522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:59.317958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:59.344729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:07:59.347242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:59.439564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2519/5055] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:07:59.509543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:07:59.512949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:07:59.712232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491214c-a961-44c9-9ac7-3c0711a8b7bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:07:59.720246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:07:59.721402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:07:59.721888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:07:59.722232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:07:59.736140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:07:59.738173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0f85b-c8b0-4d64-9f6e-a667c4d6566a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:07:59.752151 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2537/5056] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:01.236355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:01.237905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:01.278154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8c0c-adf2-4315-8514-859c047b23b2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:01.308363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:01.310485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:01.311124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:01.313307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] PATH_INFO: `/v3/projects/1ce5330feda441c8be7f408ebf8f2f97` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:01.316486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce5330feda441c8be7f408ebf8f2f97)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:01.322191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:01.338592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:01.502292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce5330feda441c8be7f408ebf8f2f97', 'request_id': 'req-886977e9-c297-4c8b-8646-264ad59225bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:01.513917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce5330feda441c8be7f408ebf8f2f97', 'request_id': 'req-886977e9-c297-4c8b-8646-264ad59225bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:01.522081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce5330feda441c8be7f408ebf8f2f97', 'request_id': 'req-886977e9-c297-4c8b-8646-264ad59225bf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:01.545776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] The token cache is being invalidate because project 1ce5330feda441c8be7f408ebf8f2f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:01.546318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:01.547764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-886977e9-c297-4c8b-8646-264ad59225bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:01.554432 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2520/5057] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:01 2022] DELETE /identity/v3/projects/1ce5330feda441c8be7f408ebf8f2f97 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:01.556486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:01.557404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:01.557904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:01.592288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:01.593905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:01.753796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2538/5058] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:01.762995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:01.763274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:01.763631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:01.792607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:01.794261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:01.803248 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2521/5059] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:01.808436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:01.823979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd8b3-6dc9-4c2f-acc9-2e601c26628d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:01.835230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:01.837119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:01.837613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:01.838714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:01.839841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:01.841157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:01.844136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:01.882548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2539/5060] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:01.886737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:01.909858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d899d-5ebe-4c66-ae10-a6be203af4f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:01.926308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:01.927189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:01.927809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:01.928385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:01.929303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:01.938995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:01.995834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2522/5061] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:02.000872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:02.025921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3d472-5048-486d-acc4-fa8cffbe26ed admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:02.132032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:02.191134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:02.192235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.192746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.193754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.195464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:02.198754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:02.242473 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2540/5062] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:01 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:02.242962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:02.263324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa48524-ee64-4acf-9ab3-8d18a27087ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:02.277996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:02.279333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.279864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.281965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.282920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:02.286391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:02.319604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2523/5063] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:02.322161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:02.337100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42fa1a-4126-4b50-b764-ff4d0c73bc8f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:02.348185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:02.352602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.352977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.353333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.355095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:02.367607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4b8e-937f-4c8f-aa06-ae0afbae139e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:02.416019 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2541/5064] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:02.420987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:02.439399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a07af-8f36-4978-a3f9-884240111423 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:02.459635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:02.460566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.460851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.462023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] PATH_INFO: `/v3/projects/f72307bb0ec24d91a632a33d7b6fe327/users/a724241c1a654f5191565cf93dd7a0a6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.498768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72307bb0ec24d91a632a33d7b6fe327, user_id=a724241c1a654f5191565cf93dd7a0a6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:02.503153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:02.545289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.546050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.546569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.548299 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2524/5065] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:02 2022] PUT /identity/v3/projects/f72307bb0ec24d91a632a33d7b6fe327/users/a724241c1a654f5191565cf93dd7a0a6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:02.593455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] MFA Rules not processed for user `a724241c1a654f5191565cf93dd7a0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:02.596054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:02.699339 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2542/5066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:02.711438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:02.713522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:02.906792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545e131-90ed-46b3-8667-8525ee83b93a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:02.916047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:02.917266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:02.917713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:02.918179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:02.952898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:02.955015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:02.973462 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2525/5067] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:06.593747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:06.597995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:06.810193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c33d4-2d6c-4bcf-910a-100bb8a879a0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:06.817704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:06.818873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:06.819309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:06.819956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] PATH_INFO: `/v3/users/890837d5b27e4471b54c1eac851e88c5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:06.822241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890837d5b27e4471b54c1eac851e88c5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:06.824541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:07.005388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:07.011658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890837d5b27e4471b54c1eac851e88c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:07.046854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890837d5b27e4471b54c1eac851e88c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:07.048281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890837d5b27e4471b54c1eac851e88c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:07.049099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890837d5b27e4471b54c1eac851e88c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:07.093750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890837d5b27e4471b54c1eac851e88c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:07.127176 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2543/5068] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:06 2022] DELETE /identity/v3/users/890837d5b27e4471b54c1eac851e88c5 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:07.839134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:07.863060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f9c3-6966-4829-9f73-8d3b66597f34 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:07.937529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:07.999063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:08.000026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:08.000433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:08.000722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] PATH_INFO: `/v3/projects/83e17865ce4e4d2ba7854d03668bfb78` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:08.001919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e17865ce4e4d2ba7854d03668bfb78)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:08.004318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:08.153175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e17865ce4e4d2ba7854d03668bfb78', 'request_id': 'req-93be4509-39e1-4348-a48f-8ed06b949aad'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.160937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e17865ce4e4d2ba7854d03668bfb78', 'request_id': 'req-93be4509-39e1-4348-a48f-8ed06b949aad'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.182268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e17865ce4e4d2ba7854d03668bfb78', 'request_id': 'req-93be4509-39e1-4348-a48f-8ed06b949aad'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.241593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] The token cache is being invalidate because project 83e17865ce4e4d2ba7854d03668bfb78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:08.242089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.243045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.248034 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2526/5069] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:07 2022] DELETE /identity/v3/projects/83e17865ce4e4d2ba7854d03668bfb78 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:08.252213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:08.261020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:08.305916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c2c46-534d-4316-828e-99efb6c85ec1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:08.434789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:08.436312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:08.436819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:08.437254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] PATH_INFO: `/v3/users/2223013130e24fbf8c5f254456bd9417` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:08.438791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2223013130e24fbf8c5f254456bd9417)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:08.442386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:08.537039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2223013130e24fbf8c5f254456bd9417'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.545215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2223013130e24fbf8c5f254456bd9417'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.546015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2223013130e24fbf8c5f254456bd9417'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.546636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2223013130e24fbf8c5f254456bd9417'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.564558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7463307a-7894-4b6b-bb9c-4448363f26b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2223013130e24fbf8c5f254456bd9417'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:08.589042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2544/5070] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:08 2022] DELETE /identity/v3/users/2223013130e24fbf8c5f254456bd9417 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:08.985107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:08.987235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:09.004654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4509-39e1-4348-a48f-8ed06b949aad admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.084410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.085460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.085818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.086512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] PATH_INFO: `/v3/projects/1fe754dc088e4273aa7204d368d076d3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.088158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe754dc088e4273aa7204d368d076d3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.090837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.165935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe754dc088e4273aa7204d368d076d3', 'request_id': 'req-bcedae90-4c26-46a1-9b13-a3d0da2e0897'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:09.181559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe754dc088e4273aa7204d368d076d3', 'request_id': 'req-bcedae90-4c26-46a1-9b13-a3d0da2e0897'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:09.189857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe754dc088e4273aa7204d368d076d3', 'request_id': 'req-bcedae90-4c26-46a1-9b13-a3d0da2e0897'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:09.192911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:09.210951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] The token cache is being invalidate because project 1fe754dc088e4273aa7204d368d076d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:09.212327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:09.213359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bcedae90-4c26-46a1-9b13-a3d0da2e0897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:09.214964 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2527/5071] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:08 2022] DELETE /identity/v3/projects/1fe754dc088e4273aa7204d368d076d3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:09.220082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.220776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.221342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.254435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:09.256217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:09.317351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:09.352006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2545/5072] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:09.352353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.352970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.353419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.404970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:09.408892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:09.435525 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2528/5073] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:09.440620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.488444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05849a-1d96-40d7-8443-599ea4fbc6a1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.507980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.508898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.509338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.509791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.510946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:09.514181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.516231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.544063 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2546/5074] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:09.545417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.555373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2eeb-446d-4c6b-90fd-a9a521484764 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.563801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.565032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.565558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.566642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.567617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.570049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.603312 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2529/5075] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:09 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:09.608710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.622308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb64be-8c6e-446f-be3b-2f9d12dd2833 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.712370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.713133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.713484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.713827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.714595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.718563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.745765 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2547/5076] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:09 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:09.749928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.765087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0246fa-d6cb-4943-9241-f9d9d283416c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.777142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.778052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.778360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.778677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.779516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.781805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.818967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.835854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2530/5077] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:09.842375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7e07-894e-4d32-9f95-5fcc5742c33b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.848365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.849417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.849935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.850771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.852040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.854477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4756-2b94-4e04-a195-ba17931680c5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.871774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2548/5078] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:09.878000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:09.891165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52219346-8fe5-4727-a8fd-512c5a72f62c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:09.897801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:09.899141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.899716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.900621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] PATH_INFO: `/v3/projects/3a41aa195bb047cfae9f16c5e29050cc/users/33de20254305474aa55173591da1b6a6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.934235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a41aa195bb047cfae9f16c5e29050cc, user_id=33de20254305474aa55173591da1b6a6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:09.938073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:09.957505 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2531/5079] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:09 2022] PUT /identity/v3/projects/3a41aa195bb047cfae9f16c5e29050cc/users/33de20254305474aa55173591da1b6a6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:09.962894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849459f3-c6c5-4b15-9c24-5f0e131909ad None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:09.963309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849459f3-c6c5-4b15-9c24-5f0e131909ad None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:09.963699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849459f3-c6c5-4b15-9c24-5f0e131909ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:09.983997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-849459f3-c6c5-4b15-9c24-5f0e131909ad None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:09.985337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-849459f3-c6c5-4b15-9c24-5f0e131909ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.072460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2549/5080] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:10.084571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:10.086435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.203887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce152-4eaa-4f1d-ab24-fec132f82942 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:10.209036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:10.211027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:10.211270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:10.211631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:10.219167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:10.219537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:10.220502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:10.228309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:10.229953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:10.244612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2532/5081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:10.258698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:10.259980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.321309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:10.336097 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2550/5082] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:10.349421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:10.351029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.466963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2807011-dc0a-4717-87c6-72b0f4a460ca service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:10.475159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:10.475935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:10.476219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:10.476494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:10.490243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:10.491922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:10.503527 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2533/5083] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:08:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:10.615729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:10.617182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.642600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424306c-af9e-4fbc-a619-40bf2ec61407 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:10.649704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:10.651041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:10.651562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:10.651917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:10.667805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:10.695815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:10.698253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcaa08-a895-4e6e-af28-0baa76fa95b4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:10.721230 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2551/5084] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:10.978765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:10.980967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:11.020418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad70b7-eb65-4b72-abdc-542b1bb27e5b service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:11.047427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:11.048615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:11.062904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:11.062904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] PATH_INFO: `/v3/users/a724241c1a654f5191565cf93dd7a0a6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:11.063990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a724241c1a654f5191565cf93dd7a0a6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:11.067257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:11.096997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:11.167436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a724241c1a654f5191565cf93dd7a0a6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:11.168271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a724241c1a654f5191565cf93dd7a0a6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:11.190605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a724241c1a654f5191565cf93dd7a0a6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:11.192460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a724241c1a654f5191565cf93dd7a0a6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:11.226441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a724241c1a654f5191565cf93dd7a0a6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:11.252328 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2534/5085] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:10 2022] DELETE /identity/v3/users/a724241c1a654f5191565cf93dd7a0a6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:11.257152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:11.257498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:11.257959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:11.304298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:11.306403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:11.390410 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2552/5086] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:11.752946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:11.754518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:11.894381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbae4e-fdf5-4f1b-9c52-a11bd908a3da admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:11.901184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:11.901880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:11.902164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:11.903183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:11.941299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:11.942991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:11.959898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2535/5087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:12.941371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:12.946125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:13.080677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:13.082342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:13.111247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7d75-b712-4743-be50-cad785380849 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:13.128891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:13.130387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.130920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.131964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] PATH_INFO: `/v3/projects/f72307bb0ec24d91a632a33d7b6fe327` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.133608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72307bb0ec24d91a632a33d7b6fe327)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:13.137882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:13.162215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603852c-7a92-4c75-a22d-abd66affe9c8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:13.197646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:13.198476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.198771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.199143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.203705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:13.240679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:13.249829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72307bb0ec24d91a632a33d7b6fe327', 'request_id': 'req-ac89bc33-be64-4e94-a79b-4845e71b85fd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:13.260456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72307bb0ec24d91a632a33d7b6fe327', 'request_id': 'req-ac89bc33-be64-4e94-a79b-4845e71b85fd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:13.262668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37fbeb-b1bb-470a-9524-8d484eda5a79 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:13.268752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72307bb0ec24d91a632a33d7b6fe327', 'request_id': 'req-ac89bc33-be64-4e94-a79b-4845e71b85fd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:13.294760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] The token cache is being invalidate because project f72307bb0ec24d91a632a33d7b6fe327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:13.295399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:13.296576 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2553/5088] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:13.297286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ac89bc33-be64-4e94-a79b-4845e71b85fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:13.302778 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2536/5089] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:13 2022] DELETE /identity/v3/projects/f72307bb0ec24d91a632a33d7b6fe327 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:13.318473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.319121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.327721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.413226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:13.414489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:13.580992 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2554/5090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:13.589289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.589581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.589866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.626729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:13.638820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:13.667399 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2537/5091] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:13.672336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:13.689331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c62de6-ab60-4c1a-9559-5cdea0df7df6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:13.701915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:13.704216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.706537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.708110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.712099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:13.713055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:13.718220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:13.724152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:13.767883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2555/5092] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:13.772605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:13.788013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d4ce-5a19-4b00-87f8-64f451e828fe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:13.804674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:13.805305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:13.807568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:13.807691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:13.813498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:13.821437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:13.845882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:13.885502 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2538/5093] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:13 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:13.889664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:13.909481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbe5f4-49ee-4f07-9258-9a8bbddae0a2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.064109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.066167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.066630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.067084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.068766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.071417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:14.102768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2556/5094] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:13 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:14.106693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:14.122061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f43199-d032-4ce6-8cdd-c3ac75c489ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.138273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.139287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.139979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.140460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.141405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.145449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:14.165279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2539/5095] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:14.170669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:14.189234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d14dc-1a88-42e6-a05e-8b147a0d8e8e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.209763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.211108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.211826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.212393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.213612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.217935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00406c-4e08-4f64-82cc-780ae8e2734d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:14.237156 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2557/5096] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:14.242873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:14.257884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30377a9-206c-42c7-9d5e-3727ad773d16 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.268314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.272036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.273510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.274034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] PATH_INFO: `/v3/projects/78708ead8abd482bab61be479bae7912/users/14f03605fadb4a819444a497e7a2805f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.353909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] RBAC: Authorizing `identity:create_grant(project_id=78708ead8abd482bab61be479bae7912, user_id=14f03605fadb4a819444a497e7a2805f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.358769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:14.402852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2540/5097] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:14 2022] PUT /identity/v3/projects/78708ead8abd482bab61be479bae7912/users/14f03605fadb4a819444a497e7a2805f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:14.415095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.415381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.415902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.489703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] MFA Rules not processed for user `14f03605fadb4a819444a497e7a2805f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:14.492316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:14.685415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:14.688190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:14.711591 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2558/5098] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:14.729764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:14.731334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:14.846851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b23c4-a955-4081-9d9b-2d9fb35b1e6a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.852150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.855799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.856193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.856712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.877920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.880225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:14.905280 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2559/5099] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:14.910494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba86a8-dff1-416e-9204-359a2757decf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:14.922797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:14.925690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:14.926073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:14.926442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:14.932180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:14.974289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:14.976258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b613f16-9da9-4645-9f6a-91c400187171 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:15.021310 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2541/5100] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:16.364493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:16.366622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:16.383073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:16.518033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ccd6-ca2b-4849-8c06-fb1e1f3c4422 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:16.518538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ccd6-ca2b-4849-8c06-fb1e1f3c4422 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:16.520997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ccd6-ca2b-4849-8c06-fb1e1f3c4422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:16.536795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e682027-bd25-49dd-bef3-14254c3b01c8 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:16.555286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:16.556696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:16.557256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:16.557774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] PATH_INFO: `/v3/users/797aa51baad940e08e46a861b76e4af6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:16.562277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] RBAC: Authorizing `identity:delete_user(user_id=797aa51baad940e08e46a861b76e4af6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:16.564713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:16.580450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7049ccd6-ca2b-4849-8c06-fb1e1f3c4422 None None] MFA Rules not processed for user `14f03605fadb4a819444a497e7a2805f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:16.582599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7049ccd6-ca2b-4849-8c06-fb1e1f3c4422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:16.609110 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2542/5101] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:16.690864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:16.691259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:16.691749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:16.718609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797aa51baad940e08e46a861b76e4af6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:16.748943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:16.750715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797aa51baad940e08e46a861b76e4af6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:16.755341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797aa51baad940e08e46a861b76e4af6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:16.757050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797aa51baad940e08e46a861b76e4af6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:16.757940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:16.786290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797aa51baad940e08e46a861b76e4af6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:16.814736 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2560/5102] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:16 2022] DELETE /identity/v3/users/797aa51baad940e08e46a861b76e4af6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:16.832298 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2543/5103] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:16.859907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:16.863729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:17.010319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843d6ac-33a5-4ef0-8e35-dc479350526e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:17.024089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:17.024774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:17.025093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:17.025374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:17.087591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:17.160582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:17.163245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774749dc-a123-422e-8a00-0c8767f7414e service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:17.182896 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2561/5104] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:08:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:17.399840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:17.402000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:17.440732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7b629-429e-4724-98d6-b3732ca35f8f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:17.542647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:17.601319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:17.602415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:17.602877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:17.603322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] PATH_INFO: `/v3/projects/3fae3157a11e4b7ab621512cec5442b5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:17.608644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fae3157a11e4b7ab621512cec5442b5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:17.610872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:17.726559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fae3157a11e4b7ab621512cec5442b5', 'request_id': 'req-b552ebc0-f800-4873-9c0e-9299eb6e14ef'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:17.751938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fae3157a11e4b7ab621512cec5442b5', 'request_id': 'req-b552ebc0-f800-4873-9c0e-9299eb6e14ef'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:17.764870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fae3157a11e4b7ab621512cec5442b5', 'request_id': 'req-b552ebc0-f800-4873-9c0e-9299eb6e14ef'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:17.795256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] The token cache is being invalidate because project 3fae3157a11e4b7ab621512cec5442b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:17.795582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:17.799502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b552ebc0-f800-4873-9c0e-9299eb6e14ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:17.801576 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2544/5105] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:17 2022] DELETE /identity/v3/projects/3fae3157a11e4b7ab621512cec5442b5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:17.806438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:17.806979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:17.807222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:17.841554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:17.843413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:18.039776 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2562/5106] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:18.048806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.049162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.049475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.088239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:18.090336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:18.112591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2545/5107] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:18.116576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.130450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6d97-1399-48c9-9709-e6f574503a3d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.138414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.139113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.140136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.140433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.141683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:18.142007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.147060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.166314 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2563/5108] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:18.172973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.188625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f374-d930-4e47-8aa8-1a4cdb00ea24 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.201003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.201914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.202309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.202599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.203454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.209334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.276797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2546/5109] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:18 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:18.281576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.297784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c906-e51b-4516-9f15-672361be11c8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.424508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.425217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.425505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.425785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.426504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.439338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.505533 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2564/5110] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:18 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:18.516465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.542168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d560-b347-43c8-b8bd-6ea5753ca73f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.560630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.561148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.561262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.561491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.562247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.565959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.617280 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2547/5111] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:18.621650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.637298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93c4c-33c9-4138-a946-d9655e637fbc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.657948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.659936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:18.685182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.685692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.686505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.686505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.687002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.695132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.700511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2eae00-719f-4451-ab83-7f7764f58b41 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.713402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.720272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.720272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.720687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] PATH_INFO: `/v3/users/c06fd081dccd4e10bdbb3c7871be811f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.724294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06fd081dccd4e10bdbb3c7871be811f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.726232 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2565/5112] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:18.727185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:18.729123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.762905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453afdd3-4a08-47cb-9660-5e5f38888a16 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:18.776863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:18.778351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.780241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.780818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] PATH_INFO: `/v3/projects/ad10a1342ff54e47993d8a95997d1e53/users/2a44d13645e04c349c259cd24e7f4435/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.840777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad10a1342ff54e47993d8a95997d1e53, user_id=2a44d13645e04c349c259cd24e7f4435, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:18.850585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb62ecc-1934-4ea9-aa0b-9d6294a8a35e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:18.889761 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2566/5113] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:18 2022] PUT /identity/v3/projects/ad10a1342ff54e47993d8a95997d1e53/users/2a44d13645e04c349c259cd24e7f4435/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:18.895217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06fd081dccd4e10bdbb3c7871be811f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:18.896345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06fd081dccd4e10bdbb3c7871be811f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:18.900718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:18.902000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:18.902561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:18.911217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06fd081dccd4e10bdbb3c7871be811f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:18.913068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06fd081dccd4e10bdbb3c7871be811f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:18.922542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:18.954503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] MFA Rules not processed for user `2a44d13645e04c349c259cd24e7f4435`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:18.955963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-beebc12f-9cce-4597-bd07-5b52f7ef1683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06fd081dccd4e10bdbb3c7871be811f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:18.958329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:18.988084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:19.000689 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2548/5114] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:18 2022] DELETE /identity/v3/users/c06fd081dccd4e10bdbb3c7871be811f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:19.005238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.006502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.007034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.063238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:19.064885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:19.130665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2567/5115] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:19.135169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.137385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:19.241374 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2549/5116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:19.244783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b087d3-187c-44a6-9d33-b0b759ecf02d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:19.252432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:19.253209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.253775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.254386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.255945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:19.256492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.257944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:19.258380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:19.298025 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2568/5117] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:19 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:19.301687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.392609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143094e-9969-4b55-b6cf-5eb582e00e10 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:19.409955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6552-a92c-4c0a-a43d-c233923f8b07 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:19.415062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:19.416046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.416511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.416957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.417800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:19.420362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:19.492946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2569/5118] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:19 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:19.499807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.582416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:19.582416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.582416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.582416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.583696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779d4b0-6b36-4ac5-8904-23fbf3436d7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:19.611651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:19.614887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:19.627775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:19.628474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.628972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.629252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.629989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:19.635204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:19.647068 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2550/5119] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:19.658956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:19.687635 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2570/5120] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:19.692032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.724751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb255d-033d-4354-aa06-5968dcd34558 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:19.734617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:19.735973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:19.736442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:19.737071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] PATH_INFO: `/v3/projects/4cdd897e184c410492546fc1ef8de19b/users/28705efe58c34736b4de2c442e18fe09/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:19.796603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdd897e184c410492546fc1ef8de19b, user_id=28705efe58c34736b4de2c442e18fe09, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:19.802347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:19.853330 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2551/5121] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:19 2022] PUT /identity/v3/projects/4cdd897e184c410492546fc1ef8de19b/users/28705efe58c34736b4de2c442e18fe09/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:19.861764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:19.883942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3f32-4351-4061-8fb0-bdbc75abe877 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.024920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.026870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.028048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.028343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.029341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.030881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883dd58d-a4a9-4206-9c7b-15d4cf5528b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.045356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2571/5122] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:20.049382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.073709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2eab3-eebd-4e1f-9fc6-5f88ac1b5d13 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.083484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.084481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.084767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.085043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] PATH_INFO: `/v3/projects/4cdd897e184c410492546fc1ef8de19b/users/28705efe58c34736b4de2c442e18fe09/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.088152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdd897e184c410492546fc1ef8de19b, user_id=28705efe58c34736b4de2c442e18fe09, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.097003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.117557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2552/5123] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:20 2022] PUT /identity/v3/projects/4cdd897e184c410492546fc1ef8de19b/users/28705efe58c34736b4de2c442e18fe09/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:20.132180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.132535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.132874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.211024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] MFA Rules not processed for user `28705efe58c34736b4de2c442e18fe09`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:20.212480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:20.330091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.332149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:20.426631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:20.542587 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2572/5124] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:20.556523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.574516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f7147-9c16-4d06-808b-bd75852d1dc0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.576641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a512a3e-74ca-479a-b894-84dc07a6de55 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.585406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.586308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.586702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.586860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] PATH_INFO: `/v3/projects/f3a52f1d9032436f907a2d30636b5d3d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.589821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.590749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.591041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.591313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.592098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.593212 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:20.593212 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:08:20.593212 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:08:20.594471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a52f1d9032436f907a2d30636b5d3d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.596390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.598459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invalid input for field 'name': '' is too short Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: '' Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise error Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application '' Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.613600 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:08:20.615774 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application '' Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.621328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2573/5125] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:20 2022] POST /identity/v3/domains => generated 283 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:08:20.623034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.642674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9d7b2-ba54-43ce-8e98-b59c5bfb85a9 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.655183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.657087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.657658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.658032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.660647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.663073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise error Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.683315 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 04 21:08:20.685241 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:08:20.686828 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:20.691460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2574/5126] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:20 2022] POST /identity/v3/domains => generated 412 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:08:20.695737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.710661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a52f1d9032436f907a2d30636b5d3d', 'request_id': 'req-a057034c-d0b0-44e2-8460-b869da25171a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:20.721434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72d32-f018-467a-892a-a2fee25a9a55 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:20.723723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a52f1d9032436f907a2d30636b5d3d', 'request_id': 'req-a057034c-d0b0-44e2-8460-b869da25171a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:20.738105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a52f1d9032436f907a2d30636b5d3d', 'request_id': 'req-a057034c-d0b0-44e2-8460-b869da25171a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:20.771840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] The token cache is being invalidate because project f3a52f1d9032436f907a2d30636b5d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:20.772384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:20.774171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a057034c-d0b0-44e2-8460-b869da25171a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:20.779115 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2553/5127] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:20 2022] DELETE /identity/v3/projects/f3a52f1d9032436f907a2d30636b5d3d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:20.786377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c722c6-5f25-4c01-bb60-7483293bc417 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.786813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c722c6-5f25-4c01-bb60-7483293bc417 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.787192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c722c6-5f25-4c01-bb60-7483293bc417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.827580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-20c722c6-5f25-4c01-bb60-7483293bc417 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:20.828986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20c722c6-5f25-4c01-bb60-7483293bc417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:20.865104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:20.866000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:20.866435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:20.866870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:20.868545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:20.873068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:20.914606 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2575/5128] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:20 2022] POST /identity/v3/domains => generated 276 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:20.916947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:20.920870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:20.944682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:20.998773 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2554/5129] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:21.006824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.007255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.007791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.056190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:21.060348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:21.104334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3308-6b2d-4a52-9de1-41d5383b446a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.113794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.115719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.117603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.118020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.140326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bbe1d7f296f84b0cafe17e6db7fef5a3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.144705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.173727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jun 04 21:08:21.187453 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 04 21:08:21.188845 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:21.191997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2555/5130] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:21.193278 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2576/5131] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:08:20 2022] DELETE /identity/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3 => generated 120 bytes in 277 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:08:21.198078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.199413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.217940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6497-27af-45ed-994b-b85549874256 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.221633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dc718-2a25-4a83-b30e-4174578e0443 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.231080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.231080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.231080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.231080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.233118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.233800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:21.235247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.235697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.237811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.238493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.239544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.240288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bbe1d7f296f84b0cafe17e6db7fef5a3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.243243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.271755 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2556/5132] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:21.273588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.289502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0547b3-99e3-4e37-ab5e-46b08d2e2697 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.295957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.297757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.299524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.300255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.300544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.300824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.303474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.305553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.351182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.352557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.358592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2577/5133] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:08:21 2022] PATCH /identity/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3 => generated 277 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:21.363601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.368100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:21.375622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2557/5134] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:21 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:21.380709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.388870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:21.548847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12c17-3deb-4e9b-8841-74e230caf81a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.556228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f522a-2c1f-49da-9630-c03144150b54 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.561039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.561754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.562044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.562333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.563035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.565637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.616355 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2558/5135] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:21 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:21.627361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.655800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ab741-a13b-45b8-85ca-8814de2a95d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.669111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.671042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.671725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.673551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.675727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.680746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.690488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:21.720642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.722011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.722543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.724100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.725095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2559/5136] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:21.728694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.751924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bbe1d7f296f84b0cafe17e6db7fef5a3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.754319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.754533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f191ac-5330-48fa-954a-aeb761ca2222 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.773786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:21.774485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:21.774887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:21.775204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:21.776155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:21.778015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:21.799395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.807351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.864234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2560/5137] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:21.868522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:21.912262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097d79-c080-441b-96db-e07255ac3d0c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:21.927458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.938592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.947405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.976135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] The token cache is being invalidate because project bbe1d7f296f84b0cafe17e6db7fef5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:21.976804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.978960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:21.999714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:22.000371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:22.010108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbe1d7f296f84b0cafe17e6db7fef5a3', 'request_id': 'req-120d75c7-b4fe-4556-b183-3f99f98ad6a1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:22.023077 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2578/5138] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:08:21 2022] DELETE /identity/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:22.040138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:22.044383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:22.093530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.094467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.094748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.095025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] PATH_INFO: `/v3/projects/b8abf73775cf4d25aec54d7e27a6cc52/users/60df515b9c4c490994284bf20ccb0b31/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.137342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8abf73775cf4d25aec54d7e27a6cc52, user_id=60df515b9c4c490994284bf20ccb0b31, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:22.142481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f4b45-0fca-4251-8da3-be84409150b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:22.176230 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2561/5139] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:21 2022] PUT /identity/v3/projects/b8abf73775cf4d25aec54d7e27a6cc52/users/60df515b9c4c490994284bf20ccb0b31/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:22.189427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.189723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.190011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.204456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d75c7-b4fe-4556-b183-3f99f98ad6a1 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:22.227521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:22.264340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] MFA Rules not processed for user `60df515b9c4c490994284bf20ccb0b31`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:22.265590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:22.308309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:22.370377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.371544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.371846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.372118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/8d751ac81e59437bbe1bee547fdaa15a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.401087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Could not find domain: 8d751ac81e59437bbe1bee547fdaa15a.: keystone.exception.DomainNotFound: Could not find domain: 8d751ac81e59437bbe1bee547fdaa15a. Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8d751ac81e59437bbe1bee547fdaa15a. Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:22.420927 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:22.422338 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:08:22.423543 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8d751ac81e59437bbe1bee547fdaa15a. Jun 04 21:08:22.424866 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.424866 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2579/5140] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:08:22 2022] DELETE /identity/v3/domains/8d751ac81e59437bbe1bee547fdaa15a => generated 112 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:08:22.429933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:22.459427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448971c-67bd-4f5b-b6bc-695c66efc318 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:22.468216 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2562/5141] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:22.469607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.470301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.470588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.470984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.471772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:22.473582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:22.484418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:22.485886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:22.507835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2580/5142] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:22 2022] POST /identity/v3/domains => generated 253 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:22.517069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:22.635018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7e18-7d1c-42ab-9bbf-869d78a145ca None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:22.650446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c04e7-cd2d-4270-b39a-b5bde3fe06df tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:22.664707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.665455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.665746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.666022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.668034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:22.686124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:22.711839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.sql.core [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1163457911' for key 'project.ixu_project_name_domain_id'") Jun 04 21:08:22.711839 ncdv-master-1 devstack@keystone.service[97803]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 21:08:22.711839 ncdv-master-1 devstack@keystone.service[97803]: [parameters: {'id': '2a06c02ada5a42da9839774a29992f7c', 'name': 'tempest-domain-dup-1163457911', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 04 21:08:22.711839 ncdv-master-1 devstack@keystone.service[97803]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97803) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1163457911.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1163457911. Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:08:22.762891 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1163457911' for key 'project.ixu_project_name_domain_id'") Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 21:08:22.765442 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application yield resource Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise self.value Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application session.commit() Jun 04 21:08:22.771884 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.session.flush() Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application compat.raise_( Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 21:08:22.776599 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 21:08:22.784364 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application conn.query(q) Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result.read() Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:08:22.788946 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1163457911' for key 'project.ixu_project_name_domain_id'") Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [parameters: {'id': '2a06c02ada5a42da9839774a29992f7c', 'name': 'tempest-domain-dup-1163457911', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.797328 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1163457911. Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:22.804192 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1163457911. Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:22.815169 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2581/5143] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:22 2022] POST /identity/v3/domains => generated 212 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:08:22.820099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:22.820099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a02b-087a-438a-a8e6-6544b21da778 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:22.827766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.838167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.839217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.840263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/059f847010824647abb327c4e59dabe8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.879553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=059f847010824647abb327c4e59dabe8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:22.888697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:22.889947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:22.890414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:22.890881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:22.894117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:22.972175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:22.974627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:22.998712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:23.037156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:23.039778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:23.052351 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2563/5144] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:23.078309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.082525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.095970 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2582/5145] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:08:22 2022] PATCH /identity/v3/domains/059f847010824647abb327c4e59dabe8 => generated 254 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:23.099282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:23.133586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acfc6e-0140-414c-aa12-b3ca242198fc service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:23.265339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:23.266230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:23.266660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:23.266992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/059f847010824647abb327c4e59dabe8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:23.283583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=059f847010824647abb327c4e59dabe8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:23.285253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:23.320224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.324868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '059f847010824647abb327c4e59dabe8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.460851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.491486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.509550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.538919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] The token cache is being invalidate because project 059f847010824647abb327c4e59dabe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:23.539265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.542674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.565838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.566639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.567242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '059f847010824647abb327c4e59dabe8', 'request_id': 'req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:23.613914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2564/5146] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:08:23 2022] DELETE /identity/v3/domains/059f847010824647abb327c4e59dabe8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:23.618488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:23.621712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:23.660708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019cd3-f290-4d93-9ff2-6f30b5ae448a tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:23.800576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28705efe58c34736b4de2c442e18fe09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdd897e184c410492546fc1ef8de19b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:23.801609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:23.802005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:23.802390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] PATH_INFO: `/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:23.826498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-eec27989-1917-4eb0-9299-e5dd7ed8ea86 tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Could not find domain: bbe1d7f296f84b0cafe17e6db7fef5a3.: keystone.exception.DomainNotFound: Could not find domain: bbe1d7f296f84b0cafe17e6db7fef5a3. Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bbe1d7f296f84b0cafe17e6db7fef5a3. Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:23.838284 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:23.839562 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:08:23.840824 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bbe1d7f296f84b0cafe17e6db7fef5a3. Jun 04 21:08:23.842308 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:23.842308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2583/5147] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:08:23 2022] PATCH /identity/v3/domains/bbe1d7f296f84b0cafe17e6db7fef5a3 => generated 112 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:08:23.845284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:23.846802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:23.881214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:24.016365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3a07-cb1a-4eae-8515-0fe1f274700e tempest-DomainsNegativeTestJSON-1241339331 tempest-DomainsNegativeTestJSON-1241339331-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:24.023140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:24.024082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:24.024362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:24.024639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] PATH_INFO: `/v3/users/2a44d13645e04c349c259cd24e7f4435` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:24.026106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a44d13645e04c349c259cd24e7f4435)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:24.028665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:24.139916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a44d13645e04c349c259cd24e7f4435'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:24.140544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a44d13645e04c349c259cd24e7f4435'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:24.153037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a44d13645e04c349c259cd24e7f4435'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:24.153859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a44d13645e04c349c259cd24e7f4435'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:24.186692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a44d13645e04c349c259cd24e7f4435'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:24.228841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2565/5148] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:23 2022] DELETE /identity/v3/users/2a44d13645e04c349c259cd24e7f4435 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:24.234356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d909-f566-469d-944f-89e7d1704625 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:24.235213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d909-f566-469d-944f-89e7d1704625 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:24.235213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d909-f566-469d-944f-89e7d1704625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:24.268553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a257d909-f566-469d-944f-89e7d1704625 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:24.269807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a257d909-f566-469d-944f-89e7d1704625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:24.282415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:24.397360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2584/5149] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:24.458131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:24.459862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:24.697295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a537-d216-4748-9670-073f4102f13e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:24.705137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:24.705845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:24.706122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:24.706405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:24.730675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:24.735855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:24.769176 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2566/5150] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:25.820067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:25.820067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:25.820067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:25.857170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] MFA Rules not processed for user `33de20254305474aa55173591da1b6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:25.859204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:25.986457 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2585/5151] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:25.991934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:25.993230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:26.018386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1b09-702f-4c6d-92ee-2c79cc1a65e9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.034073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.034791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.035371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.035685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.036411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.038345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.104864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2567/5152] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:25 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:26.109824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.128337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09efcd-b8b6-4e6f-a7a8-3d0e4da7b3b3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.218745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.219447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.219775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.220829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.221539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.223785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.286882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.302447 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2586/5153] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:26 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:26.309403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61198f20-acb2-4abc-aeb0-4e9b05b84c52 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.317953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.319494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.319832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.320476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.320862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.322578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.329941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:26.340473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.352952 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2568/5154] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:26.354057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82842-27a7-403e-9be4-b58dc1818011 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.380774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.381431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.381716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.382051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] PATH_INFO: `/v3/projects/f946b83664fc4ed69db4933de434038e/users/9dbb2fba11204ab79617fd081e285476/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.406965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f946b83664fc4ed69db4933de434038e, user_id=9dbb2fba11204ab79617fd081e285476, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.410436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.436400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2587/5155] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:26 2022] PUT /identity/v3/projects/f946b83664fc4ed69db4933de434038e/users/9dbb2fba11204ab79617fd081e285476/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:26.436966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.455651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe137-adc6-45ad-a7a3-80b5b0f488dc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.625546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.626382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.626738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.627176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.628275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.629990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.645353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2569/5156] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:26.650001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.666850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c9dbf-ab6d-49fd-a782-853be8d551c9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:26.683360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:26.684812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:26.687707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:26.688095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] PATH_INFO: `/v3/projects/f946b83664fc4ed69db4933de434038e/users/9dbb2fba11204ab79617fd081e285476/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:26.693134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f946b83664fc4ed69db4933de434038e, user_id=9dbb2fba11204ab79617fd081e285476, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:26.697621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:26.709762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:26.729716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2588/5157] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:26 2022] PUT /identity/v3/projects/f946b83664fc4ed69db4933de434038e/users/9dbb2fba11204ab79617fd081e285476/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:26.844967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:26.847652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:26.908213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d0116-6aa2-4238-8eec-0ee871735863 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:27.209439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:27.211033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:27.211485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:27.211956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] PATH_INFO: `/v3/projects/ad10a1342ff54e47993d8a95997d1e53` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:27.213387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad10a1342ff54e47993d8a95997d1e53)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:27.219243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:27.400525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad10a1342ff54e47993d8a95997d1e53', 'request_id': 'req-d31b51db-f57d-4240-8d96-ed925ab54aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.409599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad10a1342ff54e47993d8a95997d1e53', 'request_id': 'req-d31b51db-f57d-4240-8d96-ed925ab54aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.419392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad10a1342ff54e47993d8a95997d1e53', 'request_id': 'req-d31b51db-f57d-4240-8d96-ed925ab54aa3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.455339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] The token cache is being invalidate because project ad10a1342ff54e47993d8a95997d1e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:27.456194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.457141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.459819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2570/5158] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:26 2022] DELETE /identity/v3/projects/ad10a1342ff54e47993d8a95997d1e53 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:27.465275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:27.468346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:27.488179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ee218-98c9-4d91-8083-24242b868a73 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:27.730108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:27.731118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:27.731396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:27.731700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] PATH_INFO: `/v3/users/28705efe58c34736b4de2c442e18fe09` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:27.737411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28705efe58c34736b4de2c442e18fe09)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:27.742991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:27.905388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28705efe58c34736b4de2c442e18fe09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.928240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28705efe58c34736b4de2c442e18fe09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.931556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28705efe58c34736b4de2c442e18fe09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:27.932648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28705efe58c34736b4de2c442e18fe09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:28.000391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c8e272d5-d804-4cd9-9a1e-7729e822e566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28705efe58c34736b4de2c442e18fe09'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:28.033023 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2589/5159] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:27 2022] DELETE /identity/v3/users/28705efe58c34736b4de2c442e18fe09 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:29.352641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:29.383293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b51db-f57d-4240-8d96-ed925ab54aa3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:29.445900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:29.496142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:29.498753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:29.499708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:29.500224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] PATH_INFO: `/v3/projects/4cdd897e184c410492546fc1ef8de19b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:29.501909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdd897e184c410492546fc1ef8de19b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:29.504395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:29.626214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdd897e184c410492546fc1ef8de19b', 'request_id': 'req-25b8ada9-4f55-4a30-b69d-d2a54e791b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:29.650310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdd897e184c410492546fc1ef8de19b', 'request_id': 'req-25b8ada9-4f55-4a30-b69d-d2a54e791b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:29.687931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdd897e184c410492546fc1ef8de19b', 'request_id': 'req-25b8ada9-4f55-4a30-b69d-d2a54e791b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:29.714107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] The token cache is being invalidate because project 4cdd897e184c410492546fc1ef8de19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:29.714398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:29.715813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:29.722570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2571/5160] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:29 2022] DELETE /identity/v3/projects/4cdd897e184c410492546fc1ef8de19b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:29.727735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ebe1-7d22-4127-a0fa-6e6645a96489 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:29.728662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ebe1-7d22-4127-a0fa-6e6645a96489 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:29.729344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ebe1-7d22-4127-a0fa-6e6645a96489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:29.760179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2bb4ebe1-7d22-4127-a0fa-6e6645a96489 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:29.762092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2bb4ebe1-7d22-4127-a0fa-6e6645a96489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:29.861418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:29.863071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:29.964594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2590/5161] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:29.973902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:29.974343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:29.974629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.017163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:30.018430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:30.052112 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2591/5162] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:30.060494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.077955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8354c-fa63-469d-9098-0a905ebdd18d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.095075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.095978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.096266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.096642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.097681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:30.097681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.099264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.102403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:30.119776 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2592/5163] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:30.120927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ada9-4f55-4a30-b69d-d2a54e791b58 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.128235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.140482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78487be6-b3b3-4c3b-99c7-dfafcf455a77 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.146133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.147104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.147755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.148051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.148477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.148766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.150725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.151746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.153509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.154683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.167694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:30.193763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2593/5164] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:30 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:30.195046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.230133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.234562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.299589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66dbd-2bf3-45a1-9ed3-375d307cbfed admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.305452 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2572/5165] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:30.306758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.307622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.308058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.308452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.309485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.311662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.352465 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2594/5166] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:30 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:30.357033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.370593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efe763-ac7f-494e-a3de-fa3b0a42a7b6 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.381661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.383566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.383857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.384152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.384895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.386823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.401587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2573/5167] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:30.404916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.420956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49a59d-fb9a-4841-9e94-60c140ccebd5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.427406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.428310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.428713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.429127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.430099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.431927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb52b9-c03f-4dcd-9ea0-28541f4d19ae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.456216 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2595/5168] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:30.460327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.477573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885e6b3-291f-4aca-be01-65695ab2b3d3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.497900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.499041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.499550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.500008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] PATH_INFO: `/v3/projects/86e1a2f16f5f4646a92240d4a6c653c3/users/28808e636f0a47c995c5187fa7d73ce0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.570209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e1a2f16f5f4646a92240d4a6c653c3, user_id=28808e636f0a47c995c5187fa7d73ce0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.577366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.612219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2574/5169] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:30 2022] PUT /identity/v3/projects/86e1a2f16f5f4646a92240d4a6c653c3/users/28808e636f0a47c995c5187fa7d73ce0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:30.614647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.614943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.615226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.721558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] MFA Rules not processed for user `28808e636f0a47c995c5187fa7d73ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:30.722929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:30.772499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.772499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:30.784074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:30.852662 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2596/5170] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:30.854004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:30.949428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3e194-82ea-4884-868d-12cd823378e1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:30.973192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:30.978871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:30.979207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:30.979628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] PATH_INFO: `/v3/users/60df515b9c4c490994284bf20ccb0b31` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:30.982821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60df515b9c4c490994284bf20ccb0b31)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:30.984910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:30.999014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:31.042494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250c6b7-a23c-4645-afdd-aac38e462936 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:31.060888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:31.061743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.062311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.065469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.067360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:31.071809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:31.094630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60df515b9c4c490994284bf20ccb0b31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:31.095337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60df515b9c4c490994284bf20ccb0b31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:31.109508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60df515b9c4c490994284bf20ccb0b31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:31.110330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60df515b9c4c490994284bf20ccb0b31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:31.133699 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2597/5171] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:30 2022] POST /identity/v3/projects => generated 367 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:31.135030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:31.138408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:31.149645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-68535be6-a99f-4700-8349-ddf098f6cc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60df515b9c4c490994284bf20ccb0b31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:31.185354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2575/5172] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:30 2022] DELETE /identity/v3/users/60df515b9c4c490994284bf20ccb0b31 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:31.192474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.192986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.197630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.232569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:31.234145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:31.274361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211fdca-409e-4e69-801e-ebb9596d1f3f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:31.371208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2576/5173] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:31.385274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:31.387563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:31.448093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:31.448810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.449083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.449517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.450287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:31.454667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:31.462943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:31.497212 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2598/5174] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:31 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:31.501333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:31.515758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7189559-af18-4522-8672-896e7d20e3ba None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:31.520360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:31.522717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.523258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.523736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.545100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:31.546808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:31.556101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259fd56-66ec-4dae-a0f0-b76f7d3ae23a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:31.580339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:31.582717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.583953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.584415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.595089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:31.596924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:31.610122 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2577/5175] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:31.661478 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2599/5176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:31.664786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:31.689388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec50353-c2b0-4218-b2c7-607f88732f6a service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:31.722183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:31.723112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:31.723403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:31.723700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] PATH_INFO: `/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c/users/4977dbef7f1a4281a492ac6202744f76/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:31.784597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93ef6e5a157425281932d1b7ca4ac2c, user_id=4977dbef7f1a4281a492ac6202744f76, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:31.787883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:31.826525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:31.827012 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2578/5177] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:31 2022] PUT /identity/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c/users/4977dbef7f1a4281a492ac6202744f76/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:31.840647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8add94-20a1-4419-826a-d03406429b52 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:32.002353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:32.055711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:32.057714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.058916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.059488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:32.063263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:32.069061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55d18e-08b3-465b-90dd-7fd5a7d43a71 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:32.108450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2600/5178] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:32.110511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:32.141864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7629354-820d-47bd-ab0f-7d62a1514523 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:32.158141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:32.161521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.162264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.162780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] PATH_INFO: `/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c/users/4977dbef7f1a4281a492ac6202744f76/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:32.170925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93ef6e5a157425281932d1b7ca4ac2c, user_id=4977dbef7f1a4281a492ac6202744f76, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:32.178148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:32.268891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2579/5179] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:32 2022] PUT /identity/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c/users/4977dbef7f1a4281a492ac6202744f76/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:32.282534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.282534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.282811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:32.346345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] MFA Rules not processed for user `4977dbef7f1a4281a492ac6202744f76`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:32.348507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:32.545671 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2601/5180] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:32.550702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:32.582507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dddad-4257-4f77-a283-b570fe36e750 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:32.610765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:32.611609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.611902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.612304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:32.615667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:32.620438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:32.721864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:32.730341 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2580/5181] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:08:32 2022] POST /identity/v3/domains => generated 276 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:32.738560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b826fa-5257-4cb9-ab80-3a4506fa6651 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:32.898301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:32.899111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.899479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.899854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:32.900794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:32.901761 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:32.901761 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:08:32.901761 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:08:32.903296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:32.958545 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2602/5182] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:32 2022] POST /identity/v3/groups => generated 279 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:32.963010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:32.976092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67df5e-49cb-40ce-81ab-c0f0f57bc4e9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:32.986332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:32.987684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:32.988140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:32.988713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/0302ed4a79b74b039a140534cbe7e57a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.031720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:update_group(group_id=0302ed4a79b74b039a140534cbe7e57a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.034913 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:33.034913 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:08:33.034913 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:08:33.039479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.082344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2581/5183] 10.222.0.18 () {60 vars in 1246 bytes} [Sat Jun 4 21:08:32 2022] PATCH /identity/v3/groups/0302ed4a79b74b039a140534cbe7e57a => generated 292 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:33.087332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.098472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0f30-cf63-479c-ada1-084348340998 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.119537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.120604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.120990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.121409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/0302ed4a79b74b039a140534cbe7e57a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.130454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:get_group(group_id=0302ed4a79b74b039a140534cbe7e57a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.131628 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:33.131628 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:08:33.131628 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:08:33.142819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.145220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2603/5184] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:33 2022] GET /identity/v3/groups/0302ed4a79b74b039a140534cbe7e57a => generated 292 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:33.151199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.168276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73137a58-dadc-4b78-a4bc-a95798a3d4b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.180875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.182493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.183000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.183648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/0302ed4a79b74b039a140534cbe7e57a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.185668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:update_group(group_id=0302ed4a79b74b039a140534cbe7e57a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.188589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.225591 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2582/5185] 10.222.0.18 () {60 vars in 1245 bytes} [Sat Jun 4 21:08:33 2022] PATCH /identity/v3/groups/0302ed4a79b74b039a140534cbe7e57a => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:33.229818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.241294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6ceaa-6b59-4bb9-9b5c-038489abb063 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.258987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.260322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.260742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.261019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/0302ed4a79b74b039a140534cbe7e57a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.274960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0302ed4a79b74b039a140534cbe7e57a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.276202 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:33.276202 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:08:33.276202 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:08:33.278339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.302559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.304878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:33.426142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:33.442550 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2604/5186] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:33 2022] DELETE /identity/v3/groups/0302ed4a79b74b039a140534cbe7e57a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:33.448843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.477069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8cb28-3428-4f5e-85c4-9c18c6cace23 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.576839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:33.625351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.630059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.630354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.630634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] PATH_INFO: `/v3/projects/b8abf73775cf4d25aec54d7e27a6cc52` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.640840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8abf73775cf4d25aec54d7e27a6cc52)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.642659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacea2c-0e9e-42fa-92c8-7e5d2d927e87 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.649095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.660768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.661379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.661715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.662485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.663440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.667751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.702520 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2605/5187] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:33 2022] POST /identity/v3/groups => generated 326 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:33.703772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.730591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2ada-2abb-4f82-81c0-26d79c7504d1 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.743973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:33.744678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.744965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.745245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.745947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:33.758810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:33.802954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8abf73775cf4d25aec54d7e27a6cc52', 'request_id': 'req-384caed3-6634-48da-a3ca-fea79ad63ca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:33.820845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8abf73775cf4d25aec54d7e27a6cc52', 'request_id': 'req-384caed3-6634-48da-a3ca-fea79ad63ca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:33.821072 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2606/5188] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:33 2022] POST /identity/v3/users => generated 323 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:33.822218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:33.833204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8abf73775cf4d25aec54d7e27a6cc52', 'request_id': 'req-384caed3-6634-48da-a3ca-fea79ad63ca7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:33.848328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf907e-b2e4-4eba-9384-a4052c622b4e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:33.870161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] The token cache is being invalidate because project b8abf73775cf4d25aec54d7e27a6cc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:33.871149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:33.877274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-384caed3-6634-48da-a3ca-fea79ad63ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:33.881478 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2583/5189] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:33 2022] DELETE /identity/v3/projects/b8abf73775cf4d25aec54d7e27a6cc52 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:33.887396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72182-cb3a-4b0a-a10d-52d359c9c586 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:33.888144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72182-cb3a-4b0a-a10d-52d359c9c586 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:33.888744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72182-cb3a-4b0a-a10d-52d359c9c586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:33.928777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-88c72182-cb3a-4b0a-a10d-52d359c9c586 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:33.930722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-88c72182-cb3a-4b0a-a10d-52d359c9c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:34.037415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:34.040000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.040289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.040578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.119107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=6a5a1f2e1a984602bd457a7d9a09bf11)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:34.120465 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:34.120465 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:08:34.120465 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:08:34.124176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:34.163996 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2584/5190] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:34.173901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.174197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.174480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.232737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2607/5191] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:08:33 2022] PUT /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:34.236878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.239058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:34.239412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:34.246200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:34.305315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:34.332767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe61a6-1ef1-4d86-a2eb-645a15d0c5c3 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:34.339407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:34.340328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.340732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.341711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.342549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:34.344855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:34.398919 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2608/5192] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:34 2022] POST /identity/v3/users => generated 323 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:34.399302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2585/5193] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:34.405155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.408028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.434688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d5676-0f6c-4a41-a695-3211ed0ca104 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:34.442148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559eb3-efda-4fa1-a72c-397de9b46ea9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:34.449979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:34.453571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.455612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.456325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:34.456793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.457587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.459450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.460111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.462282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:34.463904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:34.467175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:34.500957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=3d6aa5ad115f4b14a012147ab6ba18c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:34.523556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:34.537024 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2609/5194] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:34.540761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.560422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:34.587187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c65b-9127-42f4-b0ee-a22c7679c0b0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:34.607301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:34.633466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:34.633782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:34.634126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:34.634876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:34.637117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:34.656741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2586/5195] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:08:34 2022] PUT /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:34.663770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.845728 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2610/5196] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:34 2022] POST /identity/v3/projects => generated 369 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:34.846659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:34.999616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cb423-99db-479b-952e-86909c1d5f45 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.012568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.013191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.013481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.013763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.014471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.016495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.058956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf545b-4b4b-451e-b98a-9e4d5187d0f4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.100205 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2611/5197] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:34 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:35.110714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.169996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639edee-8d08-4b91-960c-1530457fc563 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.200477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.201223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.201511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.201792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.203326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.211996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.239221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2612/5198] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:35.242855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.272155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382b165-b5da-48e0-a585-c8d94f6105c8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.275098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.278868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.279222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.279443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.280414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.287818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.288765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.289459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.289786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.290016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.290755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.292411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.315332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2613/5199] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:35.324670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.348831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6319e-a2e4-4dcc-b055-b03f796ceae7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.355044 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2587/5200] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:34 2022] POST /identity/v3/users => generated 323 bytes in 694 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:35.357440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.370185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.378268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.378628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.378860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] PATH_INFO: `/v3/projects/54eb2118aa004109a50cb96a5d205f29/users/ebb53be562db4c37a420901df43b25c3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.381502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8630-c9cc-4747-bc21-22ca5963672e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.396518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.397451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.397735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.398011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.411734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54eb2118aa004109a50cb96a5d205f29, user_id=ebb53be562db4c37a420901df43b25c3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.414469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cfa2-764e-4276-a694-3ff9c73be2a4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.437475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=28ccf3a7a1ef44e69d3c274bb8443041)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.439789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.469788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2614/5201] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:35 2022] PUT /identity/v3/projects/54eb2118aa004109a50cb96a5d205f29/users/ebb53be562db4c37a420901df43b25c3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:35.475082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.475409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.475725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.509602 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2588/5202] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:08:35 2022] PUT /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:35.513565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.560822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] MFA Rules not processed for user `ebb53be562db4c37a420901df43b25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:35.562461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:35.623021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:35.642862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af24327-0013-4282-993a-cddd9aaabc81 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.657157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.660699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.661363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:35.662314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.663708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.669253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=af3a5e8ec39d4c999819ff49c815b329)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.671151 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:35.671151 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:08:35.671151 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:08:35.675121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.722296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2589/5203] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:08:35 2022] GET /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users => generated 1085 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:35.727373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.750070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9069b-d019-444b-9d5d-bd1df09ca381 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.754516 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2615/5204] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:35.760069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.767945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.769015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.769665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.770257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.778231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=6a5a1f2e1a984602bd457a7d9a09bf11)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.779412 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:35.779412 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:08:35.779412 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:08:35.781868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.818735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2590/5205] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Jun 4 21:08:35 2022] HEAD /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:35.830947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:35.855466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bdf89-323c-4b0a-b135-2d7adfddc886 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.869814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:35.871157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:35.872287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:35.873352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:35.878243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=6a5a1f2e1a984602bd457a7d9a09bf11)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:35.884885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:35.923179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:35.942104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a28cee-d829-4ca0-8d40-b7672b805851 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:35.953279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2591/5206] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:08:35 2022] DELETE /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/6a5a1f2e1a984602bd457a7d9a09bf11 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:35.958012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.217946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.218628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.218930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.227831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.228818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.234033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.246671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6289-afe8-4194-a7f1-74ee10db6ee4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.273871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.279393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.280528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.282704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.285974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=3d6aa5ad115f4b14a012147ab6ba18c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.295641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.328301 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2616/5207] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:35 2022] POST /identity/v3/projects => generated 369 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:36.329221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.343562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2592/5208] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Jun 4 21:08:35 2022] HEAD /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:36.348525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.383316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655c945-93a2-4ead-b553-14db869cbe7e tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.520887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f1d34-3565-47d6-a155-457f1d7744d7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.537760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.542336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.542624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.542955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.546785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.553920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.574662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.576010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.576472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.577758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.582567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:36.590113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=3d6aa5ad115f4b14a012147ab6ba18c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.593250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.607127 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2617/5209] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:36 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:36.611785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.630728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:36.634120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea60b-3e3c-47ec-bbee-4d0e266430f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.642271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.643377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.646840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.653338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.654446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.670843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2593/5210] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:08:36 2022] DELETE /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/3d6aa5ad115f4b14a012147ab6ba18c8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:36.671800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.674682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.700383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2618/5211] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:36.705576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.738526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed93d-6dc1-48a7-9501-bac858dab126 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.760064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:36.828568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fb889-637d-4da4-97b7-2d2816b529f6 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.839332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.840952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.841500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.842011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.845816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=28ccf3a7a1ef44e69d3c274bb8443041)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.848244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.874629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2594/5212] 10.222.0.18 () {58 vars in 1341 bytes} [Sat Jun 4 21:08:36 2022] HEAD /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:36.878552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.879129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.884495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.886744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.887047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] PATH_INFO: `/v3/projects/f33267cc07324771932dd378f448bfd6/users/98113231592749f3a253039c98ee48c3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.912408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8f97f-9e72-4c97-9bb8-074f977fe862 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:36.924333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:36.926421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:36.926723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:36.927009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:36.937300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=af3a5e8ec39d4c999819ff49c815b329, user_id=28ccf3a7a1ef44e69d3c274bb8443041)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.937866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33267cc07324771932dd378f448bfd6, user_id=98113231592749f3a253039c98ee48c3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:36.940757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.941388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:36.970144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:36.974324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2619/5213] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:36 2022] PUT /identity/v3/projects/f33267cc07324771932dd378f448bfd6/users/98113231592749f3a253039c98ee48c3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:36.978082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:36.996619 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2595/5214] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:08:36 2022] DELETE /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users/28ccf3a7a1ef44e69d3c274bb8443041 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:37.000519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:37.164470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb628f3-4bf4-46c2-bd11-d2e9dfa61ee3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.206348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89dd2ec-2b5f-4919-b162-d171977ec4b4 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.221747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.222635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.222976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.223278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.230753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=af3a5e8ec39d4c999819ff49c815b329)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.234165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:37.268368 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2596/5215] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:08:36 2022] GET /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329/users => generated 145 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:08:37.272992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:37.335676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc693-0d56-4391-a322-ac5ce916f52d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.370231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.372281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.372629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.374956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users/28ccf3a7a1ef44e69d3c274bb8443041` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.382479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=28ccf3a7a1ef44e69d3c274bb8443041)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.387786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:37.390831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.396093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.399657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.405543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.409933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.416689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:37.480820 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2620/5216] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:37.481942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:37.532307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86f16-dcb0-4314-ac4f-288d0caa7c50 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.542303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:37.548959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:37.556543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.559484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.559484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.559937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] PATH_INFO: `/v3/projects/f33267cc07324771932dd378f448bfd6/users/98113231592749f3a253039c98ee48c3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.569328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33267cc07324771932dd378f448bfd6, user_id=98113231592749f3a253039c98ee48c3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.584463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:37.585790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:37.586979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028fae9-6a94-4e92-8c5a-37a37c17eba0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:37.598004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:37.606923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ccf3a7a1ef44e69d3c274bb8443041'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:37.626335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2621/5217] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:37 2022] PUT /identity/v3/projects/f33267cc07324771932dd378f448bfd6/users/98113231592749f3a253039c98ee48c3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:37.642314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.642583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.646371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.676004 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2597/5218] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:37 2022] DELETE /identity/v3/users/28ccf3a7a1ef44e69d3c274bb8443041 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:37.679742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:37.682043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:37.692374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:37.711950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] MFA Rules not processed for user `98113231592749f3a253039c98ee48c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:37.713197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:37.841672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45fe5f-1ed4-48d2-8782-595472afa8b9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.856890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.857800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.858085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.858360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users/3d6aa5ad115f4b14a012147ab6ba18c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.864485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3d6aa5ad115f4b14a012147ab6ba18c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.873957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:37.909559 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2622/5219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:37.916562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:37.947432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ddecd-1f7a-40f4-9f49-22a750a14d05 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:37.964287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:37.965762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:37.965762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:37.966025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:37.974783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:37.982508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:38.011034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.013125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.031438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.032548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.071566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2623/5220] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:37 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:38.077824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:38.079867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6aa5ad115f4b14a012147ab6ba18c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.086865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:38.123064 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2598/5221] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:37 2022] DELETE /identity/v3/users/3d6aa5ad115f4b14a012147ab6ba18c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:38.125311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:38.128414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:38.241255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1f866-a4fb-4ad3-9875-ed8813bc2e41 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:38.322157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400cfc9-4f4e-4d00-b030-5e758f331fa9 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:38.349295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:38.350222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:38.350505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:38.350877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users/6a5a1f2e1a984602bd457a7d9a09bf11` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:38.352969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a5a1f2e1a984602bd457a7d9a09bf11)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:38.356121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:38.377860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:38.379162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:38.379725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:38.380404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:38.382248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:38.385892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:38.401450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:38.459683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2624/5222] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:38 2022] POST /identity/v3/users => generated 373 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:38.470703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:38.471807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:38.515404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfd67-25ff-480b-b5ae-351a1351c44e tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:38.540954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.541770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.557817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.559931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.563261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:38.569561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:38.569925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:38.570295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:38.577853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:38.578178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:38.580438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:38.596127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5a1f2e1a984602bd457a7d9a09bf11'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:38.650291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2599/5223] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:38 2022] DELETE /identity/v3/users/6a5a1f2e1a984602bd457a7d9a09bf11 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:38.657953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:38.661021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:38.718616 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2625/5224] 10.222.0.18 () {58 vars in 1156 bytes} [Sat Jun 4 21:08:38 2022] GET /identity/v3/users?domain_id=default => generated 8289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:38.722786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:38.726748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:38.776910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5fc59-36ab-4a11-bb59-c0f3fa3253eb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:38.879297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97f02-ba6a-48f5-a12e-f6a1fc7d218b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:38.894173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:38.895093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:38.895989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:38.896274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/af3a5e8ec39d4c999819ff49c815b329` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:38.899442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=af3a5e8ec39d4c999819ff49c815b329)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:38.901528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.039719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2600/5225] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:38 2022] DELETE /identity/v3/groups/af3a5e8ec39d4c999819ff49c815b329 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:39.040924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.060634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.062257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.062556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.062863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/users/4fc129dc5b9149e69883400dd2d7c4f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.087589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:update_user(user_id=4fc129dc5b9149e69883400dd2d7c4f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.098283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.156468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.177595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abb6c2-92cc-4a55-bb23-733ffd6eca78 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.179732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invalidating the token cache because user 4fc129dc5b9149e69883400dd2d7c4f7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:39.180033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.180836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6c96130b-4f48-482e-b01a-278bfd4aeaae tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.183238 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2626/5226] 10.222.0.18 () {60 vars in 1243 bytes} [Sat Jun 4 21:08:38 2022] PATCH /identity/v3/users/4fc129dc5b9149e69883400dd2d7c4f7 => generated 488 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:39.189637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.189931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.190198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.203744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.204469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.204759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.205217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.206848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.209459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.220905 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.auth.plugins.core [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] User is disabled: 4fc129dc5b9149e69883400dd2d7c4f7: AssertionError: User is disabled: 4fc129dc5b9149e69883400dd2d7c4f7 Jun 04 21:08:39.224543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:39.237647 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.application [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:08:39.243774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2627/5227] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 54 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 04 21:08:39.251882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.259840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2601/5228] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:39 2022] POST /identity/v3/groups => generated 326 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:39.262003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:39.264006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.268327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:39.309739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe85e3a-fcf3-4b08-a219-9d445c80013d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.327023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.328457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.328457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.328846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.332955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.336742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.401161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2602/5229] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:39 2022] POST /identity/v3/groups => generated 327 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:39.404645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.440315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfc86-ed83-4c26-bf97-2ec3c400e890 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.452197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.454153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.454517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445b05f-3bf5-4286-9c8b-dda6fa0372e2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.455015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.455575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.457724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.461761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.467743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.468658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.468947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.469225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/users/4fc129dc5b9149e69883400dd2d7c4f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.511677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4fc129dc5b9149e69883400dd2d7c4f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.512649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2603/5230] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:39 2022] POST /identity/v3/groups => generated 325 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:39.513641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.513858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.544639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb5b7-87b1-464d-83e8-03dda2338d51 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.557715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.558665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.558960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.559347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.560245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.561429 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:08:39.561429 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:08:39.561429 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:08:39.562809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.580433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2604/5231] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:08:39 2022] GET /identity/v3/groups => generated 1488 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:39.588337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.602516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:39.609686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f707f0b-acc3-4306-9aa5-65e26f5e9b7b tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:39.614924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.624571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:39.625518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:39.625968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:39.626165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/ca29ba5c3dbf4dd59c42cba26e241cf9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:39.635025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.635894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.637044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.641419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ca29ba5c3dbf4dd59c42cba26e241cf9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:39.647858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:39.669085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc129dc5b9149e69883400dd2d7c4f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:39.709067 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2628/5232] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:39 2022] DELETE /identity/v3/users/4fc129dc5b9149e69883400dd2d7c4f7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:39.713475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.717434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:39.845208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2605/5233] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:39 2022] DELETE /identity/v3/groups/ca29ba5c3dbf4dd59c42cba26e241cf9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:39.851535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:39.863718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:39.871224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67167e-9f37-4a4b-a5d5-3a1b978afbeb tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:40.020204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:40.021462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:40.021774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:40.022058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/projects/acdd9c9c30d04fd792fdb1f7d40373e1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:40.024488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:delete_project(project_id=acdd9c9c30d04fd792fdb1f7d40373e1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:40.030165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:40.109588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7589e-86d7-49a4-b8f8-483384edb39f tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:40.123863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:40.126287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:40.126987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:40.127670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/f807bc33b27149358b4953b18663791a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:40.147895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f807bc33b27149358b4953b18663791a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:40.149852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:40.208733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdd9c9c30d04fd792fdb1f7d40373e1', 'request_id': 'req-767b83a2-994f-4414-80d0-ed33d2dc4ae2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:40.238249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdd9c9c30d04fd792fdb1f7d40373e1', 'request_id': 'req-767b83a2-994f-4414-80d0-ed33d2dc4ae2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:40.259449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdd9c9c30d04fd792fdb1f7d40373e1', 'request_id': 'req-767b83a2-994f-4414-80d0-ed33d2dc4ae2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:40.264890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:40.290371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] The token cache is being invalidate because project acdd9c9c30d04fd792fdb1f7d40373e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:40.290674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:40.298350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:40.301034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2629/5234] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:39 2022] DELETE /identity/v3/projects/acdd9c9c30d04fd792fdb1f7d40373e1 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:40.306390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:40.308163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:40.339336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2606/5235] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:39 2022] DELETE /identity/v3/groups/f807bc33b27149358b4953b18663791a => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:40.340626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:40.342575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:40.426330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:40.505770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2ad7a-f172-435c-b067-a57895b67a20 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:40.512524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:40.514009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:40.514410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:40.515391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/4e24e8c305b943adae60d6b9e0b6f65f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:40.532633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4e24e8c305b943adae60d6b9e0b6f65f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:40.540817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:40.548641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b83a2-994f-4414-80d0-ed33d2dc4ae2 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:40.638256 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2607/5236] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:40 2022] DELETE /identity/v3/groups/4e24e8c305b943adae60d6b9e0b6f65f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:40.656117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:40.735355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98113231592749f3a253039c98ee48c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f33267cc07324771932dd378f448bfd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:40.736141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:40.736585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:40.736875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:40.737763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:40.743260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Could not find domain: 4b94e645d9cd4889808f03ba903e6f89.: keystone.exception.DomainNotFound: Could not find domain: 4b94e645d9cd4889808f03ba903e6f89. Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4b94e645d9cd4889808f03ba903e6f89. Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:40.809751 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jun 04 21:08:40.812034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:08:40.814184 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:08:40.815588 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:08:40.815588 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4b94e645d9cd4889808f03ba903e6f89. Jun 04 21:08:40.815588 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:08:40.820126 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2630/5237] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:40 2022] POST /identity/v3/users => generated 112 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:08:40.872630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:40.884755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:41.059314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28e5e-4da0-4137-ab98-7df2c32dc750 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.070293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.071828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.072120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.072400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.077336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.082078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.120368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bdcb4-3055-4873-8ea6-e5c6f5f923c9 tempest-UsersNegativeTest-621753786 tempest-UsersNegativeTest-621753786-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.147297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2608/5238] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:40 2022] POST /identity/v3/users => generated 321 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:41.149314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.172121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bb37-9a3b-4b4f-8552-bd364088030c tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.186563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.187264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.187782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.188018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.188730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.196370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.219219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:41.247913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2609/5239] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:41 2022] POST /identity/v3/groups => generated 324 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:41.252352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.256932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.260082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.261956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.262392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] PATH_INFO: `/v3/users/ebb53be562db4c37a420901df43b25c3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.266722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb53be562db4c37a420901df43b25c3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.269746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.279744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38668179-0906-4405-a25c-c2d3a2fdb8cf tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.295076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.296058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.296341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.296615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/f5a2f2d7979541c1bb597b73ed0faff1/users/5ee7eabf58644b1f9b455cfe089b296e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.354738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f5a2f2d7979541c1bb597b73ed0faff1, user_id=5ee7eabf58644b1f9b455cfe089b296e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.360404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.375896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb53be562db4c37a420901df43b25c3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:41.396148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb53be562db4c37a420901df43b25c3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:41.397364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb53be562db4c37a420901df43b25c3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:41.398090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb53be562db4c37a420901df43b25c3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:41.438223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2610/5240] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:08:41 2022] PUT /identity/v3/groups/f5a2f2d7979541c1bb597b73ed0faff1/users/5ee7eabf58644b1f9b455cfe089b296e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:41.442203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-114c85db-c1a2-4bb1-a03a-80aabb66c38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb53be562db4c37a420901df43b25c3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:41.442386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.444511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:41.475245 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2631/5241] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:40 2022] DELETE /identity/v3/users/ebb53be562db4c37a420901df43b25c3 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:41.480983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.481273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.481530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.487158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:41.530186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:41.531416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:41.608708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1ab0-c636-48ed-948a-813e94ecf398 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.691844 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2632/5242] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:41.726558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.727249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.727555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.727841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.728541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.730948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.787554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2611/5243] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:41 2022] POST /identity/v3/groups => generated 327 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:41.795599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.809394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6c6ef-b356-4fcd-bcd4-abd14e0b0bd7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:41.815729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:41.817179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:41.817530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:41.817920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/4d6c288d607d4f4db751c9c94e143452/users/5ee7eabf58644b1f9b455cfe089b296e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:41.825256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4d6c288d607d4f4db751c9c94e143452, user_id=5ee7eabf58644b1f9b455cfe089b296e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:41.829017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:41.887609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2633/5244] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:08:41 2022] PUT /identity/v3/groups/4d6c288d607d4f4db751c9c94e143452/users/5ee7eabf58644b1f9b455cfe089b296e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:41.891930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.902994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:41.912924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:41.914808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10705-cce3-4aaa-88e1-8af120bc1a14 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:42.062247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:42.113398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:42.114711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bcf2a-6801-4acc-b880-54417bc14f1d tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:42.116782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:42.117279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:42.119198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users/5ee7eabf58644b1f9b455cfe089b296e/groups` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:42.122572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=5ee7eabf58644b1f9b455cfe089b296e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:42.126671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:42.130071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:42.130876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:42.131945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:42.132359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:42.187458 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2612/5245] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:08:41 2022] GET /identity/v3/users/5ee7eabf58644b1f9b455cfe089b296e/groups => generated 837 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:42.193204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:42.224818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d364-d6d0-4868-80c2-fbdd6f3243b0 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:42.245579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:42.245579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:42.249859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:42.249859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/4d6c288d607d4f4db751c9c94e143452` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:42.255458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4d6c288d607d4f4db751c9c94e143452)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:42.265544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:42.356248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:42.364962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:42.386571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2634/5246] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:42.785443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:42.798643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2613/5247] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:42 2022] DELETE /identity/v3/groups/4d6c288d607d4f4db751c9c94e143452 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:42.802615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:42.826445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44a544-c9a6-453e-a010-d6626cce91f0 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:43.091537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:43.092489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:43.092780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:43.093066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/groups/f5a2f2d7979541c1bb597b73ed0faff1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:43.107478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f5a2f2d7979541c1bb597b73ed0faff1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:43.110652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:43.233674 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2635/5248] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:08:42 2022] DELETE /identity/v3/groups/f5a2f2d7979541c1bb597b73ed0faff1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:43.238336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:43.252512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36f7f1-ac9c-4ac8-8d19-891331efc955 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:43.441118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:43.442011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:43.442290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:43.442561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/users/5ee7eabf58644b1f9b455cfe089b296e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:43.452293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5ee7eabf58644b1f9b455cfe089b296e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:43.454244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:43.560175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee7eabf58644b1f9b455cfe089b296e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.563492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee7eabf58644b1f9b455cfe089b296e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.581288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee7eabf58644b1f9b455cfe089b296e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.582514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee7eabf58644b1f9b455cfe089b296e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.611673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-353c519b-cd83-4c11-88e3-61bc1e42ea31 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee7eabf58644b1f9b455cfe089b296e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.634697 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2614/5249] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:43 2022] DELETE /identity/v3/users/5ee7eabf58644b1f9b455cfe089b296e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:43.640288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:43.642049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:43.677558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13847e3c-5d00-4684-b95b-1fce839fd827 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:43.775152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:43.775628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:43.776569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:43.866797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:43.873095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] MFA Rules not processed for user `9dbb2fba11204ab79617fd081e285476`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:43.878924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:43.900202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:43.901620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:43.902141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:43.903132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/domains/a6194c99caf8429b9e18832a5165d22b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:43.904983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a6194c99caf8429b9e18832a5165d22b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:43.906712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:43.956470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:43.957455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.055296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2615/5250] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:44.056572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:44.060742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:44.079116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:44.085173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.090569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.094706 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2636/5251] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:08:43 2022] PATCH /identity/v3/domains/a6194c99caf8429b9e18832a5165d22b => generated 277 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:44.095763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:44.098172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:44.238177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa13565-a82e-4492-b99a-2df65021b2a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:44.263306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd4a2-ead7-434e-8f49-9b966ab28479 tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:44.275133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:44.275880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:44.276160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:44.276438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:44.280208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:44.357643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:44.358248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:44.358377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:44.358802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] PATH_INFO: `/v3/projects/54eb2118aa004109a50cb96a5d205f29` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:44.360947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54eb2118aa004109a50cb96a5d205f29)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:44.362879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:44.393386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:44.397298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:44.424832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2637/5252] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:44.427283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:44.430268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:44.466415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54eb2118aa004109a50cb96a5d205f29', 'request_id': 'req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.483744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54eb2118aa004109a50cb96a5d205f29', 'request_id': 'req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.490953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54eb2118aa004109a50cb96a5d205f29', 'request_id': 'req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.524901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] The token cache is being invalidate because project 54eb2118aa004109a50cb96a5d205f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:44.525328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.526280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.528443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2616/5253] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:44 2022] DELETE /identity/v3/projects/54eb2118aa004109a50cb96a5d205f29 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:44.534224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:44.552439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:44.609569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3a1e-94c4-4e7b-bfbe-59a326a03200 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:44.630675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:44.698406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:44.740455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4977dbef7f1a4281a492ac6202744f76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93ef6e5a157425281932d1b7ca4ac2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:44.741637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:44.742101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:44.742556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] PATH_INFO: `/v3/domains/a6194c99caf8429b9e18832a5165d22b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:44.749132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7ea97-b996-4ab4-89d1-4726f61fffb3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:44.763559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:44.764461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:44.764749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:44.765030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] PATH_INFO: `/v3/users/98113231592749f3a253039c98ee48c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:44.769325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98113231592749f3a253039c98ee48c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:44.771795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:44.784441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a6194c99caf8429b9e18832a5165d22b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:44.791816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:44.880822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.894196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98113231592749f3a253039c98ee48c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.894914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98113231592749f3a253039c98ee48c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.913194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.919437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98113231592749f3a253039c98ee48c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.920231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98113231592749f3a253039c98ee48c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.942429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98113231592749f3a253039c98ee48c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:44.974617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2617/5254] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:44 2022] DELETE /identity/v3/users/98113231592749f3a253039c98ee48c3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:45.068559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.106517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.158084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.190126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] The token cache is being invalidate because project a6194c99caf8429b9e18832a5165d22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:45.190632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.191540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.239544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.240970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.248787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a6194c99caf8429b9e18832a5165d22b', 'request_id': 'req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.278593 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2638/5255] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:08:44 2022] DELETE /identity/v3/domains/a6194c99caf8429b9e18832a5165d22b => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:45.283468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:45.285587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:45.479175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3de2c-38db-429d-a695-152892d8fa14 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:45.639747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:45.640873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:45.641154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:45.642474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] PATH_INFO: `/v3/users/28808e636f0a47c995c5187fa7d73ce0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:45.649027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28808e636f0a47c995c5187fa7d73ce0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:45.651345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:45.664370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:45.774000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:45.775611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:45.812568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29c8b5-f47d-49b5-9f6b-fa4a348c4fea tempest-GroupsV3TestJSON-259795740 tempest-GroupsV3TestJSON-259795740-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:45.816002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28808e636f0a47c995c5187fa7d73ce0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.816926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28808e636f0a47c995c5187fa7d73ce0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.831131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:45.832391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:45.832863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:45.833313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] PATH_INFO: `/v3/projects/f33267cc07324771932dd378f448bfd6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:45.834843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33267cc07324771932dd378f448bfd6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:45.837082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28808e636f0a47c995c5187fa7d73ce0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.837732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28808e636f0a47c995c5187fa7d73ce0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.846411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:45.853065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bb708cbd-fc34-4f15-8a56-dbc004ca0a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28808e636f0a47c995c5187fa7d73ce0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.881095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2618/5256] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:45 2022] DELETE /identity/v3/users/28808e636f0a47c995c5187fa7d73ce0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:45.882712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:45.882999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:45.883929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:45.922812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:45.924118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:45.980890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:45.989459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33267cc07324771932dd378f448bfd6', 'request_id': 'req-e608126b-f7df-4bd4-af3e-20bf40dca50a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:45.998477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33267cc07324771932dd378f448bfd6', 'request_id': 'req-e608126b-f7df-4bd4-af3e-20bf40dca50a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:46.023314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33267cc07324771932dd378f448bfd6', 'request_id': 'req-e608126b-f7df-4bd4-af3e-20bf40dca50a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:46.052438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] The token cache is being invalidate because project f33267cc07324771932dd378f448bfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:46.053280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:46.054518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e608126b-f7df-4bd4-af3e-20bf40dca50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:46.056460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2639/5257] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:45 2022] DELETE /identity/v3/projects/f33267cc07324771932dd378f448bfd6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:46.064971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c32d5-6551-4e29-8dff-1a490cff89eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.065608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c32d5-6551-4e29-8dff-1a490cff89eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.066109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c32d5-6551-4e29-8dff-1a490cff89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.103538 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2619/5258] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:46.113737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.115931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:46.125843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ba4c32d5-6551-4e29-8dff-1a490cff89eb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:46.130248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba4c32d5-6551-4e29-8dff-1a490cff89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:46.220536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc48bbc-042f-4733-90c2-2f9674d6d669 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.284949 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2640/5259] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:46.293293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.293729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.294057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.309260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:46.336802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.339233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.339722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.340095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.346877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:46.348191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:46.367187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.368711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.393448 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2641/5260] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:46.398788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.414496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56f2c-9b4b-488a-844d-501ccd5ae839 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.422835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.423933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.424585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.425131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.426107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:46.426841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.430591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.440015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2620/5261] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:46.466641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2642/5262] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:46.482357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.499704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2eb26e-a44c-4037-bfea-235dfb4bce56 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.512000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.512982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.514177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.514177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.514633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.517623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca786f-5bc9-454c-b635-1699c27fdf0d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.553694 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2621/5263] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:46 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:46.558075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.577074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56784a7-a384-483d-838c-805a96f081ce admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.691231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.693535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.696522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.696702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.698060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.706841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.743013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.743304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.744055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.778929 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2643/5264] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:46 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:46.784071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.799752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:46.803084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:46.807696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac609-6dc6-4fb5-9d46-1a8247ba4808 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.825621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.826910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.827197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.828624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.830023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.832606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.869754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2644/5265] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:46.870991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.886675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82056f08-44ba-4434-a9c0-0478390be2ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.893778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.894468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.894754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.895213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:46.896737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:46.898415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:46.927942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2645/5266] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:46.936742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:46.960872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66530a18-b8d0-4fdb-8b2a-1f73bd92567b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:46.976221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:46.977601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:46.978459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:46.983036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] PATH_INFO: `/v3/projects/7168d49b209d4181bca22bba8ed712ad/users/963b4ccd8a684492b1f7dea9e7e40201/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:47.004530 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2622/5267] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:47.005947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7168d49b209d4181bca22bba8ed712ad, user_id=963b4ccd8a684492b1f7dea9e7e40201, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:47.006209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:47.008253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:47.008921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f4cf2-0807-4703-9096-4a2075117cfb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:47.012626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:47.041505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2646/5268] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:46 2022] PUT /identity/v3/projects/7168d49b209d4181bca22bba8ed712ad/users/963b4ccd8a684492b1f7dea9e7e40201/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:47.053582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:47.053979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:47.054254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:47.155789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] MFA Rules not processed for user `963b4ccd8a684492b1f7dea9e7e40201`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:47.162185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1138f8-4d75-4090-a74a-5cc2a6deef75 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:47.163041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:47.289483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:47.291135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:47.291806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:47.292098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:47.315565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:47.387142 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2647/5269] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:47.390958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:47.393861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:47.453970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:47.455494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:47.476723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2623/5270] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:08:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:47.478867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:47.502160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd64f-919d-4c8c-af29-29c714118954 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:47.521011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:47.522278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:47.522748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:47.523193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] PATH_INFO: `/v3/projects/86e1a2f16f5f4646a92240d4a6c653c3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:47.526007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e1a2f16f5f4646a92240d4a6c653c3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:47.528625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:47.533378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6365ad-4909-41fe-ae8a-830122afefa6 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:47.562648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:47.563641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:47.563864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:47.564144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:47.564880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:create_application_credential(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:47.566048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:47.704807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e1a2f16f5f4646a92240d4a6c653c3', 'request_id': 'req-52191a21-46e5-4a04-a702-4da93e2ec3e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:47.719780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e1a2f16f5f4646a92240d4a6c653c3', 'request_id': 'req-52191a21-46e5-4a04-a702-4da93e2ec3e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:47.753299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e1a2f16f5f4646a92240d4a6c653c3', 'request_id': 'req-52191a21-46e5-4a04-a702-4da93e2ec3e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:47.792285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] The token cache is being invalidate because project 86e1a2f16f5f4646a92240d4a6c653c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:47.792663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:47.793558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:47.798049 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2648/5271] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:47 2022] DELETE /identity/v3/projects/86e1a2f16f5f4646a92240d4a6c653c3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:47.802693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:47.804371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:47.829375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:47.859341 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2624/5272] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:08:47 2022] POST /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials => generated 921 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:47.864828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:47.869885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:47.917199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d662-92db-42e6-8a99-e120e59a3a28 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.015249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52191a21-46e5-4a04-a702-4da93e2ec3e5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.028446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.029447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.029729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.030006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] PATH_INFO: `/v3/users/4977dbef7f1a4281a492ac6202744f76` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.036557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4977dbef7f1a4281a492ac6202744f76)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.041680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.127794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.129442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.131334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.131780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/dba972e454bb4994bc36a6518a36d944` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.135969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:delete_access_rule(user_id=963b4ccd8a684492b1f7dea9e7e40201, access_rule_id=dba972e454bb4994bc36a6518a36d944)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.139609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.173289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4977dbef7f1a4281a492ac6202744f76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:48.183986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4977dbef7f1a4281a492ac6202744f76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:48.185257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4977dbef7f1a4281a492ac6202744f76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:48.185928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4977dbef7f1a4281a492ac6202744f76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:48.220346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4977dbef7f1a4281a492ac6202744f76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:48.271008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2649/5273] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:47 2022] DELETE /identity/v3/users/4977dbef7f1a4281a492ac6202744f76 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application session.delete(ref) Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application yield resource Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:08:48.294963 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise self.value Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application session.commit() Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.flush() Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 21:08:48.296521 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application compat.raise_( Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._synchronize( Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise AssertionError( Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jun 04 21:08:48.297677 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:08:48.298909 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:08:48.302642 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2625/5274] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jun 4 21:08:47 2022] DELETE /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/dba972e454bb4994bc36a6518a36d944 => generated 89 bytes in 433 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:08:48.303328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:48.303328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:48.500527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f226-a5fe-4e9f-9542-18a202b1a7a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.506527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.507529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.507849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.508133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials/72d390b8ea9a4ba1bf269436d4366104` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.531477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:delete_application_credential(user_id=963b4ccd8a684492b1f7dea9e7e40201, application_credential_id=72d390b8ea9a4ba1bf269436d4366104)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.534228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.578579 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2650/5275] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:08:48 2022] DELETE /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials/72d390b8ea9a4ba1bf269436d4366104 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:48.582725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:48.595978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb7f2-5148-4bc0-a35d-0a085bc7f497 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.607691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.609753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.610033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.610308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.613352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:list_access_rules(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.615498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.641062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2626/5276] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:08:48 2022] GET /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules => generated 369 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:48.645025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:48.658480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ea34f-fbaf-4526-b5fa-fa6f2c51986f tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.669886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.670925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.671189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.671468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/dba972e454bb4994bc36a6518a36d944` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.676350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:delete_access_rule(user_id=963b4ccd8a684492b1f7dea9e7e40201, access_rule_id=dba972e454bb4994bc36a6518a36d944)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.677746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.696014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:48.724993 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2651/5277] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Jun 4 21:08:48 2022] DELETE /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/dba972e454bb4994bc36a6518a36d944 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:48.731353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:48.743374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5f2a2-16b9-4f36-b7a9-5ffd499e8c40 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.750036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.752305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.752932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.753555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.755327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:list_access_rules(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.757564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:48.790899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2627/5278] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:08:48 2022] GET /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules => generated 158 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:48.793929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:48.810241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc812a-104a-4c80-8ba3-aef81c73122d tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:48.823227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:48.826260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:48.826551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:48.829005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:48.829820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:create_application_credential(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:48.831776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.009322 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2652/5279] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:08:48 2022] POST /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials => generated 920 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:49.012719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:49.026140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420919ff-df55-420a-bc0a-1ccf83653175 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:49.030855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:49.032044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.032393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.032759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.034092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:list_access_rules(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:49.038018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.048267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2628/5280] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:08:49 2022] GET /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules => generated 369 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:08:49.049891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:49.061245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfa64-85e7-4807-9b78-ed71527c86a3 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:49.067551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:49.068906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.069575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.070054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.071228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:create_application_credential(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:49.073196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.259043 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2653/5281] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:08:49 2022] POST /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/application_credentials => generated 920 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:49.263396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:49.276961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ab66-5da6-43ba-99cf-2a10e75f3553 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:49.304481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963b4ccd8a684492b1f7dea9e7e40201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7168d49b209d4181bca22bba8ed712ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:49.308581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.309323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.311756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/baa9fc4a5a5a427b877273ad1e8d7a35` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.313673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorizing `identity:get_access_rule(user_id=963b4ccd8a684492b1f7dea9e7e40201, access_rule_id=baa9fc4a5a5a427b877273ad1e8d7a35)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:49.319386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.331400 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2629/5282] 10.222.0.18 () {58 vars in 1358 bytes} [Sat Jun 4 21:08:49 2022] GET /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201/access_rules/baa9fc4a5a5a427b877273ad1e8d7a35 => generated 229 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:49.336143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:49.341371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:49.463564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:49.465618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:49.474800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd5332-efe1-4a74-b613-20577d683113 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:49.479760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:49.480298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:49.481881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.482771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.482771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] PATH_INFO: `/v3/users/963b4ccd8a684492b1f7dea9e7e40201` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.484363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=963b4ccd8a684492b1f7dea9e7e40201)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:49.486799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.492912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6923-e461-4d4b-9c8d-daa5b55e9813 tempest-AccessRulesV3Test-356219544 tempest-AccessRulesV3Test-356219544-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:49.493920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=1,keystone:SELECT=92,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:49.505516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:49.508337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.508337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.509674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] PATH_INFO: `/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.512939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93ef6e5a157425281932d1b7ca4ac2c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:49.517112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:49.599724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963b4ccd8a684492b1f7dea9e7e40201'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.615999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963b4ccd8a684492b1f7dea9e7e40201'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.617407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963b4ccd8a684492b1f7dea9e7e40201'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.618312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963b4ccd8a684492b1f7dea9e7e40201'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.658280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93ef6e5a157425281932d1b7ca4ac2c', 'request_id': 'req-f5444afe-1e5b-47c9-908b-103d09aaa83c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.666651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93ef6e5a157425281932d1b7ca4ac2c', 'request_id': 'req-f5444afe-1e5b-47c9-908b-103d09aaa83c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.678016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93ef6e5a157425281932d1b7ca4ac2c', 'request_id': 'req-f5444afe-1e5b-47c9-908b-103d09aaa83c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.705576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] The token cache is being invalidate because project f93ef6e5a157425281932d1b7ca4ac2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:49.705863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.708130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9aa239f7-fcce-423b-8f13-914fb982df5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963b4ccd8a684492b1f7dea9e7e40201'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.708297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f5444afe-1e5b-47c9-908b-103d09aaa83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:49.713551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2630/5283] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:49 2022] DELETE /identity/v3/projects/f93ef6e5a157425281932d1b7ca4ac2c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:49.716627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f14eb-e896-4754-9b5a-d9c0bad838f1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.716974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f14eb-e896-4754-9b5a-d9c0bad838f1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.717291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f14eb-e896-4754-9b5a-d9c0bad838f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.785782 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2654/5284] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:49 2022] DELETE /identity/v3/users/963b4ccd8a684492b1f7dea9e7e40201 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:49.796515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:49.796515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:49.798281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:49.814541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d39f14eb-e896-4754-9b5a-d9c0bad838f1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:49.822014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d39f14eb-e896-4754-9b5a-d9c0bad838f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:49.855478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:49.857655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:50.094550 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2631/5285] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:50.101288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.101580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.101876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.104413 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2655/5286] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:50.131724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.134585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:50.229990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:50.238678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:50.261480 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2632/5287] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:50.265591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.289686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205c2b-1005-4b73-8ef3-b86080f04946 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.305584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.306605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.310067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.310525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.311686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:50.313225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.315909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:50.345934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286c7e-0690-40d6-b3b9-49ef5e34228a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.351595 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2633/5288] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:50.354315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.391997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.396831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.397276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.399609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.429533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.431597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:50.439165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815505ba-43de-4852-8482-ec0e14947546 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.456304 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2656/5289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:08:50.469543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.470806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.471337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.471946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.472978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.478734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:50.543423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2634/5290] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:50 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:50.547361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.554673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:50.568275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078825-bfda-439b-817b-f3fe3b63882e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.789135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.790197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.790582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.792228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.793487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.796844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:50.830294 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2657/5291] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:50 2022] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:50.836990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.853069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b3d0-2083-4c4d-a6e0-dd955259bb8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.883456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.890148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.893584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.895881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.900484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.909617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:50.959842 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2635/5292] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:50.962620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:50.974347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a2908-5798-4a8c-b89e-65ffae231c54 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:50.993609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:50.994525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:50.994814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:50.995095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:50.996009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:50.997655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.025605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2658/5293] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:51.027837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.042698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3b27e-fbb8-4c3f-be04-63be48b092ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.053140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.054261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.055491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.062994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] PATH_INFO: `/v3/projects/70712c79811d4190963dbb8c30e3b840/users/b2a25788a8244382aa521646ef164ae0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.093597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70712c79811d4190963dbb8c30e3b840, user_id=b2a25788a8244382aa521646ef164ae0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:51.102730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239de13-9aef-43b3-bebb-aa0f5e191b40 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.105416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.107294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.131213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4e66-9de2-4ea6-8ea1-446f76051f4c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.148309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.156751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.157376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.157737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] PATH_INFO: `/v3/projects/7168d49b209d4181bca22bba8ed712ad` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.159738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7168d49b209d4181bca22bba8ed712ad)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:51.168944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2636/5294] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:51 2022] PUT /identity/v3/projects/70712c79811d4190963dbb8c30e3b840/users/b2a25788a8244382aa521646ef164ae0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:51.169182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.171009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.171362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.171754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.230719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:51.259174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] MFA Rules not processed for user `b2a25788a8244382aa521646ef164ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:51.262911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.263834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7168d49b209d4181bca22bba8ed712ad', 'request_id': 'req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.281899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7168d49b209d4181bca22bba8ed712ad', 'request_id': 'req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.289906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7168d49b209d4181bca22bba8ed712ad', 'request_id': 'req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.311906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] The token cache is being invalidate because project 7168d49b209d4181bca22bba8ed712ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:51.312393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.313467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0607cc42-3a2e-4818-bb1c-55d7bb16b74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.320358 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2659/5295] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:51 2022] DELETE /identity/v3/projects/7168d49b209d4181bca22bba8ed712ad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:51.334303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc636a-90ba-4f02-a018-0691860d86d3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.336838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc636a-90ba-4f02-a018-0691860d86d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.337373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc636a-90ba-4f02-a018-0691860d86d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.377325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5dfc636a-90ba-4f02-a018-0691860d86d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:51.379378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5dfc636a-90ba-4f02-a018-0691860d86d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.450129 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2637/5296] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:51.451136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.462324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40c31-5c28-40de-8868-bac75bb351d5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.470494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a25788a8244382aa521646ef164ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70712c79811d4190963dbb8c30e3b840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.471186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.476117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.476325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] PATH_INFO: `/v3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.478210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2638/5297] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/v3 => generated 255 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:51.483555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.484114 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2660/5298] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:51.497828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.498222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.499288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.506296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce9f4-0fc1-41be-81b5-72d5f4ea8c65 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.524868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:51.526168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a25788a8244382aa521646ef164ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70712c79811d4190963dbb8c30e3b840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.535442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.535892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.543408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:51.543667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] PATH_INFO: `/v3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.545927 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2639/5299] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/v3 => generated 255 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:51.549499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.551007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.571130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2661/5300] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:51.577202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.591664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5674-9fee-4b70-9af0-9b899bb26a51 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.597059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5412e-1fbc-4dff-9d37-f1c8b8939c52 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a25788a8244382aa521646ef164ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70712c79811d4190963dbb8c30e3b840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.597913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5412e-1fbc-4dff-9d37-f1c8b8939c52 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.598202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5412e-1fbc-4dff-9d37-f1c8b8939c52 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.598476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5412e-1fbc-4dff-9d37-f1c8b8939c52 tempest-TestApiDiscovery-285245390 tempest-TestApiDiscovery-285245390-project] PATH_INFO: `/v3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.600111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2640/5301] 10.222.0.18 () {58 vars in 1103 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/v3 => generated 255 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:51.603601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f0e8b-c827-45e9-a5f6-87ee7c82d0b1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.606634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0b3f-d8a0-4be7-aab9-b292375267de None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.607038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0b3f-d8a0-4be7-aab9-b292375267de None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.607335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0b3f-d8a0-4be7-aab9-b292375267de None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.608966 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2641/5302] 10.222.0.18 () {56 vars in 894 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:08:51.618507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.618800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.619083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.620270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.622458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.624642 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2642/5303] 10.222.0.18 () {56 vars in 894 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:08:51.625389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.626284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.627694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.629194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:51.630367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:51.634347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.637713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.673068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581031-50a5-46b1-a074-0bfaac6dcae1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.678218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.679114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.679401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.680998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] PATH_INFO: `/v3/users/b2a25788a8244382aa521646ef164ae0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.691692 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2662/5304] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:51.694171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a25788a8244382aa521646ef164ae0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:51.696191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.698479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.742074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497e2d6-b031-460c-a1b8-37e5cc9a3e5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:51.760232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:51.767724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.769066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.770105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.775081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:51.790319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:51.807469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a25788a8244382aa521646ef164ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.808331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a25788a8244382aa521646ef164ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.832293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a25788a8244382aa521646ef164ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.833254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a25788a8244382aa521646ef164ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.880893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c55b5daf-64b1-4490-9082-542cc9e6003e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a25788a8244382aa521646ef164ae0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:51.911028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2643/5305] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:51 2022] DELETE /identity/v3/users/b2a25788a8244382aa521646ef164ae0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:51.917068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:51.917597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2663/5306] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:51.918087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:51.918569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:51.923071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:51.929654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:51.958163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:51.961090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:52.069968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd6c32-b71c-4b05-b7ad-a485e01e16a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.082374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.083127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.083555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.084956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.085764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.092627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.105047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:52.127362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2644/5307] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:52.140227 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2664/5308] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:51 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:52.145350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.158842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982bbc-a5a3-431e-9b3f-52a3b5074b31 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.167761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.168888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.169470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.169980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.171256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.173331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.193579 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2645/5309] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:52.197524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.218593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c256780-7028-4918-88be-f08cffb7660b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.231737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.232551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.232902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.233243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.234060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.242069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.244352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:52.250463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.287988 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2665/5310] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:52.290414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.303295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838305dd-f7d0-4028-903e-b60880315525 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.309719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.310871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.311317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.311834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] PATH_INFO: `/v3/projects/6e9085245ca946ad806e928accb39b27/users/ca54b3b6dd534cdbbf82a821887ad939/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.336124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9085245ca946ad806e928accb39b27, user_id=ca54b3b6dd534cdbbf82a821887ad939, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.339993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea2255-1aa6-4131-890b-df61c95a3b88 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.367823 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2666/5311] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:52 2022] PUT /identity/v3/projects/6e9085245ca946ad806e928accb39b27/users/ca54b3b6dd534cdbbf82a821887ad939/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:52.380039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.381318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2d1-387e-4a36-a1f2-aea53dac51d3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.382261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.382605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.480751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.481733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.481932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.482304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.486805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] MFA Rules not processed for user `ca54b3b6dd534cdbbf82a821887ad939`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:52.488069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:52.621253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.622908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.655567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2646/5312] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:08:52.665803 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2667/5313] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:52.668777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.681151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16c90e-1726-4947-a626-c8e6899d5e45 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.691249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.692333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.692755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.693120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.694174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.696863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.737376 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2647/5314] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:52 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:52.741533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.761756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8ee8-52d2-4481-a59b-1b76400d092f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.768000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:52.858619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.859356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.859689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.859975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.860676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.862643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.894407 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2668/5315] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:52 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:52.897796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.910627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560415-94e3-4c2d-90ae-0ddd1ad446bb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.915928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.916819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.917149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.917710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.918305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.920063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.932439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2648/5316] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:52.937506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:52.952143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692c75-52c6-48b4-8f61-b95e0f83a0b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:52.962838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:52.963405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:52.963788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:52.964118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:52.965966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:52.966729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0a0dc-b786-45eb-8c6f-521bc133c33a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:52.984836 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2669/5317] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:52.990140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:53.005953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3460-ba26-4eec-90b7-010429ca6172 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:53.015544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:53.016559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.016848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.017236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] PATH_INFO: `/v3/projects/b95e5b7422f240ab93ebca9ae2ac2979/users/60fc32e40b954301850432f35083982b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.035460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95e5b7422f240ab93ebca9ae2ac2979, user_id=60fc32e40b954301850432f35083982b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:53.038196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:53.042115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:53.067500 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2649/5318] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:52 2022] PUT /identity/v3/projects/b95e5b7422f240ab93ebca9ae2ac2979/users/60fc32e40b954301850432f35083982b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:53.079884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.080231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.080544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.122880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] MFA Rules not processed for user `60fc32e40b954301850432f35083982b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:53.124569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.253455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:53.256098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.274960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2670/5319] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:53.280226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:53.447164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986aded-dcfb-45a7-bb7d-811bfa13849e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:53.461941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeacbcb-7062-4507-a5b8-16804eec99dd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:53.463428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca54b3b6dd534cdbbf82a821887ad939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e9085245ca946ad806e928accb39b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:53.464847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.464847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.465134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] PATH_INFO: `/v3/users/ca54b3b6dd534cdbbf82a821887ad939/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.470386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] RBAC: Authorizing `identity:list_user_projects(user_id=ca54b3b6dd534cdbbf82a821887ad939)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:53.475949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69cd05-693b-4314-b1fe-e4be057270d9 tempest-IdentityV3ProjectsTest-1496905597 tempest-IdentityV3ProjectsTest-1496905597-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:53.489680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:53.491219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.491845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.492338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] PATH_INFO: `/v3/projects/70712c79811d4190963dbb8c30e3b840` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.494632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70712c79811d4190963dbb8c30e3b840)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:53.521239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:53.531455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:53.568807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2671/5320] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:08:53 2022] GET /identity/v3/users/ca54b3b6dd534cdbbf82a821887ad939/projects => generated 517 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:53.570602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57f12-0a12-47c9-8c6f-6d571d5f97f6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.570905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57f12-0a12-47c9-8c6f-6d571d5f97f6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.571198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57f12-0a12-47c9-8c6f-6d571d5f97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.618562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70712c79811d4190963dbb8c30e3b840', 'request_id': 'req-fcb9064d-63f8-4e64-ac9b-b11915ff5950'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:53.627885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70712c79811d4190963dbb8c30e3b840', 'request_id': 'req-fcb9064d-63f8-4e64-ac9b-b11915ff5950'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:53.628244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2dd57f12-0a12-47c9-8c6f-6d571d5f97f6 None None] MFA Rules not processed for user `ca54b3b6dd534cdbbf82a821887ad939`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:53.629428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2dd57f12-0a12-47c9-8c6f-6d571d5f97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.637580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70712c79811d4190963dbb8c30e3b840', 'request_id': 'req-fcb9064d-63f8-4e64-ac9b-b11915ff5950'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:53.675327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] The token cache is being invalidate because project 70712c79811d4190963dbb8c30e3b840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:53.675705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:53.676473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fcb9064d-63f8-4e64-ac9b-b11915ff5950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:53.678423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2650/5321] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:53 2022] DELETE /identity/v3/projects/70712c79811d4190963dbb8c30e3b840 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:08:53.689890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1608-928f-4559-bbf5-456aa624348e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.690272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1608-928f-4559-bbf5-456aa624348e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.690528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1608-928f-4559-bbf5-456aa624348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.722967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-14bc1608-928f-4559-bbf5-456aa624348e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:53.729418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14bc1608-928f-4559-bbf5-456aa624348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.797272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2672/5322] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:53.798739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.799031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.799312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.846156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] MFA Rules not processed for user `ca54b3b6dd534cdbbf82a821887ad939`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:53.847369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.854251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2651/5323] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:53.862489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:53.862755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:53.863436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:53.907488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:53.909644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:53.926793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2652/5324] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:08:53.931429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:53.964435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e855d9f-05e7-41a1-9e4e-9affcc3ca860 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:53.984522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.models.token_model [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] User ca54b3b6dd534cdbbf82a821887ad939 has no access to project b95e5b7422f240ab93ebca9ae2ac2979 {{(pid=97803) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jun 04 21:08:54.007538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.008321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.010368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.010368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.012936 ncdv-master-1 devstack@keystone.service[97803]: WARNING keystone.server.flask.application [None req-f3062421-16df-48c0-affc-4239d6d03cbd None None] Authorization failed. The request you have made requires authentication. from 10.222.0.18: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 04 21:08:54.013612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:54.016204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.018894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.021023 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2673/5325] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:53 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 222 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 04 21:08:54.024377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.024823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.025108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.070935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2653/5326] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:54.074856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.078362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:54.091316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] MFA Rules not processed for user `ecdc2e5bf2e3492bb5320e054641ec3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:54.097567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:54.130701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335c84-a5c8-4464-a7ef-f06d4fe2afc2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.161400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.162992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.162992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.162992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] PATH_INFO: `/v3/users/ca54b3b6dd534cdbbf82a821887ad939` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.164253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca54b3b6dd534cdbbf82a821887ad939)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.166716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.168998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:54.248646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca54b3b6dd534cdbbf82a821887ad939'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:54.249547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca54b3b6dd534cdbbf82a821887ad939'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:54.265941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca54b3b6dd534cdbbf82a821887ad939'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:54.268044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca54b3b6dd534cdbbf82a821887ad939'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:54.295494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2674/5327] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:54.295494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.296217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:54.304926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0944a772-3dd7-4781-9bf9-43d9a5785748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca54b3b6dd534cdbbf82a821887ad939'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:54.341619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b998f-cd74-4b03-b674-5a6ca6b618e8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.346136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2654/5328] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:54 2022] DELETE /identity/v3/users/ca54b3b6dd534cdbbf82a821887ad939 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:54.351537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.352046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.352655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.436384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:54.437670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:54.478595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:54.510229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.510918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.511263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.511564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.512465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.515459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.562548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2675/5329] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:54 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:54.567483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.590785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2655/5330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:54.601952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.603498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:54.687834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3541-eda9-4dbb-a981-576ff297c3f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.713530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d847e8-8954-4df2-ba20-739cf3b613f7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.739809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.740723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.741014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.741737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:54.743183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.746011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.753568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.799316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.800469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.801001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.801456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.802269 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2676/5331] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:54 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:54.806095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.826026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.827658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add50c6-e502-4cd7-b1fd-0446903e890f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.832941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.833709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.834093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.834462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.835301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.837447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.842523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.855012 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2677/5332] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:54.856256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.869779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f1ce-7f79-43d1-b9f2-028c4b918ed1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.875486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.876399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.876777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.877145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.878165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.880650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e28f-8071-40cd-a28c-b35ee9796bbc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:54.886624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2656/5333] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:54.907301 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2678/5334] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:54.908541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:54.922267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953c3f-f68d-4831-95a6-3707e5940bcd service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:54.934169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:54.935095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:54.935601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:54.935884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] PATH_INFO: `/v3/projects/833c4913a8e44f96ad9ad1774b1d1a52/users/28f6100920f24abf81249089ee6976a7/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:54.971326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=833c4913a8e44f96ad9ad1774b1d1a52, user_id=28f6100920f24abf81249089ee6976a7, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:54.976585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:55.015731 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2657/5335] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:54 2022] PUT /identity/v3/projects/833c4913a8e44f96ad9ad1774b1d1a52/users/28f6100920f24abf81249089ee6976a7/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:55.026484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.027118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.027415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.084168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] MFA Rules not processed for user `28f6100920f24abf81249089ee6976a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:55.087233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:55.219986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2679/5336] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:55.226792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:55.243108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6468-bc33-4b90-842e-dfcd73255c7d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:55.250093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f6100920f24abf81249089ee6976a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '833c4913a8e44f96ad9ad1774b1d1a52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:55.252213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.252714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.253113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] PATH_INFO: `/v3/auth/catalog` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.254909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:55.256462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:55.260893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2658/5337] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 21:08:55 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:08:55.266169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:55.322164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:55.427848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8d0c5-c334-4350-b496-b2cfc87c503a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:55.435735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:55.437332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.438320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.438616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] PATH_INFO: `/v3/users/28f6100920f24abf81249089ee6976a7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.442299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f6100920f24abf81249089ee6976a7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:55.446764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:55.479692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:55.481672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:55.509449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f5f7-482a-44f8-ba21-a75475f20ee4 tempest-IdentityCatalogTest-2073418530 tempest-IdentityCatalogTest-2073418530-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:55.543955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:55.545359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.545832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.546284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] PATH_INFO: `/v3/users/465cff93c4244a4794784ad2885c02e7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.547886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=465cff93c4244a4794784ad2885c02e7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:55.554919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:55.623381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f6100920f24abf81249089ee6976a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.663618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f6100920f24abf81249089ee6976a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.666348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f6100920f24abf81249089ee6976a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.667381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f6100920f24abf81249089ee6976a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.722974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb8ddc40-a36f-4441-8e9e-49474dacc2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f6100920f24abf81249089ee6976a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.732637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465cff93c4244a4794784ad2885c02e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.733489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465cff93c4244a4794784ad2885c02e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.757092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2680/5338] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:55 2022] DELETE /identity/v3/users/28f6100920f24abf81249089ee6976a7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:55.762962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.763174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.763469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.765240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465cff93c4244a4794784ad2885c02e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.766973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465cff93c4244a4794784ad2885c02e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.806398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-333a11c9-19ff-4989-a9ec-1eaf04fb5d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465cff93c4244a4794784ad2885c02e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:55.809740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:55.811993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:55.829493 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2659/5339] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:55 2022] DELETE /identity/v3/users/465cff93c4244a4794784ad2885c02e7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:55.834389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:55.834844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:55.835354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:55.877433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:55.878700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:55.964387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2681/5340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:56.022184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2660/5341] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:56.205663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:56.206957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:56.207232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:56.209940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:56.262391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:56.313632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:56.346244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75223f-2928-4392-9f12-e27abc358d23 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:56.347435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc5a4-e562-4db8-85e2-d1e90edd6f8c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:56.357160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:56.358320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:56.360220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:56.360359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:56.360906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:56.361110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:56.361422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:56.361705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:56.394870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:56.401921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:56.417000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:56.418675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:56.438961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2661/5342] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:56.440499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:56.442903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:56.446585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2682/5343] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:08:56.475467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9668-2f91-420d-b5db-75bed95e0d7e service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:56.493713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:56.501465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:56.501754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:56.502033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] PATH_INFO: `/v3/projects/6e9085245ca946ad806e928accb39b27` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:56.508654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9085245ca946ad806e928accb39b27)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:56.510739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:56.633612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9085245ca946ad806e928accb39b27', 'request_id': 'req-70644f91-5385-4721-93a8-c03d820e36e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:56.648491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9085245ca946ad806e928accb39b27', 'request_id': 'req-70644f91-5385-4721-93a8-c03d820e36e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:56.662009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9085245ca946ad806e928accb39b27', 'request_id': 'req-70644f91-5385-4721-93a8-c03d820e36e2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:56.712707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] The token cache is being invalidate because project 6e9085245ca946ad806e928accb39b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:56.716034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:56.731018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:56.739050 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2662/5344] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:56 2022] DELETE /identity/v3/projects/6e9085245ca946ad806e928accb39b27 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:56.740318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:56.760667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12286e5f-32f6-40af-b2fb-786d57a58f86 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:56.956691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:56.957965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:56.958467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:56.958980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] PATH_INFO: `/v3/users/60fc32e40b954301850432f35083982b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:56.970754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fc32e40b954301850432f35083982b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:56.975274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:57.084518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fc32e40b954301850432f35083982b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:57.092936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fc32e40b954301850432f35083982b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:57.099682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fc32e40b954301850432f35083982b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:57.099682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fc32e40b954301850432f35083982b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:57.147011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8b09132d-de46-4476-b69c-50afde1f1e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fc32e40b954301850432f35083982b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:57.173917 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2683/5345] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:08:56 2022] DELETE /identity/v3/users/60fc32e40b954301850432f35083982b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:57.947592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:57.956411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:57.982025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70644f91-5385-4721-93a8-c03d820e36e2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:58.145846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:58.146841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.147187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.147546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] PATH_INFO: `/v3/projects/2de85e590d5e45c9bca587e74b6689d6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.153717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de85e590d5e45c9bca587e74b6689d6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:58.156442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:58.267066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de85e590d5e45c9bca587e74b6689d6', 'request_id': 'req-12518cd1-04c3-4727-994c-d29e6e0c59f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.268506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:58.277353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de85e590d5e45c9bca587e74b6689d6', 'request_id': 'req-12518cd1-04c3-4727-994c-d29e6e0c59f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.287336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de85e590d5e45c9bca587e74b6689d6', 'request_id': 'req-12518cd1-04c3-4727-994c-d29e6e0c59f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.312171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] The token cache is being invalidate because project 2de85e590d5e45c9bca587e74b6689d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:58.312601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.313186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.319643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2663/5346] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:57 2022] DELETE /identity/v3/projects/2de85e590d5e45c9bca587e74b6689d6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:58.321775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8c78-856f-4913-9655-38c64cedee1d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.322742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8c78-856f-4913-9655-38c64cedee1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.323285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8c78-856f-4913-9655-38c64cedee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.366954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4c4d8c78-856f-4913-9655-38c64cedee1d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:58.368766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4c4d8c78-856f-4913-9655-38c64cedee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.392645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:58.394542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.564798 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2684/5347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:58.565436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12518cd1-04c3-4727-994c-d29e6e0c59f6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:58.577992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:58.579173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.579665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.580132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] PATH_INFO: `/v3/projects/b95e5b7422f240ab93ebca9ae2ac2979` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.580902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.581303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.581596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.582179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95e5b7422f240ab93ebca9ae2ac2979)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:58.585556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:58.626034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:58.627289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.636794 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2685/5348] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:58.640820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:58.651749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:58.665221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076c6d-201b-45ce-96a7-3fcf530675f5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:58.680837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:58.681531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.681817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.682104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.682891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:58.683210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:58.685090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:58.703653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95e5b7422f240ab93ebca9ae2ac2979', 'request_id': 'req-ef60647d-85db-4d20-b76c-fc2ed395dbfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.720699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95e5b7422f240ab93ebca9ae2ac2979', 'request_id': 'req-ef60647d-85db-4d20-b76c-fc2ed395dbfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.730496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95e5b7422f240ab93ebca9ae2ac2979', 'request_id': 'req-ef60647d-85db-4d20-b76c-fc2ed395dbfc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.736014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2686/5349] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:08:58.739381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:58.752840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] The token cache is being invalidate because project b95e5b7422f240ab93ebca9ae2ac2979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:58.753175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.754138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ef60647d-85db-4d20-b76c-fc2ed395dbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:58.759590 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2664/5350] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:58 2022] DELETE /identity/v3/projects/b95e5b7422f240ab93ebca9ae2ac2979 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:58.762116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc9e1-f873-4c6b-9e4b-16de64aedb99 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.762518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc9e1-f873-4c6b-9e4b-16de64aedb99 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.764432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc9e1-f873-4c6b-9e4b-16de64aedb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.768582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058c606-0396-49e3-880d-7780d19363f0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:58.789536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-aa8fc9e1-f873-4c6b-9e4b-16de64aedb99 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:58.791017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa8fc9e1-f873-4c6b-9e4b-16de64aedb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.899581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:58.901979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.905280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.906965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.910839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:58.912897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2665/5351] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:58.914195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:58.921570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.922419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.922544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:58.952900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:58.955625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.967310 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2666/5352] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:58.971606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:58.976823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:58.984895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94616f-076e-4c56-a9fd-714e5fe4f965 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:58.988699 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2687/5353] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/projects => generated 399 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:58.993235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:58.995215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:58.995490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502840-eeb4-4722-9826-52924577838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:58.996398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502840-eeb4-4722-9826-52924577838b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:58.996655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502840-eeb4-4722-9826-52924577838b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:58.996901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502840-eeb4-4722-9826-52924577838b admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.000411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502840-eeb4-4722-9826-52924577838b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:08:59.002166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502840-eeb4-4722-9826-52924577838b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.004927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502840-eeb4-4722-9826-52924577838b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.041014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2667/5354] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:08:59.045662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502840-eeb4-4722-9826-52924577838b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.067035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502840-eeb4-4722-9826-52924577838b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.075334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.076916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.077213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.077497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.078209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.080203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.080431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330df495-fc72-4cb6-9ecb-012626b03e35 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.090696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.091691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.092075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.092571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.093483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.096843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.117994 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2668/5355] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:08:59 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:59.118732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.121140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:59.146186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2688/5356] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:58 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:08:59.148337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.171452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee7aa-171c-47cd-8290-ebdb9075b9cc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.301584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.302334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.302682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.302958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.303719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.305682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.329921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33198662-1099-4b5d-9238-f37111cd8af8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.331588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:59.346854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.347844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.348158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.350727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] PATH_INFO: `/v3/projects/833c4913a8e44f96ad9ad1774b1d1a52` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.355596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833c4913a8e44f96ad9ad1774b1d1a52)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.361251 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2689/5357] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:08:59 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:08:59.361251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.367767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.382896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f04f8-3d11-4705-94c0-dc5e7333a0e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.393982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.394676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.394957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.395280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.396680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.403374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.433356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2690/5358] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:59.434629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.457138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c3abd-499b-477c-a78d-e8b22f963304 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.467228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.468497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.468970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.469426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.471166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.474362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.510337 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2691/5359] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:59.511707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.524760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833c4913a8e44f96ad9ad1774b1d1a52', 'request_id': 'req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:59.533542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca30a-c1ee-4326-b987-4c8bb5bef36a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.544739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833c4913a8e44f96ad9ad1774b1d1a52', 'request_id': 'req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:59.572692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833c4913a8e44f96ad9ad1774b1d1a52', 'request_id': 'req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:59.609395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] The token cache is being invalidate because project 833c4913a8e44f96ad9ad1774b1d1a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:08:59.609759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:59.616139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:08:59.621527 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2669/5360] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:59 2022] DELETE /identity/v3/projects/833c4913a8e44f96ad9ad1774b1d1a52 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:59.624235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.633300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:59.702623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.703317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.703641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.703925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.704721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.706385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0450d7a-0371-450e-a01f-9700302673b0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.733729 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2692/5361] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:59.738383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.738671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.738954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.776453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:59.777853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:59.801151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:59.812553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2693/5362] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:59.812961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd97519-865f-4b1a-8efe-b3eb9669c3c9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.813080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.813080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:59.823006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.824314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.824605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.824890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.825648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.838271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab775-4c22-434e-8df1-b3d3bcbee0c3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.852219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2670/5363] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:08:59.853489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.853785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.854072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.857751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d4a03-7686-46ef-8bda-c60e9f4a00c7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:08:59.867178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:08:59.868194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:08:59.868477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:08:59.868761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] PATH_INFO: `/v3/projects/4b3cf94cd6bb4d7c89a79a76127da15d/users/872847a42c134cdaaa854ec9dcd1fb2f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:08:59.901926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3cf94cd6bb4d7c89a79a76127da15d, user_id=872847a42c134cdaaa854ec9dcd1fb2f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:08:59.905170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:08:59.916759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:08:59.918261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:08:59.928736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2671/5364] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:08:59.933544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.943182 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2694/5365] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:59 2022] PUT /identity/v3/projects/4b3cf94cd6bb4d7c89a79a76127da15d/users/872847a42c134cdaaa854ec9dcd1fb2f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:08:59.944297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:08:59.956865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976d3d2-8074-46a9-9478-03f595457f7c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.069975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50a304-2c54-48d6-acbf-639fd72661ee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.085057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.085354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.085470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.085732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.086682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:00.086815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.088434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd29520-1974-4436-83c0-d3b4d4134518 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.096939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.097892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.098251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.098443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] PATH_INFO: `/v3/projects/cdfc5f44bddf464eaa45697d13edd85d/users/25520985b65942a8badf6c0e8beff1fc/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.116886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfc5f44bddf464eaa45697d13edd85d, user_id=25520985b65942a8badf6c0e8beff1fc, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.117298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2695/5366] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:00.118884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.118884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.119160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.123667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.145843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2672/5367] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:08:59 2022] PUT /identity/v3/projects/cdfc5f44bddf464eaa45697d13edd85d/users/25520985b65942a8badf6c0e8beff1fc/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:00.146781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.184361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] MFA Rules not processed for user `872847a42c134cdaaa854ec9dcd1fb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:00.185598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:00.229868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:00.231335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74397-6b82-4d96-80e1-2f59766ca19c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.238023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.238742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.239033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.239312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.240052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.242138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f3e7-a9bb-4f97-a9c1-ebf9bc24aede admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.290964 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2673/5368] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:00 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:00.292696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.293070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.293442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.337571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] MFA Rules not processed for user `25520985b65942a8badf6c0e8beff1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:00.338938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:00.343025 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2696/5369] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:00.348397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.390905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0c10f-8b39-4213-81da-e784ee995dac None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.393763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:00.428925 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2674/5370] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:00.429823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.431146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:00.545235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.546312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.546868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.547238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.547930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.549988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.586888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bf14-076b-45e4-b7e8-3aa9d5087ef4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.596398 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2697/5371] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:00 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:00.597250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.600889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.602186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.602473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.602749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.607082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:00.675040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.678198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.693915 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2675/5372] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:00.695223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.715598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eb8ca-b776-44d2-8780-0aabdabc25b8 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.725602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.726681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.727141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.727476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.728650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.731582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.760289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2676/5373] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:00.761309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.767952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fde5e4-aa92-4e98-a5c4-2d9bc4a31d3c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.773527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.774697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.775493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.776221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.788781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6dd0e-9f47-4bb5-b5e9-7b415f4e2490 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.793748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.794531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.795669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.795955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.796234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] PATH_INFO: `/v3/users/872847a42c134cdaaa854ec9dcd1fb2f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.796973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.797526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] RBAC: Authorizing `identity:delete_user(user_id=872847a42c134cdaaa854ec9dcd1fb2f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.799493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.834705 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2698/5374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:00.835909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.860007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911e2e9-fec4-49da-871c-5ebd8d014011 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:00.874185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:00.874890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:00.875184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:00.876178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:00.879242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:00.883929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:00.897797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872847a42c134cdaaa854ec9dcd1fb2f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:00.898679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872847a42c134cdaaa854ec9dcd1fb2f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:00.916270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872847a42c134cdaaa854ec9dcd1fb2f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:00.918821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872847a42c134cdaaa854ec9dcd1fb2f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:00.937568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:00.945427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2699/5375] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:00.946985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:00.950434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-910f3ba9-f531-4fca-bf0c-1db2752f248b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872847a42c134cdaaa854ec9dcd1fb2f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:00.953538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.001765 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2677/5376] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:00 2022] DELETE /identity/v3/users/872847a42c134cdaaa854ec9dcd1fb2f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:01.009374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb79b-78d0-463b-a369-ec0a9ab42cc3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.009677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb79b-78d0-463b-a369-ec0a9ab42cc3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.009922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb79b-78d0-463b-a369-ec0a9ab42cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.020872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab05b-7ece-4502-bce8-ec1dcd620f39 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:01.085283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b9fdb79b-78d0-463b-a369-ec0a9ab42cc3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:01.086847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9fdb79b-78d0-463b-a369-ec0a9ab42cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.121405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:01.189026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:01.190003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.190237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.190521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] PATH_INFO: `/v3/projects/27ff04c8590a4670a4a8ed3580d8efba/users/54f765d0b420493dbb973ad0f5687826/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.226844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ff04c8590a4670a4a8ed3580d8efba, user_id=54f765d0b420493dbb973ad0f5687826, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:01.229695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c494f-a8a1-4d78-b172-d2b132b0087d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:01.259956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2678/5377] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:01.263153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.263588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.264798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.265090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2700/5378] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:00 2022] PUT /identity/v3/projects/27ff04c8590a4670a4a8ed3580d8efba/users/54f765d0b420493dbb973ad0f5687826/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:01.281718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.282116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.282290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.312132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:01.313842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.365019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] MFA Rules not processed for user `54f765d0b420493dbb973ad0f5687826`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:01.365019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.407604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2679/5379] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:01.411601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:01.411601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.538522 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2701/5380] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:09:01.539425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:01.546246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.554578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9537a6-3f05-42af-954b-73b3609adc1f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:01.566967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:01.567711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.569567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.569849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.685245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:01.725148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:01.726611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:01.729340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449af33-9dc4-442f-9266-1b0178cc36dc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:01.749725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:01.751228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.751228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.752060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.752592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2680/5381] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:01.753557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:01.755367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:01.775281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:01.777906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea551796-0375-46bf-b72d-f41407093311 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:01.798711 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2702/5382] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:01.847277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5e19d-a5bc-4610-94a9-b42656829087 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:01.851740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:01.852448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:01.852730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:01.853003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:01.866064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:01.867828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:01.878970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2681/5383] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:02.552310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:02.552798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:02.553007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:02.584636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:02.599911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:02.601272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:02.602434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b00d2-a42f-464f-8d18-a7bc29ee1c6e service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:02.612682 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2703/5384] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:02.614458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:02.615465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:02.615638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:02.616053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] PATH_INFO: `/v3/users/54f765d0b420493dbb973ad0f5687826` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:02.623135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f765d0b420493dbb973ad0f5687826)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:02.625400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:02.646913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:02.684638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d171-75b3-4131-9b3c-3bc7310554a2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:02.701128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:02.701818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:02.702292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:02.702752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:02.720898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:02.722478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:02.738680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f765d0b420493dbb973ad0f5687826'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:02.740255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f765d0b420493dbb973ad0f5687826'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:02.746146 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2704/5385] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:02.759415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f765d0b420493dbb973ad0f5687826'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:02.760463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f765d0b420493dbb973ad0f5687826'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:02.789555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-78627e84-bc7a-4459-acb5-9f8eec026f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f765d0b420493dbb973ad0f5687826'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:02.820838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:02.824004 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2682/5386] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:02 2022] DELETE /identity/v3/users/54f765d0b420493dbb973ad0f5687826 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:02.826097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:02.826734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:02.827088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:02.827400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:02.850853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c8c3-dd9c-4abc-9128-f0257f224d99 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:02.868168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:02.890553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:02.894292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:02.997885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:02.998819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:03.001313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.001677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.002684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] PATH_INFO: `/v3/projects/4b3cf94cd6bb4d7c89a79a76127da15d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.005292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3cf94cd6bb4d7c89a79a76127da15d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.009017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.041256 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2683/5387] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:09:03.055550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.057642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.112671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3cf94cd6bb4d7c89a79a76127da15d', 'request_id': 'req-8ac6f167-ce40-4e88-b30d-81b51588b0cc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:03.123809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3cf94cd6bb4d7c89a79a76127da15d', 'request_id': 'req-8ac6f167-ce40-4e88-b30d-81b51588b0cc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:03.150116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3cf94cd6bb4d7c89a79a76127da15d', 'request_id': 'req-8ac6f167-ce40-4e88-b30d-81b51588b0cc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:03.174474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] The token cache is being invalidate because project 4b3cf94cd6bb4d7c89a79a76127da15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:03.174872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:03.176109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8ac6f167-ce40-4e88-b30d-81b51588b0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:03.180546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2705/5388] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:02 2022] DELETE /identity/v3/projects/4b3cf94cd6bb4d7c89a79a76127da15d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:03.182120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817e60-060a-414c-b2f6-77d2c797e606 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.182495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817e60-060a-414c-b2f6-77d2c797e606 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.182927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f817e60-060a-414c-b2f6-77d2c797e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.211030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf643f08-cec3-429c-be4d-644c74e0a7dd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.211276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6f817e60-060a-414c-b2f6-77d2c797e606 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:03.215824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f817e60-060a-414c-b2f6-77d2c797e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.290522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.291248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.291938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.292330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.294628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.432457 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2706/5389] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:03.434256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.437392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.437953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.440107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.441751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c6167-6dff-46ec-a492-b4fcc4394ce8 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.456969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2684/5390] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:09:03.458219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.458509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.458792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.479584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:03.481356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.482236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:03.483972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.495963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2685/5391] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:03.499834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.512335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930886e4-ab17-49f1-a233-012f0d882e2e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.519117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.520021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.521196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.521580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.522823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:03.522966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.525087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.543412 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2686/5392] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:09:03.548378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.553221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:03.565474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8d6cd-0f4f-476d-88cf-f7730da96bc6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.571352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2707/5393] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:03.574954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.575669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.575960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.576336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.577069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.580248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.585305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.586745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:03.651048 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2687/5394] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:03 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:03.655824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.691371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ff8e-a72f-4105-9c25-814d599f2d96 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.705462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:03.802993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.804257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.804769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.805393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.810299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e189bf-07fc-459a-869b-2bd5db03a922 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.823099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.824567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.824567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.824815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.825452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.827378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.867910 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2688/5395] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:03 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:03.868737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.892973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.895196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.898015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aa720-bd3b-4060-85eb-f1f7682b9ef3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.903190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.904066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.904199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.904462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.905192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.906794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.909750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2708/5396] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:03.936634 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2689/5397] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:03.940866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:03.959317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4355-91d7-4507-8dbf-e3e1bf3a5673 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:03.965403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:03.966922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:03.967426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:03.968068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:03.969076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:03.970927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fd640-efa1-486b-adce-7816799c7f66 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:03.989943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:04.001589 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2709/5398] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:09:04.011957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77fec-a182-48ac-8901-7dce155c31cd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:04.021115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:04.023862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.024903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.025474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] PATH_INFO: `/v3/projects/727bfb4a2c5e449881b2e666725b41b1/users/e1865685fa174c9a8a06af94099ca5d0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.049173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727bfb4a2c5e449881b2e666725b41b1, user_id=e1865685fa174c9a8a06af94099ca5d0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:04.052601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb771f-b307-490f-9557-fd50dd087749 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:04.126341 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2690/5399] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:03 2022] PUT /identity/v3/projects/727bfb4a2c5e449881b2e666725b41b1/users/e1865685fa174c9a8a06af94099ca5d0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:04.138151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.138538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.138903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.194635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0950f-1159-4590-a566-54b865e8b920 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.195011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0950f-1159-4590-a566-54b865e8b920 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.195404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0950f-1159-4590-a566-54b865e8b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.200278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] MFA Rules not processed for user `e1865685fa174c9a8a06af94099ca5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:04.201599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:04.230728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e8b0950f-1159-4590-a566-54b865e8b920 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:04.232376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8b0950f-1159-4590-a566-54b865e8b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:04.245028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:04.343766 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2710/5400] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:04.351500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:04.353531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:04.367713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2691/5401] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:04.386003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.386602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.387149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.417022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] MFA Rules not processed for user `33de20254305474aa55173591da1b6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:04.418302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:04.491338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2692/5402] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:04.491338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:04.502834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6585893-2615-4108-82b0-229d96543dc1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:04.513612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:04.514288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.514574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.514853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.528825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:04.530767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fec6bd-e478-4931-af27-3fa1859dc213 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:04.532162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:04.562850 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2711/5403] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:09:04.582736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.583042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.583333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.612014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7bda7-977d-4a8c-a3d3-00b532f9af31 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:04.618100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:04.620156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:04.620754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:04.621160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:04.645767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:04.649178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d7288-f400-42aa-aab3-e5a40094b113 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:04.657957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] MFA Rules not processed for user `33de20254305474aa55173591da1b6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:04.659178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:04.670130 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2712/5404] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:04.675705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2693/5405] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:04.930714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:04.932996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.060979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0829a-8ca7-4423-abe9-ed46f5e033f3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:05.067423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:05.069548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.069867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.070366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] PATH_INFO: `/v3/projects/27ff04c8590a4670a4a8ed3580d8efba` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.072382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ff04c8590a4670a4a8ed3580d8efba)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:05.077026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:05.175169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:05.180682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ff04c8590a4670a4a8ed3580d8efba', 'request_id': 'req-16be6727-7463-4e25-bdec-3e22135b58d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:05.193374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ff04c8590a4670a4a8ed3580d8efba', 'request_id': 'req-16be6727-7463-4e25-bdec-3e22135b58d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:05.241160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951c09e-84de-4774-b9a3-292fa7a4305c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.241653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951c09e-84de-4774-b9a3-292fa7a4305c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.242047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951c09e-84de-4774-b9a3-292fa7a4305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.250883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ff04c8590a4670a4a8ed3580d8efba', 'request_id': 'req-16be6727-7463-4e25-bdec-3e22135b58d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:05.283473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] The token cache is being invalidate because project 27ff04c8590a4670a4a8ed3580d8efba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:05.286989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:05.288615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-16be6727-7463-4e25-bdec-3e22135b58d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:05.293487 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2713/5406] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:04 2022] DELETE /identity/v3/projects/27ff04c8590a4670a4a8ed3580d8efba => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:05.299042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.299541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.299985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.311064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6951c09e-84de-4774-b9a3-292fa7a4305c None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:05.312532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6951c09e-84de-4774-b9a3-292fa7a4305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.342467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:05.345038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.489312 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2694/5407] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:05.502159 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2714/5408] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:09:05.510209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.510867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.511187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:05.511638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.512709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.545538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:05.548589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.572790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2695/5409] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:05.578097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:05.595203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b1eb9-aed7-4276-97a1-1e74a7cdbd17 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:05.610377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:05.611241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.611617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.611949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.613153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:05.613682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:05.615624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:05.648288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883e6d-fe13-469c-8e79-affb4a552054 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:05.654613 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2696/5410] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:09:05.656433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:05.667540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:05.670279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.670907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.671392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.676153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a4610-1c31-4156-adff-822a8fb28812 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:05.689152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:05.690087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.690544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.690989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.691935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:05.693505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:05.697677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:05.698066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:05.721889 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2715/5411] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:09:05.810556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:05.823818 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2697/5412] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:05 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:09:05.836386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595d60-8e7b-4673-91f6-9a00549b3fbd service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:05.928635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:05.931270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:05.978517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:05.980871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:05.982626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:05.983210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:05.986299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:05.993004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.020282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:06.040361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b75126-42a3-4c4d-8b88-51c914952d12 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.043799 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2716/5413] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:05 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:06.050614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.051810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.052957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.053347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.054208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.058112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:06.074710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb366a2-a443-4d8c-94bc-48daac961a53 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.085709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.086407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.086691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.086969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.087749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.090256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49a178-0b8e-4623-9bc7-e03dae841d04 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.092016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.094242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.105881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2717/5414] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:06.107482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.107883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.111862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.118463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2698/5415] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:09:06.121389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.135707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:06.138130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:06.159492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d2e9-3346-48d0-8e2a-2fdad532f6d5 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.179430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.180153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.180715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.180715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.183353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.184993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.230992 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2699/5416] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:06.231566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2718/5417] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:06.238346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.248085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.252215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd0b0-cfb3-4b77-b4c2-f6bf84706844 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.264721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.264721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.264721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.264721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] PATH_INFO: `/v3/projects/a501fe31105d477f8b9d9491919add48/users/46e1dfe5c0a449a9ac73993816d01f10/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.266749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:06.302089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a501fe31105d477f8b9d9491919add48, user_id=46e1dfe5c0a449a9ac73993816d01f10, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.305264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6601f-f5cb-477d-9b50-ebc20811fb05 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.331087 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2700/5418] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:06 2022] PUT /identity/v3/projects/a501fe31105d477f8b9d9491919add48/users/46e1dfe5c0a449a9ac73993816d01f10/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:06.342060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.342355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.342637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.363725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4c11-587d-4a4f-86d7-6b508fe59453 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.392009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] MFA Rules not processed for user `46e1dfe5c0a449a9ac73993816d01f10`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:06.396073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:06.505978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.506726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.507086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.507433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.551890 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2701/5419] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:06.552851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.581070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:06.643220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.646129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.665034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46124f90-493f-4fa2-9e58-bb1ead33168d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.681462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.682619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.683203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.683597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.684523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.686587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:06.713327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2719/5420] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:09:06.740050 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2702/5421] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:06 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:06.744255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.777449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea06-9d90-4190-a8f1-71d882d332fa service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:06.906766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:06.908818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:06.964953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:06.966032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:06.966258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:06.966835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:06.967489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:06.970616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.032071 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2720/5422] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:06 2022] POST /identity/v3/users => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:07.043582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.062403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf89b6-f02c-40b6-a5a7-ace5d65c03b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.065977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:07.073449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.074438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.074921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.075370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.075636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1cb0-1638-434a-8c3b-597c21558202 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.078447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.080334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.089924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.090870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.091155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.091436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] PATH_INFO: `/v3/users/25520985b65942a8badf6c0e8beff1fc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.094167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25520985b65942a8badf6c0e8beff1fc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.098875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.099389 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2721/5423] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:07.104018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.137774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965f599-ad80-4ede-a389-a29e52bfde53 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.154827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.157438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.158887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.159975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] PATH_INFO: `/v3/projects/ee8652b129c7498d8280985e96f3d67d/users/9c11ee51d8c645b7b3548d69ae0ee9e5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.187018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8652b129c7498d8280985e96f3d67d, user_id=9c11ee51d8c645b7b3548d69ae0ee9e5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.190167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.229230 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2722/5424] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:07 2022] PUT /identity/v3/projects/ee8652b129c7498d8280985e96f3d67d/users/9c11ee51d8c645b7b3548d69ae0ee9e5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:07.230477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.236094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25520985b65942a8badf6c0e8beff1fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:07.237875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25520985b65942a8badf6c0e8beff1fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:07.271217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25520985b65942a8badf6c0e8beff1fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:07.276056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25520985b65942a8badf6c0e8beff1fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:07.340125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3cd6c04f-adf6-4e08-ae33-f4e9cfa8dfa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25520985b65942a8badf6c0e8beff1fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:07.388669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f7eff-cfc7-453f-8a3c-c2a2f581a69d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.397415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2703/5425] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:06 2022] DELETE /identity/v3/users/25520985b65942a8badf6c0e8beff1fc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:07.401909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.402506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.402793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.403211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.404095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.405607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.409899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.410218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.410520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.434480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2723/5426] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:07.436185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.439556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:07.455966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:07.459818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:07.481440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf300a7-b534-4451-8c3b-ef5cb46b386e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.526401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:07.585450 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2704/5427] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:07.600907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.603536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:07.631607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.633505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.634221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.634604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] PATH_INFO: `/v3/projects/ee8652b129c7498d8280985e96f3d67d/users/9c11ee51d8c645b7b3548d69ae0ee9e5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.637771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8652b129c7498d8280985e96f3d67d, user_id=9c11ee51d8c645b7b3548d69ae0ee9e5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.646036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22889cd7-9959-4b39-8143-5c8133919eb5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.685377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2724/5428] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:07 2022] PUT /identity/v3/projects/ee8652b129c7498d8280985e96f3d67d/users/9c11ee51d8c645b7b3548d69ae0ee9e5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:07.699551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6d83-a96d-4b0d-aa3f-4dda0cc24a1e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:07.700161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.700757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.701168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.744613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:07.780580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] MFA Rules not processed for user `9c11ee51d8c645b7b3548d69ae0ee9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:07.783739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:07.796218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:07.797461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:07.799322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:07.799459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:07.961801 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2725/5429] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:09:07.974790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:07.976093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:07.991535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:07.993522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:07.999781 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2705/5430] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:09:08.038522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff49be-fc4a-43ce-9fda-24789c4842b2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:08.044178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:08.044871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:08.045158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:08.045565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:08.050616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:08.197251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:08.200918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae6cd3-0ccf-49bc-80d3-0aedd2777c5d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:08.216499 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2726/5431] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:08.384571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:08.386916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:08.401109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4d72-a8a9-418e-a342-7076728e0100 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:08.408847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:08.410306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:08.410638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:08.410915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] PATH_INFO: `/v3/users/e1865685fa174c9a8a06af94099ca5d0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:08.412859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1865685fa174c9a8a06af94099ca5d0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:08.414946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:08.501580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1865685fa174c9a8a06af94099ca5d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:08.502803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1865685fa174c9a8a06af94099ca5d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:08.514870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1865685fa174c9a8a06af94099ca5d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:08.516336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1865685fa174c9a8a06af94099ca5d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:08.537634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1865685fa174c9a8a06af94099ca5d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:08.565489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2706/5432] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:08 2022] DELETE /identity/v3/users/e1865685fa174c9a8a06af94099ca5d0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:08.570560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:08.570861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:08.571139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:08.594550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:08.596211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:08.650386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:08.703768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2727/5433] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:08.822650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:08.824585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:08.977288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b27d7c-70b6-4531-a13a-48583e09d71c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:08.985557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:08.986767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:08.987249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:08.987716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.002676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.004867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac3247-60ca-49ca-b41c-fa8804b38222 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.009595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:09.024023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2707/5434] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:09.055660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.057187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:09.078549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3031a-6c7e-4cfc-bd61-19ac35d50adb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.095682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.096329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.096613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.097700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] PATH_INFO: `/v3/projects/cdfc5f44bddf464eaa45697d13edd85d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.101434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfc5f44bddf464eaa45697d13edd85d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.103398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.200449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfc5f44bddf464eaa45697d13edd85d', 'request_id': 'req-2354b03d-e50d-41d4-805e-3175801d4a30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:09.210540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfc5f44bddf464eaa45697d13edd85d', 'request_id': 'req-2354b03d-e50d-41d4-805e-3175801d4a30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:09.221458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfc5f44bddf464eaa45697d13edd85d', 'request_id': 'req-2354b03d-e50d-41d4-805e-3175801d4a30'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:09.247872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] The token cache is being invalidate because project cdfc5f44bddf464eaa45697d13edd85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:09.248189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:09.249204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2354b03d-e50d-41d4-805e-3175801d4a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:09.252806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2728/5435] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:09 2022] DELETE /identity/v3/projects/cdfc5f44bddf464eaa45697d13edd85d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:09.259719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.260146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.260544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.293891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:09.297040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:09.452713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2708/5436] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:09.464779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.465152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.465470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.495372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:09.496947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:09.513122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2729/5437] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:09.517116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.529601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac28967-038c-474b-bd6d-03c4e0afe6f7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.538963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.539706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.539999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.540277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.541230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:09.541549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.543798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.570907 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2709/5438] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:09.572419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.588705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453314ca-811c-4f37-aee4-65a2a53ccbbf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.595190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.596286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.596908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.597363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.598282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.601096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.650665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2730/5439] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:09 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:09.655076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.669971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfa9e7-0216-499a-8553-9c107a0d7a64 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.797645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.799141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.799141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.799141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.801413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.806079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.867212 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2710/5440] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:09 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:09.869407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.892204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b59e-e048-427c-8ca8-4ddb701cae71 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.903096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.905745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.906412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.907090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.909134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.913505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:09.949564 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2731/5441] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:09.953077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:09.967234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30081-3d89-49f9-b924-f3d7c7a5ed96 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:09.980444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:09.981161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:09.981763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:09.981907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:09.983486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:09.988541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41471-2af2-4b18-81c8-e13cd1422b6c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.014934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2711/5442] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:10.019690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.035934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744722c3-ca11-45c3-a4cf-9604346d98ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.044255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.045706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.045867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.046192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] PATH_INFO: `/v3/projects/987aab7e9b0448f190a44f10e851c162/users/24dc128c22ea4a1f95f7aaaeff1b1753/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.066726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987aab7e9b0448f190a44f10e851c162, user_id=24dc128c22ea4a1f95f7aaaeff1b1753, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.069497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.092825 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2732/5443] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:10 2022] PUT /identity/v3/projects/987aab7e9b0448f190a44f10e851c162/users/24dc128c22ea4a1f95f7aaaeff1b1753/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:10.103731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.105352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.105683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.170567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] MFA Rules not processed for user `24dc128c22ea4a1f95f7aaaeff1b1753`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:10.171729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:10.247693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:10.265513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2712/5444] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:10.270145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.348058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:10.354066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77e6eb-2b3e-41d9-bde3-0f7cb2cb8c60 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.367127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.367669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.368048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.368606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.370527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.382691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.441363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2733/5445] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:10 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:10.444249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.465521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc23f1f-ddbc-4639-9764-a528436f50f5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.539550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.541895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:10.624700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.625770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.626454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.627056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.627876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.630630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.641803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf39aca-7fad-496d-9123-15deb5a58c0d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.657360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.674447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.674833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.677110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] PATH_INFO: `/v3/projects/727bfb4a2c5e449881b2e666725b41b1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.682280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] RBAC: Authorizing `identity:delete_project(project_id=727bfb4a2c5e449881b2e666725b41b1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.688000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.689503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2713/5446] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:10 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:10.693722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.722118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535fbc-954c-4674-b388-55068f43f5d2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.728590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.730461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.730755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.731076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.732034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.734073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.751252 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2714/5447] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:10.755972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:10.774734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727bfb4a2c5e449881b2e666725b41b1', 'request_id': 'req-fe9f5c13-05d4-4842-905f-d55505cf496a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:10.777920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0a620-877f-4700-9362-96e89e9b2eff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:10.784179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727bfb4a2c5e449881b2e666725b41b1', 'request_id': 'req-fe9f5c13-05d4-4842-905f-d55505cf496a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:10.793485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727bfb4a2c5e449881b2e666725b41b1', 'request_id': 'req-fe9f5c13-05d4-4842-905f-d55505cf496a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:10.835890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] The token cache is being invalidate because project 727bfb4a2c5e449881b2e666725b41b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:10.837424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:10.839814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe9f5c13-05d4-4842-905f-d55505cf496a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:10.846344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2734/5448] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:10 2022] DELETE /identity/v3/projects/727bfb4a2c5e449881b2e666725b41b1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:10.851499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.852093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.852488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.881154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:10.882547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:10.919115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:10.920840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:10.921196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:10.921875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] PATH_INFO: `/v3/projects/b88b266dc2764ac28ebb5af097f784fb/users/66e416322ae34b408c1b1399a5c757b3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:10.968429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88b266dc2764ac28ebb5af097f784fb, user_id=66e416322ae34b408c1b1399a5c757b3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:10.972593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:10.999763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2715/5449] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:10 2022] PUT /identity/v3/projects/b88b266dc2764ac28ebb5af097f784fb/users/66e416322ae34b408c1b1399a5c757b3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:11.001485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.003992 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2735/5450] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:11.007293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.012159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.013731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.033941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a3b06-da53-445c-b6e0-3837e97e0634 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.047372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:11.117933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc1d65-525a-4b28-bb6f-1c5a4231e695 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.123193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.124114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.124562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.125278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.129207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.141061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:11.149195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.150143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.150714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.151120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.152403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.154864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fb60a-cfe8-4be5-a4c5-0aee79008526 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.174006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2736/5451] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:11.175792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.176469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.176921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.217105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:11.226722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.253753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2737/5452] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:11.253753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.269725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739092d2-f0e5-479d-b0f7-ca7341f7c1d8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.287577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.289539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.289991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.290501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] PATH_INFO: `/v3/projects/b88b266dc2764ac28ebb5af097f784fb/users/66e416322ae34b408c1b1399a5c757b3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.298741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88b266dc2764ac28ebb5af097f784fb, user_id=66e416322ae34b408c1b1399a5c757b3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.302068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.314711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.316222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4537b-af99-40d3-9a6a-680183756488 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.317559 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2738/5453] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:11 2022] PUT /identity/v3/projects/b88b266dc2764ac28ebb5af097f784fb/users/66e416322ae34b408c1b1399a5c757b3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:11.319149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.341241 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2716/5454] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:11.342313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.342602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.342881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.402817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] MFA Rules not processed for user `66e416322ae34b408c1b1399a5c757b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:11.408896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.424070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7937e-a3b8-44dc-ace9-2217c4c25791 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.430344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.430882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.431827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.432203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.433218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:11.433423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.435252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.455649 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2739/5455] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:11.456940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.470986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022a643-79ab-4e76-990b-67f005e08ec3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.476649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.477335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.477832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.478228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.480209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.482621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.544927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2740/5456] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:11 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:09:11.546724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.573363 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2717/5457] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:11.598315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.600092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:11.686503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe4fad-ccd3-4a35-8e8e-6f4a0afca186 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.691060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2bb1d-82c7-4264-b0c3-12bc39a7822d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.696995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.697914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.698331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.698676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.699573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.701728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.710555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:11.777474 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2741/5458] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:11 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:11.783037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.796620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:11.803981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e649d7d-8084-4062-bc58-dc77cf568771 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.818605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.819393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.819707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.819841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.820128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.820741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.821232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.821520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.822564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.827385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.858414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2742/5459] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:11.861831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.888854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559e91b-a37d-4004-9443-5d347329580d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.899043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.900370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.900846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.901678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:11.903054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.910645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5916e-6454-47d4-9b2f-c0c709b101d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.921722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:11.923546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:11.938809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2718/5460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:11.941622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:11.954742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2743/5461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:11.955101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519ec83-c6b0-4f5b-a540-f800c770bbee service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:11.962949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:11.964238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:11.964574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:11.964931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] PATH_INFO: `/v3/projects/1f5a1973383d43b78538311cfb1df87c/users/c7fbde1fc523414d9bbe535db7f70095/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:12.009248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5a1973383d43b78538311cfb1df87c, user_id=c7fbde1fc523414d9bbe535db7f70095, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:12.013183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:12.058928 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2719/5462] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:11 2022] PUT /identity/v3/projects/1f5a1973383d43b78538311cfb1df87c/users/c7fbde1fc523414d9bbe535db7f70095/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:12.066114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbaa6-2dbf-4332-8824-e8c0b4a5e5b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:12.066424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbaa6-2dbf-4332-8824-e8c0b4a5e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:12.066705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbaa6-2dbf-4332-8824-e8c0b4a5e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:12.102620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0c3fbaa6-2dbf-4332-8824-e8c0b4a5e5b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:12.104136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c3fbaa6-2dbf-4332-8824-e8c0b4a5e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:12.224620 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2744/5463] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:12.311294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:12.459302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b6a9a-5c91-48e0-b94d-b91f6b2aba4e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:12.474803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:12.475985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:12.476703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:12.477183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:12.515229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:12.517005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:12.535367 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2720/5464] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:15.798081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:15.799797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:15.800389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:15.856921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] MFA Rules not processed for user `c7fbde1fc523414d9bbe535db7f70095`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:15.858557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:16.044689 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2745/5465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:16.058520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:16.060164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:16.198171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:16.214306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7ec3-bc64-4049-9cc5-35f662d04e9e service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:16.230637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:16.231283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:16.231610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:16.231935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:16.261020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:16.292781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:16.317768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2721/5466] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:16.475961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:16.503550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df9ad-6f5f-4dbb-9589-a4b0b5f9c37c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:16.511842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:16.514740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:16.515942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:16.516641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:16.518950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:16.636178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:16.642350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:16.644039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdd938-826b-466a-94a2-d789a2c2de23 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:16.658435 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2746/5467] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:17.802387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:17.827541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fa10f-1e3d-4917-939b-dd5d9b8f4c18 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:17.838321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:17.840537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:17.840938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:17.841484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] PATH_INFO: `/v3/users/24dc128c22ea4a1f95f7aaaeff1b1753` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:17.844289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24dc128c22ea4a1f95f7aaaeff1b1753)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:17.848374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:17.992414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24dc128c22ea4a1f95f7aaaeff1b1753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:17.994692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24dc128c22ea4a1f95f7aaaeff1b1753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:18.015679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24dc128c22ea4a1f95f7aaaeff1b1753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:18.017758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24dc128c22ea4a1f95f7aaaeff1b1753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:18.059591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24dc128c22ea4a1f95f7aaaeff1b1753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:18.100820 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2722/5468] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:17 2022] DELETE /identity/v3/users/24dc128c22ea4a1f95f7aaaeff1b1753 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:18.107405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:18.107977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:18.108104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:18.143337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:18.150596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:18.331665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2747/5469] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:18.346026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:18.348626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:18.474133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3535-7c9d-4801-b6e4-060cd98b02c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:18.478045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:18.478845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:18.479146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:18.479877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:18.497752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:18.499817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:18.520157 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2723/5470] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:20.323792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:20.331652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:20.349618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46e7f3-b104-4002-96e2-1e3caf5a940e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:20.354732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:20.356339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:20.356617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:20.356888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] PATH_INFO: `/v3/projects/987aab7e9b0448f190a44f10e851c162` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:20.358180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=987aab7e9b0448f190a44f10e851c162)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:20.360362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:20.431710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987aab7e9b0448f190a44f10e851c162', 'request_id': 'req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.439821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987aab7e9b0448f190a44f10e851c162', 'request_id': 'req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.447610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987aab7e9b0448f190a44f10e851c162', 'request_id': 'req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.466283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] The token cache is being invalidate because project 987aab7e9b0448f190a44f10e851c162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:20.468496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.468496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.470164 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2748/5471] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:20 2022] DELETE /identity/v3/projects/987aab7e9b0448f190a44f10e851c162 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:20.474561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:20.485572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c467e-715f-4663-8614-92533a32c4b5 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:20.557160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:20.563823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:20.563823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:20.563823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] PATH_INFO: `/v3/users/66e416322ae34b408c1b1399a5c757b3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:20.563823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e416322ae34b408c1b1399a5c757b3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:20.563823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:20.573665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:20.642078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e416322ae34b408c1b1399a5c757b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.656144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e416322ae34b408c1b1399a5c757b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.664559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e416322ae34b408c1b1399a5c757b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.665345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e416322ae34b408c1b1399a5c757b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.681705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-049abfff-7c1b-4e89-a24e-99fd259164e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e416322ae34b408c1b1399a5c757b3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:20.703596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2724/5472] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:20 2022] DELETE /identity/v3/users/66e416322ae34b408c1b1399a5c757b3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:21.584467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:21.586787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:21.632747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3ce8-d4eb-4264-aecd-f5043ae7f31f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:21.776738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:21.778018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:21.778554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:21.779965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] PATH_INFO: `/v3/projects/b88b266dc2764ac28ebb5af097f784fb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:21.781701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88b266dc2764ac28ebb5af097f784fb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:21.784767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:21.827319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:21.908843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88b266dc2764ac28ebb5af097f784fb', 'request_id': 'req-374d26c6-137b-491a-8a99-434b8dd7b25b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:21.927671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88b266dc2764ac28ebb5af097f784fb', 'request_id': 'req-374d26c6-137b-491a-8a99-434b8dd7b25b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:21.937225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88b266dc2764ac28ebb5af097f784fb', 'request_id': 'req-374d26c6-137b-491a-8a99-434b8dd7b25b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:21.964825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] The token cache is being invalidate because project b88b266dc2764ac28ebb5af097f784fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:21.964952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:21.966203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-374d26c6-137b-491a-8a99-434b8dd7b25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:21.968846 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2749/5473] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:21 2022] DELETE /identity/v3/projects/b88b266dc2764ac28ebb5af097f784fb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:21.974709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:21.975792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:21.975792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.014359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:22.017147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:22.159021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2725/5474] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:22.169241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.169862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.170336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.208510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:22.210343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:22.240449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2750/5475] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:22.245923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.261797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a86c7-205a-477a-ab47-633302bc7db4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.280699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.281785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.282343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.283165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.284142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:22.284727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.286618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.304435 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2726/5476] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:22.309337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.324224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6f23d-280a-436f-bb19-235da84bdc02 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.330602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.332446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.332734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.333014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.333731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.335740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.407774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2751/5477] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:22 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:22.409125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.430349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8eef5-69d9-462d-abdb-79093b6b9a3a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.593926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.597757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.598451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.598975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.600511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.603252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.686656 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2727/5478] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:22 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:22.690051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.702135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c4523-0140-44f4-b82b-91aeaadd64cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.722191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.726953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.727484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.728146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.729539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.732841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.776736 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2752/5479] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:22.777015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.787477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:22.800160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c17d87-da92-497d-a46e-07cf6698eedf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.817807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.818527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.818814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.819103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.819898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.821590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff29070-0a84-46a6-8478-66f72851aa91 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.846558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2728/5480] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:22.852692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:22.874063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b791d-1608-4866-ba09-f5c18bf4f6de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:22.882780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:22.884792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.885213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.885684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] PATH_INFO: `/v3/projects/6aac55dc9f8b42fdab727167e7825b37/users/220be0b1662d4424b758dc7e646d1867/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:22.915019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aac55dc9f8b42fdab727167e7825b37, user_id=220be0b1662d4424b758dc7e646d1867, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:22.921235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:22.986022 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2753/5481] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:22 2022] PUT /identity/v3/projects/6aac55dc9f8b42fdab727167e7825b37/users/220be0b1662d4424b758dc7e646d1867/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:22.996960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:22.998065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:22.998606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:23.055275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] MFA Rules not processed for user `220be0b1662d4424b758dc7e646d1867`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:23.056871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:23.197142 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2729/5482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:23.226176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:23.228588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:23.384631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91bdc-6c6f-48bb-a4fa-5c8c2b343e1e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:23.401750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:23.404482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:23.406138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:23.424715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:23.455966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:23.457674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db100556-b440-41f9-ab0f-7039bc74c1c3 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:23.494494 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2754/5483] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:24.981744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:25.048746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace5f9f-ddeb-4c09-9e57-814c1a8c99ef None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:25.053980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:25.055040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:25.055360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:25.055666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] PATH_INFO: `/v3/users/220be0b1662d4424b758dc7e646d1867` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:25.057100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220be0b1662d4424b758dc7e646d1867)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:25.059346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:25.154742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220be0b1662d4424b758dc7e646d1867'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.155916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220be0b1662d4424b758dc7e646d1867'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.175793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220be0b1662d4424b758dc7e646d1867'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.177057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220be0b1662d4424b758dc7e646d1867'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.193731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220be0b1662d4424b758dc7e646d1867'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.210905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:25.221596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:25.222330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:25.222330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:25.239163 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2730/5484] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:24 2022] DELETE /identity/v3/users/220be0b1662d4424b758dc7e646d1867 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:25.263596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:25.265038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:25.373958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:25.418873 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2755/5485] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:25.444198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:25.446040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:25.521066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:25.528939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:25.538702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b2d8c-cb95-4bbb-962e-220fec48fdc0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:25.544840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:25.545929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:25.546313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:25.547905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:25.548450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117616f-4af6-4e7c-8d15-452507ad30b0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:25.559470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:25.560989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:25.563441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:25.565044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] PATH_INFO: `/v3/users/46e1dfe5c0a449a9ac73993816d01f10` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:25.567815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e1dfe5c0a449a9ac73993816d01f10)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:25.574502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:25.576552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:25.578782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115736df-f0ac-45be-a428-09d40576b988 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:25.612629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2731/5486] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:25.727102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e1dfe5c0a449a9ac73993816d01f10'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.753924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e1dfe5c0a449a9ac73993816d01f10'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.755445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e1dfe5c0a449a9ac73993816d01f10'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.759802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e1dfe5c0a449a9ac73993816d01f10'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.824140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e1dfe5c0a449a9ac73993816d01f10'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:25.885346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2756/5487] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:25 2022] DELETE /identity/v3/users/46e1dfe5c0a449a9ac73993816d01f10 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:25.891492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:25.891884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:25.892244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:25.966663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:25.970143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.080819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2732/5488] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:09:26.095547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:26.097623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.208862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dc55-9e9c-4748-b7ab-2485f5c3a004 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:26.215363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:26.216877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:26.217341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:26.217834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:26.238838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:26.240361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116888b-0959-47ea-8718-c0f9981440fc service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:26.253062 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2757/5489] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:26.504968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:26.504968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.514799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad94ea-0c17-45e4-8788-b9ee8aea5559 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:26.521958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:26.522473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:26.522829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:26.523180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] PATH_INFO: `/v3/projects/6aac55dc9f8b42fdab727167e7825b37` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:26.524550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aac55dc9f8b42fdab727167e7825b37)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:26.526825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:26.624327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aac55dc9f8b42fdab727167e7825b37', 'request_id': 'req-5596b75b-2bb0-4568-8992-4ccb12022760'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:26.641822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aac55dc9f8b42fdab727167e7825b37', 'request_id': 'req-5596b75b-2bb0-4568-8992-4ccb12022760'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:26.656156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aac55dc9f8b42fdab727167e7825b37', 'request_id': 'req-5596b75b-2bb0-4568-8992-4ccb12022760'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:26.684810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] The token cache is being invalidate because project 6aac55dc9f8b42fdab727167e7825b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:26.685226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:26.716086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:26.719612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2733/5490] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:26 2022] DELETE /identity/v3/projects/6aac55dc9f8b42fdab727167e7825b37 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:26.723034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70b15-7ef2-485c-bc0b-e67d9d5a76c0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:26.723343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70b15-7ef2-485c-bc0b-e67d9d5a76c0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:26.723862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee70b15-7ef2-485c-bc0b-e67d9d5a76c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:26.764758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8ee70b15-7ef2-485c-bc0b-e67d9d5a76c0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:26.766497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ee70b15-7ef2-485c-bc0b-e67d9d5a76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.811157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:26.813060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.871092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:26.920696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2758/5491] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:26.927445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596b75b-2bb0-4568-8992-4ccb12022760 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:26.928721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:26.929212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:26.929750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:26.932650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:26.933624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:26.934045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:26.934335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] PATH_INFO: `/v3/users/c7fbde1fc523414d9bbe535db7f70095` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:26.936160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fbde1fc523414d9bbe535db7f70095)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:26.938177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:26.943337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:26.962866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:26.970655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:26.996299 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2759/5492] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:27.002679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.041748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021533-4986-41a7-bb26-ba4abb23825a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.060289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fbde1fc523414d9bbe535db7f70095'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.061434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fbde1fc523414d9bbe535db7f70095'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.069322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.070261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.070461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fbde1fc523414d9bbe535db7f70095'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.070602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.070805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.071229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fbde1fc523414d9bbe535db7f70095'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.071958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:27.072228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.073912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.092684 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2760/5493] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:27.094157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.094830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fbde1fc523414d9bbe535db7f70095'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.096608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:27.110870 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2734/5494] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:26 2022] DELETE /identity/v3/users/c7fbde1fc523414d9bbe535db7f70095 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:27.115646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396ab7-dbe9-4573-ae25-e6eeca9ba89d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.142339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.144262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:27.192283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.192971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.193261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.194115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.194941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.198569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.248295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2761/5495] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:27 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:09:27.256268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.321493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825e7dd-a7ee-4582-9069-92c79fc9939b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.378210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51c5c-1800-4d7e-a227-e37d270f67bc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.387302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.388422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.388878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.390109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.390561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.396243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.414342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:27.471643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.472729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.472729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.472987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] PATH_INFO: `/v3/projects/a501fe31105d477f8b9d9491919add48` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.480498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a501fe31105d477f8b9d9491919add48)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.484402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2762/5496] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:27 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:27.487095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.508677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.532942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416a118-3e28-47a0-80f0-8b669cd7febf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.555434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.557735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.565601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.566537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.568388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.572349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.592431 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2763/5497] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:27.593495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.599316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:27.615645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a501fe31105d477f8b9d9491919add48', 'request_id': 'req-b135eeef-cb1d-4691-b8f7-c69141883754'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.620296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c124009-d08d-4e93-865f-d008bb923618 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.629958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a501fe31105d477f8b9d9491919add48', 'request_id': 'req-b135eeef-cb1d-4691-b8f7-c69141883754'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.646574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a501fe31105d477f8b9d9491919add48', 'request_id': 'req-b135eeef-cb1d-4691-b8f7-c69141883754'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.670806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] The token cache is being invalidate because project a501fe31105d477f8b9d9491919add48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:27.671212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.672446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:27.679065 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2735/5498] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:27 2022] DELETE /identity/v3/projects/a501fe31105d477f8b9d9491919add48 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:09:27.679065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.681714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:27.792813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:27.846378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135eeef-cb1d-4691-b8f7-c69141883754 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:27.851978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.852890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.853094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.853577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] PATH_INFO: `/v3/projects/1f5a1973383d43b78538311cfb1df87c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.864994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5a1973383d43b78538311cfb1df87c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.868443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:27.869172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:27.869563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:27.874408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:27.874408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:27.874408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.890392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:27.916084 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2736/5499] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:27.917456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:27.928943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:27.979948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72bc1-3139-4e2c-b95d-e2dc9c255a77 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:28.017121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5a1973383d43b78538311cfb1df87c', 'request_id': 'req-b56e6134-9e05-4376-883e-bca1da6f8c92'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.026197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:28.028118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.029626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.029948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] PATH_INFO: `/v3/users/9c11ee51d8c645b7b3548d69ae0ee9e5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.037973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c11ee51d8c645b7b3548d69ae0ee9e5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:28.038694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5a1973383d43b78538311cfb1df87c', 'request_id': 'req-b56e6134-9e05-4376-883e-bca1da6f8c92'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.045391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:28.048314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5a1973383d43b78538311cfb1df87c', 'request_id': 'req-b56e6134-9e05-4376-883e-bca1da6f8c92'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.076737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] The token cache is being invalidate because project 1f5a1973383d43b78538311cfb1df87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:28.079703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.083539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.086863 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2764/5500] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:27 2022] DELETE /identity/v3/projects/1f5a1973383d43b78538311cfb1df87c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:28.095281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:28.097088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:28.181313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c11ee51d8c645b7b3548d69ae0ee9e5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.184059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c11ee51d8c645b7b3548d69ae0ee9e5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.201651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c11ee51d8c645b7b3548d69ae0ee9e5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.203563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c11ee51d8c645b7b3548d69ae0ee9e5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.256377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-888876ab-7f5f-4f1b-8fd4-381830ab151e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c11ee51d8c645b7b3548d69ae0ee9e5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:28.258801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:28.286085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6134-9e05-4376-883e-bca1da6f8c92 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:28.293732 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2737/5501] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:27 2022] DELETE /identity/v3/users/9c11ee51d8c645b7b3548d69ae0ee9e5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:28.295369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470effed-f3fd-44ff-8881-c40b4634f294 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.295789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470effed-f3fd-44ff-8881-c40b4634f294 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.296184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470effed-f3fd-44ff-8881-c40b4634f294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.332786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:28.335893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.336223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.336513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] PATH_INFO: `/v3/projects/51b57968d11c4b6a9cc5f5dcb2d5b3e8/users/4f1b1569cab6432ead7e0cae1f5733e4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.337930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-470effed-f3fd-44ff-8881-c40b4634f294 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:28.343331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-470effed-f3fd-44ff-8881-c40b4634f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:28.372562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b57968d11c4b6a9cc5f5dcb2d5b3e8, user_id=4f1b1569cab6432ead7e0cae1f5733e4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:28.376627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabb836-77e7-4112-9028-1b52353b5085 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:28.407552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2765/5502] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:28 2022] PUT /identity/v3/projects/51b57968d11c4b6a9cc5f5dcb2d5b3e8/users/4f1b1569cab6432ead7e0cae1f5733e4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:28.414317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.415049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.415991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.505022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] MFA Rules not processed for user `4f1b1569cab6432ead7e0cae1f5733e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:28.507193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:28.560814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2738/5503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:28.562847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.563368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.563843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.592036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:28.594110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:28.636301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:28.687258 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2766/5504] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:28.713914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:28.717371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:28.773548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2739/5505] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:28.788235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:28.807491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1652d-3327-4a27-9caf-76fc81573ee3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:28.813955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:28.815643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.816104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.816235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.817097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:28.817455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:28.819564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:28.856530 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2740/5506] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:09:28.861835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:28.872649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1103a0-3742-4353-87c5-49fa3d23bec5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:28.877433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbca2a-9fcb-46e8-bbf7-ddb5d82e9022 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:28.881364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:28.883665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.884175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.884631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:28.885012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.889561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:28.889973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:28.890307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:28.891137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:28.896217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:28.903241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:28.913349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:28.938816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2767/5507] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:28.977710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2741/5508] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:28 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:28.979573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:29.006512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e6f0f-320d-45e8-ac94-507f76057833 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:29.086327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:29.088724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:29.191564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:29.192266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.192475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.192805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.193535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:29.197184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:29.239364 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2768/5509] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:28 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:29.244778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:29.253176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:29.263731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3a839-e1a3-408c-91ae-c1529033cb2f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:29.282694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04797b0-0769-41c9-9d3b-79802b4af3d0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:29.288610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:29.292149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.295874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.296262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] PATH_INFO: `/v3/projects/ee8652b129c7498d8280985e96f3d67d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.297771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8652b129c7498d8280985e96f3d67d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:29.309168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:29.314219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:29.315059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.315379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.315901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.316663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:29.319141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:29.347570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2769/5510] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:29.368645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:29.468410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbf9e-d63d-44b7-8a56-4d04611fe0bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:29.486680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:29.487373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.487712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.487976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.488740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:29.502320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:29.525485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8652b129c7498d8280985e96f3d67d', 'request_id': 'req-2233b1ea-b7e1-445f-859b-10b7f107f640'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:29.542987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2770/5511] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:29.548371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8652b129c7498d8280985e96f3d67d', 'request_id': 'req-2233b1ea-b7e1-445f-859b-10b7f107f640'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:29.549253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:29.568778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8652b129c7498d8280985e96f3d67d', 'request_id': 'req-2233b1ea-b7e1-445f-859b-10b7f107f640'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:29.583870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b755c71-889b-47e3-9d03-d94593d13f63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:29.612551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] The token cache is being invalidate because project ee8652b129c7498d8280985e96f3d67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:09:29.613214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:29.616985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2233b1ea-b7e1-445f-859b-10b7f107f640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:29.621702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2742/5512] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:29 2022] DELETE /identity/v3/projects/ee8652b129c7498d8280985e96f3d67d => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:29.627326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13a6c-094e-4db6-b6fe-61ad23e0935f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.628047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13a6c-094e-4db6-b6fe-61ad23e0935f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.643105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c13a6c-094e-4db6-b6fe-61ad23e0935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.675403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82c13a6c-094e-4db6-b6fe-61ad23e0935f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:29.677774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82c13a6c-094e-4db6-b6fe-61ad23e0935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:29.751443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:29.753161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.753662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.754108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] PATH_INFO: `/v3/projects/0f2b7449c8de4c6eba0e9b7c174856e1/users/3467d447a572424f9c6cd56c5fa7e0c4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.759956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:29.793346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b7449c8de4c6eba0e9b7c174856e1, user_id=3467d447a572424f9c6cd56c5fa7e0c4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:29.807700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1380a03-20a9-4d51-9671-e12bc7acfee1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:29.831648 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2743/5513] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:29.838033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.838739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.839183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.852730 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2771/5514] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:29 2022] PUT /identity/v3/projects/0f2b7449c8de4c6eba0e9b7c174856e1/users/3467d447a572424f9c6cd56c5fa7e0c4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:29.863157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:29.863157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:29.863157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:29.904518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:29.907938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:29.909727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:29.911280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:30.084919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2744/5515] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:30.090620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.101573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2772/5516] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:30.102075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20386-0896-4b9e-81e8-c73a3fe9d1da None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.108967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.109872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.110254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.110663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.111599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:09:30.112092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.114322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.131873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2745/5517] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:09:30.141790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.181291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.185167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878e724-8439-4dd9-ba74-e5846ad42e79 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.202055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:30.212759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.213744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.215424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.220000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.223911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.232043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.309650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:30.342257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2773/5518] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:30 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:30.343147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.440979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7195bb-0683-46e0-95c7-17751499ea9c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.578823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcfce5-cd1c-4815-a152-b3e962d6f675 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.594228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.595495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.596098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.596637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.597617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.618719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.618872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.619562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.619855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.620082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.640665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.643060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.679143 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2774/5519] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:30 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:30.685453 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2746/5520] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:30.694670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.743562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b412e0-33e0-41d3-beca-a2afac892d88 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.760796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.761910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.762233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.762535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.763501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.768221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.808804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2775/5521] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:30.809050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.829425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0fd0-a81f-4e88-9def-36d4db979ba1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.834666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.835437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.835779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.836044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.836873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.841084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a4cab-a22a-4347-8687-04a5eb8793b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:30.876925 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2747/5522] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:30.881499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:30.899865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69d939-a26e-435a-84bf-f01a1cfb505b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:30.916811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:30.917985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:30.918244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:30.918529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] PATH_INFO: `/v3/projects/1a01ac6edadc450fa3a64a3f05ec5f9c/users/3ee5f6d6bc4c4b6aa403f6c9576fe49a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:30.961356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a01ac6edadc450fa3a64a3f05ec5f9c, user_id=3ee5f6d6bc4c4b6aa403f6c9576fe49a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:30.982299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:31.044402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2776/5523] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:30 2022] PUT /identity/v3/projects/1a01ac6edadc450fa3a64a3f05ec5f9c/users/3ee5f6d6bc4c4b6aa403f6c9576fe49a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:31.055101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:31.055438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:31.055711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:31.088229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] MFA Rules not processed for user `3ee5f6d6bc4c4b6aa403f6c9576fe49a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:31.090010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:31.296646 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2748/5524] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:31.297632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:31.383623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:31.546295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29403c0-553a-4c66-9d64-cb676478f47c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:31.568451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:31.568451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:31.568451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:31.568451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:31.569003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:31.570104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:31.638153 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2777/5525] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:09:31 2022] POST /identity/v3/projects => generated 385 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:09:31.642563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:31.685298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef5059-d992-476d-b945-0c9418f59bdf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:31.849067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:31.865125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:31.871950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:31.872305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:31.873560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:31.874333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:31.876507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:31.950374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:31.951867 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2749/5526] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:09:31 2022] POST /identity/v3/users => generated 299 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:09:31.967667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bab7c-8c75-4ef6-bafd-7f743ef60658 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:31.991646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:31.992639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:31.992639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:31.994222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:31.994222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:31.995947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:32.029469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2778/5527] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:09:32.029696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:32.063640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398cd23-6211-4d77-826f-b497239cebec admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:32.078045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:32.079929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:32.081140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:32.081835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] PATH_INFO: `/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff/users/efbbd8a07a60455abc974225c307ac02/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:32.142182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1de57afe7e4f508c4cc8739f72b5ff, user_id=efbbd8a07a60455abc974225c307ac02, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:32.149460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:32.237960 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2750/5528] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:32 2022] PUT /identity/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff/users/efbbd8a07a60455abc974225c307ac02/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:32.238368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:32.257697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccd32c-28a5-48c1-82f8-7a29ecb7c114 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:32.417099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:32.420295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:32.420431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:32.420742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:32.421753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:32.423604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274cf6d-a965-4147-8b43-485787459874 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:32.452726 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2779/5529] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:09:32.454305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:32.468052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7311ee-6da5-4827-8c48-e07238073822 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:32.484910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:32.486017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:32.486188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:32.486418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] PATH_INFO: `/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff/users/efbbd8a07a60455abc974225c307ac02/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:32.492491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1de57afe7e4f508c4cc8739f72b5ff, user_id=efbbd8a07a60455abc974225c307ac02, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:32.495579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:32.521556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2751/5530] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:09:32 2022] PUT /identity/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff/users/efbbd8a07a60455abc974225c307ac02/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:09:32.535935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62657-cbe9-41b6-bc9a-ad0954b234d6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:32.535935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62657-cbe9-41b6-bc9a-ad0954b234d6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:32.535935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62657-cbe9-41b6-bc9a-ad0954b234d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:32.604236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-74e62657-cbe9-41b6-bc9a-ad0954b234d6 None None] MFA Rules not processed for user `efbbd8a07a60455abc974225c307ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:32.609533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-74e62657-cbe9-41b6-bc9a-ad0954b234d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:32.865260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2780/5531] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:32.973088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:33.160585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c632ac-5260-432f-844e-b95315228554 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:33.180354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:33.186074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:33.186610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:33.187085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:33.425532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:33.427030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725fc4f-70be-4f7c-9b97-3f6a96996498 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:33.458743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2752/5532] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:35.333290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:35.334182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:35.334835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:35.418355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:35.449458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] MFA Rules not processed for user `3467d447a572424f9c6cd56c5fa7e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:35.451899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:35.779279 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2781/5533] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:35.800387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:35.801154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:35.801154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:35.824501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] MFA Rules not processed for user `3467d447a572424f9c6cd56c5fa7e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:35.826772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:35.864857 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2753/5534] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:35.959190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:35.975501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:36.289108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9812d18-0d3f-4aa5-b7c2-60d837df25c2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:36.305330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:36.309195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:36.309494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:36.309787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:36.340443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:36.348431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b54272-a7f7-487a-b9ad-177dba96f1af service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:36.364961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2782/5535] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:09:37.910098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:37.911580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:37.971330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d5188-510f-418f-8d49-6875fdec80c5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:37.986246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:37.987261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:37.987747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:37.988770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:38.039050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:38.046365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:38.079731 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2754/5536] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:46.358977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=61 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:48.065905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:52.579752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675095c-233b-45b3-b0ab-291fa66cdb98 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:52.580264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675095c-233b-45b3-b0ab-291fa66cdb98 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:52.580335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675095c-233b-45b3-b0ab-291fa66cdb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:52.605235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4675095c-233b-45b3-b0ab-291fa66cdb98 None None] MFA Rules not processed for user `f290b5d01a074e2c9859488bd4ff1162`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:52.606962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4675095c-233b-45b3-b0ab-291fa66cdb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:52.746828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2783/5537] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:54.709268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:54.726484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667a4ba-c1bd-48cc-8870-47878c12678f service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:54.735807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:54.736983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:54.737332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:54.738035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:54.743462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:54.764496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:54.767138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:54.786799 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2755/5538] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:55.631142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cde7-8686-4adb-b6f5-1cbffbfa32d3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:55.632318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cde7-8686-4adb-b6f5-1cbffbfa32d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:55.638230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314cde7-8686-4adb-b6f5-1cbffbfa32d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:55.678636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0314cde7-8686-4adb-b6f5-1cbffbfa32d3 None None] MFA Rules not processed for user `ecdc2e5bf2e3492bb5320e054641ec3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:09:55.680037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0314cde7-8686-4adb-b6f5-1cbffbfa32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:55.768239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2784/5539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:09:59.571621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:09:59.573426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:09:59.807033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f648c6-ae6f-4564-9612-2c0e5576e227 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:09:59.816239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:09:59.817242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:09:59.817608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:09:59.817959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] PATH_INFO: `/v3/users/14f03605fadb4a819444a497e7a2805f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:09:59.819398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f03605fadb4a819444a497e7a2805f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:09:59.829432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:09:59.932170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f03605fadb4a819444a497e7a2805f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:59.932566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f03605fadb4a819444a497e7a2805f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:59.957174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f03605fadb4a819444a497e7a2805f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:59.958078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f03605fadb4a819444a497e7a2805f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:09:59.985240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f03605fadb4a819444a497e7a2805f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:00.012975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2756/5540] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:09:59 2022] DELETE /identity/v3/users/14f03605fadb4a819444a497e7a2805f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:00.019215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:00.019772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:00.019888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:00.060677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:00.062499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:00.216422 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2785/5541] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:00.235324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:00.237155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:00.414771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585d74-17a7-4ed8-9b28-a98e15d45596 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:00.429265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:00.430154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:00.430442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:00.430726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:00.456919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:00.458317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a752c-6234-4073-b342-4731e6a28621 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:00.497851 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2757/5542] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:02.152197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:02.153887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:02.199415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b070d27-9d8b-4163-b5b4-9948899f41ef None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:02.205667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:02.206774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.207204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.207743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] PATH_INFO: `/v3/projects/78708ead8abd482bab61be479bae7912` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.211602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78708ead8abd482bab61be479bae7912)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:02.227496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:02.323419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:02.326523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78708ead8abd482bab61be479bae7912', 'request_id': 'req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:02.343091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78708ead8abd482bab61be479bae7912', 'request_id': 'req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:02.357840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78708ead8abd482bab61be479bae7912', 'request_id': 'req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:02.400844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] The token cache is being invalidate because project 78708ead8abd482bab61be479bae7912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:02.401594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:02.402891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4a46df0-8a6e-4b8e-b35d-240dc3bd3d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:02.407124 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2786/5543] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:02 2022] DELETE /identity/v3/projects/78708ead8abd482bab61be479bae7912 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:02.411955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.412790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.413220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.452818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:02.454097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:02.466120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:02.606364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2758/5544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:02.609050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.609458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.609846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.646955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:02.649363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:02.673764 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2787/5545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:02.678141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:02.692459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1df76-9d40-4597-a444-bd640d6c1277 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:02.707896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:02.708601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.708890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.709171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.709919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:02.710232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:02.711924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:02.739768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2759/5546] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:02.744319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:02.758991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a4e7a-c053-4dc5-b6f2-d1163bf67e18 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:02.771127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:02.771841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.772284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.772702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.773549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:02.777801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:02.838880 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2788/5547] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:02 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:02.842850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:02.853466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a5bc-36f4-40ca-8b43-231ad0beb3fa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:02.961870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:02.963454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:02.963781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:02.964076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:02.964781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:02.967427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:02.999821 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2760/5548] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:02 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:03.002247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:03.021245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871e9bf-4482-4bf3-accb-d648e6788865 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:03.036689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:03.037970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.038457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.038944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.039825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:03.041596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:03.053719 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2789/5549] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:03.069386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:03.083039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb94d-b0fa-45e3-99ff-bf14330de5e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:03.089620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:03.090769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.090769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.090989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.092164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:03.093786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae9b38-cd89-400e-b69a-0f2e9de1ad1e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:03.111560 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2761/5550] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:03.116649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:03.130064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab271a1-0107-425d-a30f-dab35477c820 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:03.134961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:03.135922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.136204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.136480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] PATH_INFO: `/v3/projects/0ebc1fa3a265424a92ef0da268ed1cf3/users/f5c59cebe7c64d08b95e6ca55ab35171/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.156298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebc1fa3a265424a92ef0da268ed1cf3, user_id=f5c59cebe7c64d08b95e6ca55ab35171, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:03.159364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:03.192907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.193271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.193652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.195093 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2790/5551] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:03 2022] PUT /identity/v3/projects/0ebc1fa3a265424a92ef0da268ed1cf3/users/f5c59cebe7c64d08b95e6ca55ab35171/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:03.227683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] MFA Rules not processed for user `f5c59cebe7c64d08b95e6ca55ab35171`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:03.229388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:03.327211 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2762/5552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:03.336359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:03.338622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:03.439372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7abe1-d143-4ed6-a3ae-b9e582cc52d8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:03.443881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:03.444597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.444831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.445530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.458990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:03.461219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c79b-1491-4546-b275-b01a9de6763f service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:03.473588 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2791/5553] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:03.513793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:03.521618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:03.628615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81286-ba2d-46e0-95e0-61cf8105ddb3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:03.634411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:03.635330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.635647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.636220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] PATH_INFO: `/v3/users/f5c59cebe7c64d08b95e6ca55ab35171` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.637553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c59cebe7c64d08b95e6ca55ab35171)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:03.640300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:03.725112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c59cebe7c64d08b95e6ca55ab35171'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:03.725862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c59cebe7c64d08b95e6ca55ab35171'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:03.736175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c59cebe7c64d08b95e6ca55ab35171'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:03.736875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c59cebe7c64d08b95e6ca55ab35171'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:03.760169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c59cebe7c64d08b95e6ca55ab35171'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:03.796618 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2763/5554] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:03 2022] DELETE /identity/v3/users/f5c59cebe7c64d08b95e6ca55ab35171 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:03.800095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:03.800400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:03.800685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:03.835365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:03.836972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:03.978270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2792/5555] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:04.136023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:04.137546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:04.261163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80468-4e62-428a-b657-513d5495278d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:04.270703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:04.271387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:04.272016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:04.272277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:04.297980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:04.301531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e696e-f2d7-493d-8498-36245c6a1158 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:04.332599 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2764/5556] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:06.879063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:06.881706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:06.897803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e798c6-c44a-4bf3-9142-5da71814a804 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:06.903199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:06.904542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:06.904944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:06.905363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] PATH_INFO: `/v3/projects/0ebc1fa3a265424a92ef0da268ed1cf3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:06.906936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebc1fa3a265424a92ef0da268ed1cf3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:06.909272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:06.919242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:06.993321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebc1fa3a265424a92ef0da268ed1cf3', 'request_id': 'req-0dc3d11a-4124-4176-b380-6e9eab1749b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.009259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebc1fa3a265424a92ef0da268ed1cf3', 'request_id': 'req-0dc3d11a-4124-4176-b380-6e9eab1749b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.027050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebc1fa3a265424a92ef0da268ed1cf3', 'request_id': 'req-0dc3d11a-4124-4176-b380-6e9eab1749b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.053768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] The token cache is being invalidate because project 0ebc1fa3a265424a92ef0da268ed1cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:07.054139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.058523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.060926 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2793/5557] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:06 2022] DELETE /identity/v3/projects/0ebc1fa3a265424a92ef0da268ed1cf3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:07.065897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405633a-d5f6-4f6b-ab61-11ec0a92f40f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.066945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405633a-d5f6-4f6b-ab61-11ec0a92f40f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.067373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405633a-d5f6-4f6b-ab61-11ec0a92f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.096232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2405633a-d5f6-4f6b-ab61-11ec0a92f40f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:07.097493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2405633a-d5f6-4f6b-ab61-11ec0a92f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.133227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:07.186503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.188813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.217986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2765/5558] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:07.219923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.220387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.220832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.260326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:07.262941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.290192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3d11a-4124-4176-b380-6e9eab1749b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.292327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2766/5559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:07.293538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.295874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.297659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.297659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.298068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] PATH_INFO: `/v3/users/3ee5f6d6bc4c4b6aa403f6c9576fe49a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.299476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee5f6d6bc4c4b6aa403f6c9576fe49a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.302953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.310060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad562-d11c-4c65-8d7b-f9eea4c15226 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.317399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.318444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.318967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.319692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.329226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:07.329850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.332086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.392558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2767/5560] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:07.392701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee5f6d6bc4c4b6aa403f6c9576fe49a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.400372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.412990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee5f6d6bc4c4b6aa403f6c9576fe49a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.414641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee5f6d6bc4c4b6aa403f6c9576fe49a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.420209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee5f6d6bc4c4b6aa403f6c9576fe49a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.436671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abd2b4-d55a-417d-910e-d86f31e4cda6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.450657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.452031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.452396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.452779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.453664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.456017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.456491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9b07272f-86ec-450f-820b-ecf1b059ab8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee5f6d6bc4c4b6aa403f6c9576fe49a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:07.506263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2768/5561] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:07 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:07.510552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.517771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2794/5562] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:07 2022] DELETE /identity/v3/users/3ee5f6d6bc4c4b6aa403f6c9576fe49a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:07.519194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.521782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.526349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.526349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.572928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:07.576509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.593126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:07.625781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8d9d-4cb7-43e1-bdd7-86e2efd8a56e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.714518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.716499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.716865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.717243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.718297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.720897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.722210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2795/5563] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:07.756508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.759856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:07.775057 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2769/5564] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:07 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:07.776543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.796833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43f616-2d26-4b21-b8f1-fdd4089d6187 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.804013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.806464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.806875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.807352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.808273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.810761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.848768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2770/5565] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:07.849779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.874466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddedc5-0d1d-40d4-8b9a-a114a2e07349 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.877825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c6a47-ffd0-48cc-b9de-4ccc1d8fa4df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.883928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.885484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.885773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.886361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.890736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.891715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.894945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.895794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.896753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.899159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.902346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.904860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4dec-11ef-4bcf-90af-17f6e8514f30 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:07.913830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:07.929878 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2771/5566] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:07.930806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:07.937515 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2796/5567] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:07.945368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0225ea-b5c0-406f-b3bd-ea78be56587c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:07.952731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:07.953811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:07.954200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:07.954380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] PATH_INFO: `/v3/projects/241876e358514965aadcc36146a30265/users/0678a3e330f449d8acf9c01cda1808be/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:07.976886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241876e358514965aadcc36146a30265, user_id=0678a3e330f449d8acf9c01cda1808be, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:07.979706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:08.039726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2772/5568] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:07 2022] PUT /identity/v3/projects/241876e358514965aadcc36146a30265/users/0678a3e330f449d8acf9c01cda1808be/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:08.043883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:08.044403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:08.044673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:08.099463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] MFA Rules not processed for user `0678a3e330f449d8acf9c01cda1808be`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:08.100758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:08.251661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2797/5569] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:08.266152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:08.271522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:08.356169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd5ff-137d-41ca-9201-45c95ea16219 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:08.361889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:08.362707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:08.363121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:08.363664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:08.382817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:08.385472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:08.405758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2773/5570] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:09.483111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:09.484628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:09.626361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:09.660574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634f8c4-4b73-4f13-89ed-0b44d4c3c1b7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:09.671898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:09.674274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:09.674774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:09.675415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] PATH_INFO: `/v3/projects/1a01ac6edadc450fa3a64a3f05ec5f9c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:09.677392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a01ac6edadc450fa3a64a3f05ec5f9c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:09.680155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:09.802739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a01ac6edadc450fa3a64a3f05ec5f9c', 'request_id': 'req-048851db-38c4-42eb-9766-9dc448b08014'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:09.821151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a01ac6edadc450fa3a64a3f05ec5f9c', 'request_id': 'req-048851db-38c4-42eb-9766-9dc448b08014'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:09.833058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a01ac6edadc450fa3a64a3f05ec5f9c', 'request_id': 'req-048851db-38c4-42eb-9766-9dc448b08014'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:09.873812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] The token cache is being invalidate because project 1a01ac6edadc450fa3a64a3f05ec5f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:09.875612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:09.879715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-048851db-38c4-42eb-9766-9dc448b08014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:09.886968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2798/5571] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:09 2022] DELETE /identity/v3/projects/1a01ac6edadc450fa3a64a3f05ec5f9c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:09.894680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:09.908841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771ea9-ef98-47cb-a173-d37ccf3c70cb service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:10.012773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:10.013927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:10.014259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:10.014542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] PATH_INFO: `/v3/users/efbbd8a07a60455abc974225c307ac02` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:10.015946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbbd8a07a60455abc974225c307ac02)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:10.018420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:10.089493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbbd8a07a60455abc974225c307ac02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.090700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbbd8a07a60455abc974225c307ac02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.109622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbbd8a07a60455abc974225c307ac02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.110389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbbd8a07a60455abc974225c307ac02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.128511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262518e3-5e2d-4f7a-918c-162eb7b0a304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbbd8a07a60455abc974225c307ac02'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.148380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:10.160357 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2774/5572] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:09 2022] DELETE /identity/v3/users/efbbd8a07a60455abc974225c307ac02 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:10.231018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:10.231306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:10.232042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:10.261272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] MFA Rules not processed for user `0678a3e330f449d8acf9c01cda1808be`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:10.264764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:10.353406 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2799/5573] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:10.631658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000464-0373-4382-9b13-da7ec0adfe1b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:10.631952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000464-0373-4382-9b13-da7ec0adfe1b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:10.632229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000464-0373-4382-9b13-da7ec0adfe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:10.652727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e0000464-0373-4382-9b13-da7ec0adfe1b None None] MFA Rules not processed for user `3467d447a572424f9c6cd56c5fa7e0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:10.653966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0000464-0373-4382-9b13-da7ec0adfe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:10.736384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2775/5574] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:10.762402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:10.764163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:10.887030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e233e1c-eb65-4941-8ec7-1b17d29478ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:10.892445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:10.893565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:10.894279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:10.895369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] PATH_INFO: `/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:10.897549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1de57afe7e4f508c4cc8739f72b5ff)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:10.900836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:10.947341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:10.975127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1de57afe7e4f508c4cc8739f72b5ff', 'request_id': 'req-15aab22f-65fb-41eb-906f-fb4a0f4867d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.983063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1de57afe7e4f508c4cc8739f72b5ff', 'request_id': 'req-15aab22f-65fb-41eb-906f-fb4a0f4867d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:10.991128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1de57afe7e4f508c4cc8739f72b5ff', 'request_id': 'req-15aab22f-65fb-41eb-906f-fb4a0f4867d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:11.010068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] The token cache is being invalidate because project ed1de57afe7e4f508c4cc8739f72b5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:11.010068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:11.010530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-15aab22f-65fb-41eb-906f-fb4a0f4867d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:11.016433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2800/5575] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:10 2022] DELETE /identity/v3/projects/ed1de57afe7e4f508c4cc8739f72b5ff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:11.019277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.020842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.021607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.054197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:11.055568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:11.140909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2776/5576] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:11.151244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.151648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.151995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.192357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:11.193592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:11.216312 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2801/5577] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:11.220467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.235524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fec10-7c07-4eb1-a549-00c1d51806c1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.246245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.247469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.247791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.248076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.248813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:11.249129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.250771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.279758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2777/5578] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:11.284258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.307423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6212a-2ed8-41a1-952b-f71b0f151ece None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.327444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.328168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.337937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.338412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.340212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.342208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.426096 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2802/5579] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:11 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:11.430553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.452465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021d25d-2988-4735-9e46-5405443dd5dc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.546626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.547767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.548231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.549152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.550107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.567959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.625835 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2778/5580] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:11 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:11.629955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.652948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabd8b-9785-44b8-8320-fedcdc5d2a9e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.670477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.671178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.671550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.672045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.672885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.675990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.704659 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2803/5581] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:10:11.708209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.731246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a207c8-d0b8-4a50-8510-f4f159f3ef96 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.736890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.737918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.738404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.739675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.741582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.744444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857d001-bbe5-41e5-8b77-91b18693699b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.769434 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2779/5582] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:10:11.773631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:11.791456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e096c6-3290-4c18-88aa-a0651c0e4a5d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:11.798410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:11.799831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.800370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.800842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] PATH_INFO: `/v3/projects/3110464275344d0abfdbcfa53e421aa9/users/e86978e35bd24a12a9a1c4250547bf97/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.823198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3110464275344d0abfdbcfa53e421aa9, user_id=e86978e35bd24a12a9a1c4250547bf97, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:11.827413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:11.878532 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2804/5583] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:11 2022] PUT /identity/v3/projects/3110464275344d0abfdbcfa53e421aa9/users/e86978e35bd24a12a9a1c4250547bf97/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:10:11.889689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:11.890132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:11.890490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:11.937659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:11.965099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] MFA Rules not processed for user `e86978e35bd24a12a9a1c4250547bf97`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:11.966469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:12.112923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2780/5584] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:12.117062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.228693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03f26-8b6e-49db-849a-ee5284b6263e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.237024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.237800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.238086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.238585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.239700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.242630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.303018 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2805/5585] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:12 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:12.307464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.327425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a37b-13e4-4507-93af-bb7a35b6ed30 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.472480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.473987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.475557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.475961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.477579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.484577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.539347 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2781/5586] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:12 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:12.542663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.570874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623988c-0a9e-449a-96c5-19dc5cb4742d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.596275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.597125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.598158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.598458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.599568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.601351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.619426 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2806/5587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:10:12.624075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.646576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1836c-09c1-4f1b-8176-999be52a2e9b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.652406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.654318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.654601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.654881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] PATH_INFO: `/v3/projects/d6c50cc5465048d78cae70d5dfb31886/users/261b818f29ff45a7817ab6a4de81c425/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.676366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c50cc5465048d78cae70d5dfb31886, user_id=261b818f29ff45a7817ab6a4de81c425, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.680909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.698908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2782/5588] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:12 2022] PUT /identity/v3/projects/d6c50cc5465048d78cae70d5dfb31886/users/261b818f29ff45a7817ab6a4de81c425/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:12.703744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.720686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ae10-09dd-4f50-9e75-b0feee0826d2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.754636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.756508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:12.757327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:12.848019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.850000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.851621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.852557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.853972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.857646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.876463 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2807/5589] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:12.882039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:12.888401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a715b-22c7-4581-b4f0-a4912a5f9355 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.897244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da4881-0336-41bd-9d2c-9d66637b08cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:12.898421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.903249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.903585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.903714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:12.903906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.904720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.905226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.905514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] PATH_INFO: `/v3/projects/d6c50cc5465048d78cae70d5dfb31886/users/261b818f29ff45a7817ab6a4de81c425/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.906372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:12.911398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c50cc5465048d78cae70d5dfb31886, user_id=261b818f29ff45a7817ab6a4de81c425, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.916795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfed600-04b0-4790-922f-cd24f17c7471 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.940297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2808/5590] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:12 2022] PUT /identity/v3/projects/d6c50cc5465048d78cae70d5dfb31886/users/261b818f29ff45a7817ab6a4de81c425/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:12.943717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:12.944212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:12.944487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:12.957722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:12.971676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:12.974713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:12.990897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] MFA Rules not processed for user `261b818f29ff45a7817ab6a4de81c425`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:12.992477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:13.006785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2783/5591] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:13.159442 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2809/5592] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:13.182204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:13.185574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:13.430558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a74f9-182a-4ab7-8863-d53922eb8934 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:13.575334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:13.591665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:13.592165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:13.592595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:13.632314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:13.634273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a54d6-8af0-4e6c-97ad-543a46f29eb7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:13.664191 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2784/5593] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:15.822495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:15.824565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:15.934945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7848-e804-48aa-a884-bb82fa804cc3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:15.949049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:15.965607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:15.966292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:15.967887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] PATH_INFO: `/v3/users/4f1b1569cab6432ead7e0cae1f5733e4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:15.971836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1b1569cab6432ead7e0cae1f5733e4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:15.980747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:16.077792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:16.096116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1b1569cab6432ead7e0cae1f5733e4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:16.123318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1b1569cab6432ead7e0cae1f5733e4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:16.124590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1b1569cab6432ead7e0cae1f5733e4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:16.126505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1b1569cab6432ead7e0cae1f5733e4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:16.179460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1b1569cab6432ead7e0cae1f5733e4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:16.209087 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2810/5594] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:15 2022] DELETE /identity/v3/users/4f1b1569cab6432ead7e0cae1f5733e4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:16.214849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:16.216091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:16.216603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:16.257730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:16.265055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:16.450849 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2785/5595] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:16.524271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:16.526574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:16.635275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348f87b-30e9-4789-8ce0-4ccb8681c71d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:16.639257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:16.639973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:16.640270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:16.640691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:16.656902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:16.659085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:16.673959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2811/5596] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:18.350640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.353828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.374563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b153bf-fb49-4c7d-ac63-69fdd842cdd3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:18.381822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.384346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.399869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71137-03b5-487e-815d-b203249eb592 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:18.400286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:18.401181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.401460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.401735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] PATH_INFO: `/v3/projects/51b57968d11c4b6a9cc5f5dcb2d5b3e8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.403316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b57968d11c4b6a9cc5f5dcb2d5b3e8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:18.405821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:18.417120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:18.418532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.418532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.418737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] PATH_INFO: `/v3/users/e86978e35bd24a12a9a1c4250547bf97` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.421449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86978e35bd24a12a9a1c4250547bf97)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:18.423364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:18.504460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:18.506867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b57968d11c4b6a9cc5f5dcb2d5b3e8', 'request_id': 'req-86d6d196-938c-4960-bc73-fae1d69a7ad0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.517844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86978e35bd24a12a9a1c4250547bf97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.527121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86978e35bd24a12a9a1c4250547bf97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.528271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86978e35bd24a12a9a1c4250547bf97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.529450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86978e35bd24a12a9a1c4250547bf97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.529786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b57968d11c4b6a9cc5f5dcb2d5b3e8', 'request_id': 'req-86d6d196-938c-4960-bc73-fae1d69a7ad0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.541594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b57968d11c4b6a9cc5f5dcb2d5b3e8', 'request_id': 'req-86d6d196-938c-4960-bc73-fae1d69a7ad0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.546703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4897e9ea-8403-403f-93b0-e3032844fb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86978e35bd24a12a9a1c4250547bf97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.576865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] The token cache is being invalidate because project 51b57968d11c4b6a9cc5f5dcb2d5b3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:18.578303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.582477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2812/5597] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:18 2022] DELETE /identity/v3/users/e86978e35bd24a12a9a1c4250547bf97 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:18.582953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86d6d196-938c-4960-bc73-fae1d69a7ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:18.586057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.586361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.587458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.587796 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2786/5598] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:18 2022] DELETE /identity/v3/projects/51b57968d11c4b6a9cc5f5dcb2d5b3e8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:18.592373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7ef8-e156-4fc0-b588-42a6440fbf28 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.592812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7ef8-e156-4fc0-b588-42a6440fbf28 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.593153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7ef8-e156-4fc0-b588-42a6440fbf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.630383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9c1c7ef8-e156-4fc0-b588-42a6440fbf28 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:18.631682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9c1c7ef8-e156-4fc0-b588-42a6440fbf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.637323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:18.638788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.667820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:18.739720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2787/5599] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:18.748817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea620-c13a-481c-be09-84e962c836fb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.749009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea620-c13a-481c-be09-84e962c836fb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.749288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ea620-c13a-481c-be09-84e962c836fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.787073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2813/5600] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:18.791502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-432ea620-c13a-481c-be09-84e962c836fb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:18.792753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-432ea620-c13a-481c-be09-84e962c836fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.805936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.811729 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2788/5601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:18.817510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b313c69-c230-460c-bc48-6cbad8921998 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:18.822602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:18.823293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.823634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.823921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.827811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:18.828287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:18.829976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:18.840603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea620-c13a-481c-be09-84e962c836fb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.842074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-432ea620-c13a-481c-be09-84e962c836fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:18.865317 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2814/5602] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:18.870820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.899364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e9d5-3273-4c91-94a2-dfaf7d55bff4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:18.907255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:18.908785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.909209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.909611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.910687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:18.916083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:18.949554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ea620-c13a-481c-be09-84e962c836fb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:18.953781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:18.954382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:18.954674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:18.954944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:18.965730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:18.967382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:18.973061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2815/5603] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:18 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:18.976986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:18.984401 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2789/5604] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:10:19.067783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3264878-1858-4a3c-a3a9-353dbd53d5c7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:19.073899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:19.074605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.074889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.075183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.075941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:19.078353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:19.129049 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2816/5605] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:18 2022] POST /identity/v3/users => generated 280 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:19.134217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:19.146729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1941a-9074-40f8-9a1f-65eb7bd7ced1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:19.151776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:19.152803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.152803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.153080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.153810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:19.155443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:19.173453 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2790/5606] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:19.174424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:19.185689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194396f-9a2e-4961-9a21-28d80ab312b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:19.190848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:19.191559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.191851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.192280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.193901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:19.195568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8123d-204d-4c12-90a9-58b2da7da7b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:19.210553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2817/5607] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:10:19.212332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:19.225930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a9a7-7319-470b-a7f7-1732fc123ba9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:19.232230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:19.233266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.233548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.233824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] PATH_INFO: `/v3/projects/5351e3b9509e462b8e004a6cd6e138be/users/99094a55fffa4edc8377630f3229cc02/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.251669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5351e3b9509e462b8e004a6cd6e138be, user_id=99094a55fffa4edc8377630f3229cc02, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:19.254332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:19.281068 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2791/5608] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:19 2022] PUT /identity/v3/projects/5351e3b9509e462b8e004a6cd6e138be/users/99094a55fffa4edc8377630f3229cc02/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:19.293864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.294244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.294580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.333622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] MFA Rules not processed for user `99094a55fffa4edc8377630f3229cc02`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:19.335877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:19.468385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:19.474415 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2818/5609] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:19.500284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:19.503362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:19.609528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:19.650044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02b6ac-2e17-4827-8056-8a4b6cf9c40f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:19.660698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:19.667847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:19.669006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:19.669505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:19.684790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:19.688022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:19.702395 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2792/5610] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:21.382287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:21.390299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:21.617748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a529b2-8f72-4b17-b788-dddf90f1aafa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:21.634320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:21.635233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:21.635535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:21.635830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] PATH_INFO: `/v3/projects/3110464275344d0abfdbcfa53e421aa9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:21.637094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3110464275344d0abfdbcfa53e421aa9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:21.641903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:21.731630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3110464275344d0abfdbcfa53e421aa9', 'request_id': 'req-6f154a0d-bff7-47a9-b471-eab7fba0f62c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.745341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3110464275344d0abfdbcfa53e421aa9', 'request_id': 'req-6f154a0d-bff7-47a9-b471-eab7fba0f62c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.753270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3110464275344d0abfdbcfa53e421aa9', 'request_id': 'req-6f154a0d-bff7-47a9-b471-eab7fba0f62c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.772333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] The token cache is being invalidate because project 3110464275344d0abfdbcfa53e421aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:21.772716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.773443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.775579 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2819/5611] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:21 2022] DELETE /identity/v3/projects/3110464275344d0abfdbcfa53e421aa9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:21.779739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:21.792244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d85bb5-bfa1-4ee3-8026-ca968ad2e348 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:21.863848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:21.864691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:21.864968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:21.865369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] PATH_INFO: `/v3/users/261b818f29ff45a7817ab6a4de81c425` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:21.866608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261b818f29ff45a7817ab6a4de81c425)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:21.868665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:21.934262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261b818f29ff45a7817ab6a4de81c425'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.935080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261b818f29ff45a7817ab6a4de81c425'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.943440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261b818f29ff45a7817ab6a4de81c425'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.944340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261b818f29ff45a7817ab6a4de81c425'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.961342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a596033d-2835-4446-b29b-15ad1d574aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261b818f29ff45a7817ab6a4de81c425'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:21.979878 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2793/5612] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:21 2022] DELETE /identity/v3/users/261b818f29ff45a7817ab6a4de81c425 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:23.121349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.122907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:23.145761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f154a0d-bff7-47a9-b471-eab7fba0f62c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:23.253094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:23.253999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.254286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.254797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] PATH_INFO: `/v3/projects/d6c50cc5465048d78cae70d5dfb31886` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.256128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c50cc5465048d78cae70d5dfb31886)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:23.258329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:23.317759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:23.341665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c50cc5465048d78cae70d5dfb31886', 'request_id': 'req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:23.352948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c50cc5465048d78cae70d5dfb31886', 'request_id': 'req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:23.362729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c50cc5465048d78cae70d5dfb31886', 'request_id': 'req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:23.389609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] The token cache is being invalidate because project d6c50cc5465048d78cae70d5dfb31886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:23.389958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:23.390779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7e14130e-ffac-4d5a-b41a-5bbf6ef7a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:23.399399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2820/5613] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:23 2022] DELETE /identity/v3/projects/d6c50cc5465048d78cae70d5dfb31886 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:23.404783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.405389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.405474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.432114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:23.435358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:23.528845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:23.559017 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2794/5614] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:23.566777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.567063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.567383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.618717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:23.621449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:23.637285 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2821/5615] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:23.641065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.685487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14953f99-e1b0-4e44-9bda-0f085829998b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:23.694864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:23.695732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.696173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.696407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.697171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:23.697603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:23.701132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:23.725334 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2795/5616] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:23.728416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.740295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb442f2e-ef07-412c-a5a5-142263479c9d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:23.746140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:23.747028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.747469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.748110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.749194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:23.755154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:23.814966 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2822/5617] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:23 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:23.816769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.828947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dd64-24f6-4e4e-abf6-4021081ec65d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:23.898290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:23.899155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.899848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.900126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.901206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:23.902869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:23.932682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2796/5618] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:23 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:23.934251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.948867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace8b-9acd-41a2-ac88-a5f03216f867 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:23.962009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:23.962796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:23.963086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:23.963367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:23.964167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:23.967575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:23.983267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2823/5619] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:23.984792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:23.997952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863327-960c-417f-8fa6-7be9bd545cd8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.007015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.009407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.009703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.010098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.010859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.015073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec264f-fbb4-45d8-ad20-23b0a7028b65 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.038013 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2797/5620] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:24.041237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.054520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5777d-0dd9-4406-8aec-3270fcc000fa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.071789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.073045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.074592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.074880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] PATH_INFO: `/v3/projects/5fe64047c38644edaeb3cce2f26854c9/users/10fb05525d1b43e59b48a4a65a1c973d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.094623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe64047c38644edaeb3cce2f26854c9, user_id=10fb05525d1b43e59b48a4a65a1c973d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.100340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.139560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2824/5621] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:24 2022] PUT /identity/v3/projects/5fe64047c38644edaeb3cce2f26854c9/users/10fb05525d1b43e59b48a4a65a1c973d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:24.144161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.144460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.144749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.217507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] MFA Rules not processed for user `10fb05525d1b43e59b48a4a65a1c973d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:24.221409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:24.333059 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2798/5622] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:24.339355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.453066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e81c8-12bb-4a04-8e65-da8b66bd5c4e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.459403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.460143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.460628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.460903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.461683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.464272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.504485 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2825/5623] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:24.505619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.539934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fcb1-4734-4d8b-967e-d24eee4cc134 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.659477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:24.677497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.678891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.680533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.681578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.682581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.688315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.722338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2799/5624] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:24 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:24.726402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.757986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0726c-4956-4ce0-b2e2-6ba3a065c722 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.764099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.766275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.767040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.767464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.768573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.771680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.789144 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2826/5625] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:24.793222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.816175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a823002-5609-46e3-a2d7-193687b07dc8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.825729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.827113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.830389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.830690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] PATH_INFO: `/v3/projects/c11572129c464ffe93f2662ade7e9bf2/users/e62451a129d9469c8e0f6e18ea64b87c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.849277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11572129c464ffe93f2662ade7e9bf2, user_id=e62451a129d9469c8e0f6e18ea64b87c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.852000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:24.873370 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2800/5626] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:24 2022] PUT /identity/v3/projects/c11572129c464ffe93f2662ade7e9bf2/users/e62451a129d9469c8e0f6e18ea64b87c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:10:24.877321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:24.890395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183b53a-d7ae-478f-891c-250d7e8c367d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:24.928500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:24.968773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:24.969545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:24.969896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:24.970235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:24.971031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:24.972756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe86d1-02c1-4701-ad75-e06d843ecc65 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.000898 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2827/5627] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:25.004815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:25.019310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d08af-faab-4c0c-8077-672d3b859daa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:25.026833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:25.028005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.028736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.029678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] PATH_INFO: `/v3/projects/c11572129c464ffe93f2662ade7e9bf2/users/e62451a129d9469c8e0f6e18ea64b87c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.032010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11572129c464ffe93f2662ade7e9bf2, user_id=e62451a129d9469c8e0f6e18ea64b87c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:25.035359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.053257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2801/5628] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:25 2022] PUT /identity/v3/projects/c11572129c464ffe93f2662ade7e9bf2/users/e62451a129d9469c8e0f6e18ea64b87c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:25.066056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.068031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.068895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.116509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] MFA Rules not processed for user `e62451a129d9469c8e0f6e18ea64b87c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:25.119136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:25.224277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:25.226606 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2828/5629] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:25.238759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e77e-54a1-4942-bf1f-0fecfd511373 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:25.246627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62451a129d9469c8e0f6e18ea64b87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c11572129c464ffe93f2662ade7e9bf2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:25.247368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.247838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.248126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.248880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:25.249196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:25.251063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.274848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:25.285193 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2802/5630] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:25.287179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7a35f-6bae-48b5-a46c-41f9381c435e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:25.295615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62451a129d9469c8e0f6e18ea64b87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c11572129c464ffe93f2662ade7e9bf2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:25.296348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.296637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.296918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.297902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:25.300069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.350061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:25.358387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2829/5631] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:25 2022] POST /identity/v3/projects => generated 350 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:25.373967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a00b7-47fe-415a-9280-84646799340b tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:25.463758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62451a129d9469c8e0f6e18ea64b87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c11572129c464ffe93f2662ade7e9bf2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:25.465046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.465046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.465237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.466274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:25.466657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:25.469439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.495560 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2803/5632] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:25.519110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:25.521773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:25.598677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faa842-bd97-488b-af28-703f82e96250 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:25.604130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:25.604861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:25.605144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:25.605560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:25.618260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:25.620621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:25.634876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2830/5633] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:29.093470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:29.114843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210e93-3bec-477e-9fd3-8e6609b10b67 tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:29.128144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62451a129d9469c8e0f6e18ea64b87c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c11572129c464ffe93f2662ade7e9bf2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:29.129490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:29.129997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:29.130472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] PATH_INFO: `/v3/projects/9400e8af21df413ebba5f488bff8a33d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:29.132253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9400e8af21df413ebba5f488bff8a33d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:29.134530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:29.219643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9400e8af21df413ebba5f488bff8a33d', 'request_id': 'req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.228931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9400e8af21df413ebba5f488bff8a33d', 'request_id': 'req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.237196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9400e8af21df413ebba5f488bff8a33d', 'request_id': 'req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.267287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] The token cache is being invalidate because project 9400e8af21df413ebba5f488bff8a33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:29.267748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.268736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cac35de-5df6-407d-8f5f-4b222d9c0b9a tempest-QuotasNegativeTest-1354507829 tempest-QuotasNegativeTest-1354507829-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.272917 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2804/5634] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:29 2022] DELETE /identity/v3/projects/9400e8af21df413ebba5f488bff8a33d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:29.279328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:29.365383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:29.439340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53a524-5617-4375-a9b2-f6dcee0f907b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:29.522460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:29.523536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:29.523938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:29.524518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] PATH_INFO: `/v3/users/10fb05525d1b43e59b48a4a65a1c973d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:29.537018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fb05525d1b43e59b48a4a65a1c973d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:29.542069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:29.646739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fb05525d1b43e59b48a4a65a1c973d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.672851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fb05525d1b43e59b48a4a65a1c973d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.673718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fb05525d1b43e59b48a4a65a1c973d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.674648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fb05525d1b43e59b48a4a65a1c973d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.705990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fb05525d1b43e59b48a4a65a1c973d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:29.730019 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2831/5635] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:29 2022] DELETE /identity/v3/users/10fb05525d1b43e59b48a4a65a1c973d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:10:29.734715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:29.735421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:29.736061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:29.772766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:29.774320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:29.791078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:29.903878 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2805/5636] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:29.918688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:29.922084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:30.038707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd95249-e959-46df-9a8d-0347a209b772 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:30.043501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:30.044254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:30.044254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:30.044486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:30.057016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:30.058533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:30.076926 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2832/5637] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:30.185370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:30.186962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:30.300695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa150f-653c-4a76-a2a7-17b1b40eb3ea None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:30.313072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:30.314403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:30.315196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:30.315712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:30.318245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:30.338350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:30.341050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:30.367797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2806/5638] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:30.597429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:30.598989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:30.609159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:30.627592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bcc50-daf3-4125-9001-7cb60da0d550 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:30.640465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:30.641787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:30.642283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:30.642763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] PATH_INFO: `/v3/projects/5fe64047c38644edaeb3cce2f26854c9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:30.644834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe64047c38644edaeb3cce2f26854c9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:30.650031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:30.733201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe64047c38644edaeb3cce2f26854c9', 'request_id': 'req-4b14c9e5-814a-4d93-bb27-e76f73e0a862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.740851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe64047c38644edaeb3cce2f26854c9', 'request_id': 'req-4b14c9e5-814a-4d93-bb27-e76f73e0a862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.749419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe64047c38644edaeb3cce2f26854c9', 'request_id': 'req-4b14c9e5-814a-4d93-bb27-e76f73e0a862'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.766482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] The token cache is being invalidate because project 5fe64047c38644edaeb3cce2f26854c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:30.766482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.767287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.769282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2833/5639] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:30 2022] DELETE /identity/v3/projects/5fe64047c38644edaeb3cce2f26854c9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:30.773925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:30.788861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f077ea-7950-4443-9639-e50e2610a7da service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:30.867010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:30.869652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:30.869652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:30.869652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] PATH_INFO: `/v3/users/e62451a129d9469c8e0f6e18ea64b87c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:30.871012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62451a129d9469c8e0f6e18ea64b87c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:30.874037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:30.978019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:30.981189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62451a129d9469c8e0f6e18ea64b87c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.982182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62451a129d9469c8e0f6e18ea64b87c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.998804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62451a129d9469c8e0f6e18ea64b87c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:30.999353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62451a129d9469c8e0f6e18ea64b87c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.025053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4a2ad7b4-27e8-488b-b002-6f41fa3740b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62451a129d9469c8e0f6e18ea64b87c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.048223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2807/5640] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:30 2022] DELETE /identity/v3/users/e62451a129d9469c8e0f6e18ea64b87c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:31.467805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:31.469662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:31.498759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c9e5-814a-4d93-bb27-e76f73e0a862 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:31.608029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:31.609200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:31.609645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:31.611797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] PATH_INFO: `/v3/projects/c11572129c464ffe93f2662ade7e9bf2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:31.613233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11572129c464ffe93f2662ade7e9bf2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:31.617198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:31.707289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11572129c464ffe93f2662ade7e9bf2', 'request_id': 'req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.715054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11572129c464ffe93f2662ade7e9bf2', 'request_id': 'req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.722449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11572129c464ffe93f2662ade7e9bf2', 'request_id': 'req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.740869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] The token cache is being invalidate because project c11572129c464ffe93f2662ade7e9bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:31.741379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.744302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-822c6bfc-6f22-4ccf-bc4b-3f5e1e9d9b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:31.751100 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2834/5641] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:31 2022] DELETE /identity/v3/projects/c11572129c464ffe93f2662ade7e9bf2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:31.753394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:31.754248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:31.754671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:31.778463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:31.781033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:31.863554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2808/5642] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:31.867369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:31.867711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:31.868655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:31.905107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:31.906701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:31.930716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2835/5643] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:31.935688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:31.950208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888805b-c76e-4f87-803d-1ab345f00453 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:31.956141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:31.957888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:31.958379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:31.959129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:31.960280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:31.960797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:31.962976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:31.979609 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2809/5644] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:31.983964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:31.996431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203664cb-8481-4359-ae97-f9776fa53642 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.005290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.006350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.006828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.007367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.009087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.012229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.017817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:32.060934 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2836/5645] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:31 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:32.065411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:32.077834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09527e5-1cbe-4d60-98f9-8ef945113a63 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.156918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.157905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.158205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.158586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.159408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.161516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.191692 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2810/5646] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:32 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:32.193827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:32.207799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039438d-4618-4ae1-b7a8-61d5df9330de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.213793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.214650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.215046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.215546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.216308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.218300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.231175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2837/5647] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:32.235253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:32.248307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a36d-c6f3-4420-9a05-b017ea0ac1e4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.253691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.254522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.254806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.255106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.256008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.257623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b55c7b-5cd6-451a-a1b5-b163046a4b2b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.278669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:32.279661 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2811/5648] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:32.291844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775c4e-9499-4db0-bbc9-aabb5379c5b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.296754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.297653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.297960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.298243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] PATH_INFO: `/v3/projects/dfa373cc9f2540a2af6df9b6a5a5850b/users/f07564e17ffb4238a14ce1ff8da32bd2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.315429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa373cc9f2540a2af6df9b6a5a5850b, user_id=f07564e17ffb4238a14ce1ff8da32bd2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.318232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.346166 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2838/5649] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:32 2022] PUT /identity/v3/projects/dfa373cc9f2540a2af6df9b6a5a5850b/users/f07564e17ffb4238a14ce1ff8da32bd2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:32.348318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.348682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.349061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.414884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] MFA Rules not processed for user `f07564e17ffb4238a14ce1ff8da32bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:32.423069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:32.475731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:32.609760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2812/5650] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:32.620613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:32.622932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:32.698809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb59a9-ded6-4366-b8c0-878d53c23012 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:32.703348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:32.704460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:32.704899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:32.705339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:32.717003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:32.718428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc025d3-da40-4b6d-97ba-f39ebbab5c4d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:32.745707 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2839/5651] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:41.817460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:41.818920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:41.986918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cc833-c964-46cc-bc02-b62fcb48599f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:42.000478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:42.001166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:42.001450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:42.001730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:42.003653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:42.033209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:42.035048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:42.054200 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2813/5652] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:42.621808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:42.622719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:42.623203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:42.643563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:42.645636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:42.759573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2840/5653] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:42.860568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:42.862685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:42.879924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:42.881562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:43.032868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f48f4-ef8c-43e9-a4b2-d9579bb486f9 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:43.041862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfbed4-5860-4a8c-bfb5-7b8c68e6ed90 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:43.042782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:43.044381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:43.044899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:43.046751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:43.047780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:43.048637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:43.048914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:43.049189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] PATH_INFO: `/v3/users/ecdc2e5bf2e3492bb5320e054641ec3c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:43.050597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdc2e5bf2e3492bb5320e054641ec3c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:43.059158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:43.060808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:43.062776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:43.065239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae13953-0e33-413e-8a72-ec60d89db836 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:43.084104 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2814/5654] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:10:43.165240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdc2e5bf2e3492bb5320e054641ec3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:43.174572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdc2e5bf2e3492bb5320e054641ec3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:43.175395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdc2e5bf2e3492bb5320e054641ec3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:43.176187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdc2e5bf2e3492bb5320e054641ec3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:43.192811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdc2e5bf2e3492bb5320e054641ec3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:43.211927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2841/5655] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:42 2022] DELETE /identity/v3/users/ecdc2e5bf2e3492bb5320e054641ec3c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:43.896207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:43.896684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:43.897032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:43.916442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:43.917813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:43.953346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:44.003695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2815/5656] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:44.015704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.017402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.099750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.104260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.147530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11da4d-ef12-452c-beee-5f7d753b6dad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:44.154017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:44.155666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.156175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.156660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.171706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:44.174649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794e78b-f6cb-4d54-992d-3fba3efcd582 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:44.199311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2842/5657] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:44.316539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e259a-a588-46cd-8f7e-b8b4fcc4f25b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:44.328508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:44.329743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.330261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.330727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] PATH_INFO: `/v3/projects/14f851d439ae4167af07518e3b1354ac` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.332770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f851d439ae4167af07518e3b1354ac)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:44.340378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:44.447246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f851d439ae4167af07518e3b1354ac', 'request_id': 'req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:44.466779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f851d439ae4167af07518e3b1354ac', 'request_id': 'req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:44.491817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f851d439ae4167af07518e3b1354ac', 'request_id': 'req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:44.525740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] The token cache is being invalidate because project 14f851d439ae4167af07518e3b1354ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:44.526104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:44.526849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4614707d-2a0f-41ee-8a09-4eb68b8f45d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:44.528950 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2816/5658] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:44 2022] DELETE /identity/v3/projects/14f851d439ae4167af07518e3b1354ac => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:44.534164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b50e-df1a-4896-85ae-86b2e1a26efd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.534464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b50e-df1a-4896-85ae-86b2e1a26efd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.534744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42b50e-df1a-4896-85ae-86b2e1a26efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.567118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4d42b50e-df1a-4896-85ae-86b2e1a26efd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:44.568429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d42b50e-df1a-4896-85ae-86b2e1a26efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.629256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.629538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.629979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.665246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:44.668400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.747008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2843/5659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:44.753868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.754166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.754453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.769039 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2817/5660] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:44.782586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.784065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.792627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:44.794197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:44.804749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2844/5661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:44.808922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.813362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:44.819338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:44.826332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518feab8-8003-4dd2-b463-982c7801c1c4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:44.840983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:44.843178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.843826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.844309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.845956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:44.852629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:44.855197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:44.871379 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2845/5662] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:44.875649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.888802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2cfe-9a0d-4dfe-925a-17cdafc3cf7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:44.894721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:44.896236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.896769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.897430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.898900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:44.901627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:44.913319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f6d9-0e94-4116-8b3a-d0f58e09ab22 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:44.931025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:44.931968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:44.932426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:44.932964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:44.945160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:44.947179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:44.970649 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2846/5663] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:44 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:44.972279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:44.989242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2818/5664] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:45.107429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d610-ed1e-461c-b09d-06184e333aef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:45.120513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:45.123791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.124090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.124374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.125314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:45.141954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:45.185484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:45.192424 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2847/5665] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:44 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:45.201670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d245-308e-4086-a5fc-7c6fb4e5b138 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:45.218738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:45.234922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.237739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.238598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.239667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:45.241809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:45.284405 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2819/5666] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:45.288320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:45.305429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3338e-50dd-47f1-a4a4-7bdf6adf69e4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:45.312547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:45.313348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.314323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.314801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.315736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:45.318353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245278ea-e95c-45c8-9509-cf3caad9185a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:45.335864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2848/5667] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:45.339998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:45.404101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd151211-a505-4fd8-98d5-eda7c67b089c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:45.431900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:45.432875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.433161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.434914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] PATH_INFO: `/v3/projects/0dc813c0affe4551bd334712c53fdd3c/users/09431bbdbc394df8b368770d3e24a306/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.470659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc813c0affe4551bd334712c53fdd3c, user_id=09431bbdbc394df8b368770d3e24a306, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:45.476471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a568e-8e50-4199-a989-bc5baf691c39 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:45.514201 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2820/5668] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:45 2022] PUT /identity/v3/projects/0dc813c0affe4551bd334712c53fdd3c/users/09431bbdbc394df8b368770d3e24a306/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:45.520565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c312467-828a-4683-bc54-01b211efd697 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.521086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c312467-828a-4683-bc54-01b211efd697 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.522627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c312467-828a-4683-bc54-01b211efd697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.573514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3c312467-828a-4683-bc54-01b211efd697 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:45.574972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3c312467-828a-4683-bc54-01b211efd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:45.681415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.681934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.682291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.713277 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2849/5669] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:45.716437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:45.717925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:45.740467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c312467-828a-4683-bc54-01b211efd697 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:45.744398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3c312467-828a-4683-bc54-01b211efd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:45.818009 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2821/5670] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:45.825355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:45.903175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:45.914145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c312467-828a-4683-bc54-01b211efd697 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:45.922484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:45.923285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:45.924208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:45.924609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:45.945114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:45.952510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:45.989287 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2850/5671] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:46.035610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ac8d0-d107-4c02-a01f-417f51396ae7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:46.045105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:46.045927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:46.046210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:46.046490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:46.058962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:46.061503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:46.071815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2822/5672] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:10:47.916591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:47.918563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:47.944038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb1be6-e18b-470c-bb78-3e9497c1436b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:47.959616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:47.961534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:47.961534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:47.961752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] PATH_INFO: `/v3/users/3467d447a572424f9c6cd56c5fa7e0c4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:47.963293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3467d447a572424f9c6cd56c5fa7e0c4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:47.965312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:48.095305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3467d447a572424f9c6cd56c5fa7e0c4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.115401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3467d447a572424f9c6cd56c5fa7e0c4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.116415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3467d447a572424f9c6cd56c5fa7e0c4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.124025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3467d447a572424f9c6cd56c5fa7e0c4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.145632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3467d447a572424f9c6cd56c5fa7e0c4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.184386 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2851/5673] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:47 2022] DELETE /identity/v3/users/3467d447a572424f9c6cd56c5fa7e0c4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:48.631035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:48.633778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:48.648869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:48.659189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e99a5-71eb-4146-860b-70f1b4f56448 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:48.721943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:48.723578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:48.773208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:48.776586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:48.777308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:48.777800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] PATH_INFO: `/v3/users/0678a3e330f449d8acf9c01cda1808be` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:48.779307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0678a3e330f449d8acf9c01cda1808be)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:48.781805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:48.888802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997998-bc70-4dec-aadc-77ff7557a897 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:48.889851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0678a3e330f449d8acf9c01cda1808be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.890784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0678a3e330f449d8acf9c01cda1808be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.900993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0678a3e330f449d8acf9c01cda1808be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.901746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0678a3e330f449d8acf9c01cda1808be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.912419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:48.914076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:48.915039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:48.915698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] PATH_INFO: `/v3/projects/0f2b7449c8de4c6eba0e9b7c174856e1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:48.918977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2b7449c8de4c6eba0e9b7c174856e1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:48.920166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dbf35e0-2f40-49c8-af7f-1c8535182091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0678a3e330f449d8acf9c01cda1808be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:48.922850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:48.944548 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2823/5674] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:48 2022] DELETE /identity/v3/users/0678a3e330f449d8acf9c01cda1808be => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:10:48.947310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:48.947634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:48.947924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.001540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:49.002932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:49.040170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2b7449c8de4c6eba0e9b7c174856e1', 'request_id': 'req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:49.053810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2b7449c8de4c6eba0e9b7c174856e1', 'request_id': 'req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:49.076491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2b7449c8de4c6eba0e9b7c174856e1', 'request_id': 'req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:49.085782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:49.111836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] The token cache is being invalidate because project 0f2b7449c8de4c6eba0e9b7c174856e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:49.112424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:49.113656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4e35283c-549c-40a4-a6cc-4c9a2fc822cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:49.116584 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2852/5675] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:48 2022] DELETE /identity/v3/projects/0f2b7449c8de4c6eba0e9b7c174856e1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:49.124051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79828b01-387f-4a95-ac73-009daa8881fb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.124561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79828b01-387f-4a95-ac73-009daa8881fb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.125429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79828b01-387f-4a95-ac73-009daa8881fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.138479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2824/5676] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:49.158658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.160509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:49.176119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-79828b01-387f-4a95-ac73-009daa8881fb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:49.177569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79828b01-387f-4a95-ac73-009daa8881fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:49.224909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:49.292258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a10e9-e5d5-455a-8edb-6e417e77c3a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.293222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2853/5677] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:49.299317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.299615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.299894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.342490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:49.344905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:49.374315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2854/5678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:49.375082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.397802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9acf-c989-4585-9f70-e93ca8f6daee None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.409541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.410227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.411222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.412940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.413717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:49.414023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.417078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.441199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.441874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.442453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.442734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.445131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2855/5679] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:49.452654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.466003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6ae83-7daf-4f32-a187-be2ddc2fb08b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.467927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.469691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.472989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.473880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.474335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.474892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.475772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.478243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.484966 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2825/5680] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:49.523718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2856/5681] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:49 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:49.527038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.541554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3bb53-23d2-4cbc-a8d6-38af4e83e5a7 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.690131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.694424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.694762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.695053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.695978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.699631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.764368 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2826/5682] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:49 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:49.768747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.794287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6f87e-461a-4c29-8316-3ed78dc1b494 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.801076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.802207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.802806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.803213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.804307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.806282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.822106 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2857/5683] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:49.826036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.843426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa5996-c83a-40b9-ae13-d7a10fc7833e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.850775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.850775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.850775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.850775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.851319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.853672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88df00d-6b09-4cc3-b937-fc4ffed5f336 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.874298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:49.895728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2827/5684] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:49.902801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099cb3a-1798-4efc-8f75-e75b29b3708d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:49.911362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:49.912702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.913010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.913362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] PATH_INFO: `/v3/projects/e173e952f35b465898956477d2facf0e/users/c3a7b7c72a80455381b2b9b4ee14eed3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.933097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e173e952f35b465898956477d2facf0e, user_id=c3a7b7c72a80455381b2b9b4ee14eed3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:49.936412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:49.959776 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2858/5685] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:49 2022] PUT /identity/v3/projects/e173e952f35b465898956477d2facf0e/users/c3a7b7c72a80455381b2b9b4ee14eed3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:49.964530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:49.965751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:49.966259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:49.995003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:49.997490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:50.088799 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2828/5686] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:50.117829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:50.230483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc0f19-02e3-4b2e-b5b0-81d4f8aa246d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:50.240645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:50.241655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:50.242007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:50.242535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:50.258734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:50.261897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:50.276843 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2859/5687] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:50.628100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:50.629522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:50.634896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:50.753200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567e96-85e8-4eee-a90a-38c6ba0f97fc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:50.763270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:50.764848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:50.765564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:50.766338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:50.770230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:50.797826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:50.800332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:50.836224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2829/5688] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:50.990833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:50.992845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.013988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fdecd-9cce-4a1c-a8d3-639e331d9039 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.023245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.024946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.025417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.025787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] PATH_INFO: `/v3/users/f07564e17ffb4238a14ce1ff8da32bd2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.033858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07564e17ffb4238a14ce1ff8da32bd2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.034748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.036394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.036506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.062591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8cbf4-31fc-4e95-a28d-8c0674b49f24 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.070928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:51.076879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.078729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.079375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.080008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] PATH_INFO: `/v3/projects/241876e358514965aadcc36146a30265` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.088234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241876e358514965aadcc36146a30265)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.090708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.142864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07564e17ffb4238a14ce1ff8da32bd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.207927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07564e17ffb4238a14ce1ff8da32bd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.209263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07564e17ffb4238a14ce1ff8da32bd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.212313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07564e17ffb4238a14ce1ff8da32bd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.217638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241876e358514965aadcc36146a30265', 'request_id': 'req-357cda95-4512-4dbd-91a7-4215306071d6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.225920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241876e358514965aadcc36146a30265', 'request_id': 'req-357cda95-4512-4dbd-91a7-4215306071d6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.233139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241876e358514965aadcc36146a30265', 'request_id': 'req-357cda95-4512-4dbd-91a7-4215306071d6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.240434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d51e7c8d-e59a-4dc1-8da0-0907d8510aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07564e17ffb4238a14ce1ff8da32bd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.257717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] The token cache is being invalidate because project 241876e358514965aadcc36146a30265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:51.258230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.259438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-357cda95-4512-4dbd-91a7-4215306071d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:51.264440 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2830/5689] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:51 2022] DELETE /identity/v3/projects/241876e358514965aadcc36146a30265 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:10:51.269543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.270155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.270395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.270517 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2860/5690] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:50 2022] DELETE /identity/v3/users/f07564e17ffb4238a14ce1ff8da32bd2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:51.276229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5d1-3e83-459d-9db7-b1d03a322395 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.276522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5d1-3e83-459d-9db7-b1d03a322395 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.277237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5d1-3e83-459d-9db7-b1d03a322395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.305452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:51.306700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.312684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6929c5d1-3e83-459d-9db7-b1d03a322395 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:51.317079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6929c5d1-3e83-459d-9db7-b1d03a322395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.429054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2861/5691] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:51.437973 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2831/5692] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:51.445154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.445977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.445977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.457887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.462117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.473292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:51.474697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:51.491828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2862/5693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:51.493295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.500197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:51.514292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1cf81-808e-4eb0-a86d-9bc8f00d0bc2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.529845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.530832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.530832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.531133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.531874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:51.532182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.533823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.557947 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2863/5694] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:51.557947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.572357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24002e4d-337d-4a52-b6cd-885d98e4c77a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.580410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.582568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.582859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.583145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.584615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19f914-b0ee-4c0f-bda6-47e09aaa9fa9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.585761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.588821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.593554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.594494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.594606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.594875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.617766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.619245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.634535 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2832/5695] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:51.647296 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2864/5696] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:51 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:51.652191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.672981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45ca25-8edf-4b3b-8456-49620a265dee service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.756165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.757259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.757649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.757964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.759925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.762116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.798701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2833/5697] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:51 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:51.802646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.815024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d82725-2ae8-4fb3-b7a4-855a71bdcfd3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.825795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.826496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.826779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.827055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.828255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.831387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.848093 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2865/5698] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:51.849930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.874144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a90d56-5805-4db7-890a-ed229efe3292 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.880994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.882128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.882301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.882588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.884502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:51.886573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f275c-9a1a-48bc-88aa-5cb02fc0904b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:51.921284 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2834/5699] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:51.923463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:51.937133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17085b-2bc2-4cbf-b9e0-f7df471d5ab7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:51.945178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:51.946461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:51.950016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:51.952251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] PATH_INFO: `/v3/projects/91f1518377e6472e808f8fd8ac986c9c/users/fe6cf304a0b443d69ae741fd182c08cb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:51.993029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f1518377e6472e808f8fd8ac986c9c, user_id=fe6cf304a0b443d69ae741fd182c08cb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:52.002350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:52.026717 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2866/5700] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:51 2022] PUT /identity/v3/projects/91f1518377e6472e808f8fd8ac986c9c/users/fe6cf304a0b443d69ae741fd182c08cb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:52.040592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:52.040708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:52.041005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:52.098028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] MFA Rules not processed for user `fe6cf304a0b443d69ae741fd182c08cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:52.099883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:52.243423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2835/5701] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:52.251013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:52.254090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:52.284240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:52.386613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c42516-d749-4daf-a750-8d7bd25529da admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:52.392705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:52.395558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:52.396445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:52.396935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:52.409359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:52.412238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebada866-c638-401d-8d4c-50d1156ad4e6 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:52.425154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2867/5702] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:10:52.905741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:52.907474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:52.978469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:53.056160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf38d7-2f87-4723-b92d-13ae79ffe177 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:53.064290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:53.075034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.076797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.078877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] PATH_INFO: `/v3/projects/dfa373cc9f2540a2af6df9b6a5a5850b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.082885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa373cc9f2540a2af6df9b6a5a5850b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:53.085943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:53.207388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa373cc9f2540a2af6df9b6a5a5850b', 'request_id': 'req-fa753075-b57c-4cf1-aea1-c26d9086204b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:53.227268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa373cc9f2540a2af6df9b6a5a5850b', 'request_id': 'req-fa753075-b57c-4cf1-aea1-c26d9086204b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:53.249047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa373cc9f2540a2af6df9b6a5a5850b', 'request_id': 'req-fa753075-b57c-4cf1-aea1-c26d9086204b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:53.293499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] The token cache is being invalidate because project dfa373cc9f2540a2af6df9b6a5a5850b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:10:53.294130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:53.296907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa753075-b57c-4cf1-aea1-c26d9086204b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:53.301834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2836/5703] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:10:52 2022] DELETE /identity/v3/projects/dfa373cc9f2540a2af6df9b6a5a5850b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:53.305505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.306465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.306465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.354838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:53.388226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:53.624270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.624919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.625515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.631477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2868/5704] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:53.653133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:53.654724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:53.675103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:53.682107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2837/5705] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:53.712049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322b5a-cc8e-4a98-b237-de1d4f1cf600 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:53.720628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:53.721796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.723118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.723857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.725538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:10:53.726141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:53.730010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eee72-9cf5-4aa1-8c57-1f7d52235d50 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:53.757315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2869/5706] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:10:53.759774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:53.776916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec1a51-ae83-44f2-a2ba-862147497f8b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:53.796187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:53.797190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.797623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.798038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.799081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:53.803430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:53.824003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203c73-2f83-4901-b407-6d28ee6365e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.824571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203c73-2f83-4901-b407-6d28ee6365e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.824988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203c73-2f83-4901-b407-6d28ee6365e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.876703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2838/5707] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:10:53 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:10:53.880479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:53.881431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7d203c73-2f83-4901-b407-6d28ee6365e9 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:53.883021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d203c73-2f83-4901-b407-6d28ee6365e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:53.957137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1827b-9482-4865-9ab7-c418cbf301f9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:53.962490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:53.963153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:53.963614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:53.963897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:53.964595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:53.966591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:53.994036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2870/5708] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:54.001400 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2839/5709] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:10:53 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:10:54.005467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:54.006120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.006399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.006684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.017960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361a8fd-3942-4b24-98eb-69cfc9ffe3ab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:54.025850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:54.027243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.027833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.028290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.029210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:54.031015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:54.031393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:54.032312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:54.049126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2840/5710] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:54.050488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:54.056031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2871/5711] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:54.057046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:54.059582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:54.064143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f525b3-286e-428e-9fe8-1b4fd95f3ff9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:54.072374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:54.074348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.074830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.075322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.076603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:54.079307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:54.081227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:54.101326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2841/5712] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:10:54.103655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:54.121150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:54.127415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2d63-b5c2-4750-9df3-007eb0f3af8e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:54.137420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:54.144098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.144757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.145571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] PATH_INFO: `/v3/projects/02b1c0c103804925ae7c6ee99d35c946/users/8be06f3ffd3d473f80443e87eec03017/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.177033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b1c0c103804925ae7c6ee99d35c946, user_id=8be06f3ffd3d473f80443e87eec03017, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:54.180504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8b4b5-db4c-49a0-a310-e161c8200e7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:54.205977 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2842/5713] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:10:54 2022] PUT /identity/v3/projects/02b1c0c103804925ae7c6ee99d35c946/users/8be06f3ffd3d473f80443e87eec03017/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:54.218143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.218143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.218143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.228320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7945d-5a35-4161-afef-ca414212101d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:54.262471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] MFA Rules not processed for user `8be06f3ffd3d473f80443e87eec03017`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:54.266258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:54.388164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:54.389754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.391143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.395776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.420021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2843/5714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:10:54.434874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:54.436605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:54.572316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:54.574419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f058d3-bdf5-4112-b573-9b16fc74a8e3 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:54.623209 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2872/5715] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:54.650709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca48a6-ea3d-410e-a777-341c01a54a80 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:54.663938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:54.665281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:54.665598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:54.665883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:54.691885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:54.693478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:54.723626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2844/5716] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:10:57.952647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:57.953157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:57.953752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:58.032410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:58.049404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:58.173731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:58.213905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2873/5717] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:10:58.229065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:58.253669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44924c-a150-4ce0-81a2-836fa52dbae9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:58.291233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:58.292403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:58.292681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:58.292957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:58.325956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:58.327671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908ecca-5382-409f-a513-40f3fab84169 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:58.390496 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2845/5718] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:10:59.501152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:10:59.503584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:59.628514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89a5f4-65ca-4ad8-a32f-9a31f59dc335 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:10:59.634670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:10:59.636261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:59.636546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:59.636819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] PATH_INFO: `/v3/users/fe6cf304a0b443d69ae741fd182c08cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:59.638230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6cf304a0b443d69ae741fd182c08cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:10:59.640916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:10:59.734182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6cf304a0b443d69ae741fd182c08cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:59.746214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6cf304a0b443d69ae741fd182c08cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:59.747134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6cf304a0b443d69ae741fd182c08cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:59.748492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6cf304a0b443d69ae741fd182c08cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:59.784205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6cf304a0b443d69ae741fd182c08cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:10:59.811934 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2874/5719] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:10:59 2022] DELETE /identity/v3/users/fe6cf304a0b443d69ae741fd182c08cb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:10:59.815927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:10:59.817695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:10:59.818209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:10:59.867637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:10:59.869552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:10:59.965279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:59.997426 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2846/5720] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:00.020125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:00.021817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:00.160949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b459f-aef5-4baa-8db6-468ea9d586d7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:00.173911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:00.174759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:00.175822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:00.176217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:00.218110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:00.222019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cda72-371c-4cc9-8b0b-db61cdbcae51 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:00.245988 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2875/5721] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:01.109838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:01.112295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:01.147544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be1367-22a9-4a98-8cf5-1bb2b12941e5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:01.160922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:01.164350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:01.166146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:01.167494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] PATH_INFO: `/v3/users/cc273fcf22a84377ba959577ebc8a81c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:01.171080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc273fcf22a84377ba959577ebc8a81c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:01.175874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:01.311613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc273fcf22a84377ba959577ebc8a81c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:01.313027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc273fcf22a84377ba959577ebc8a81c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:01.330682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc273fcf22a84377ba959577ebc8a81c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:01.334167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc273fcf22a84377ba959577ebc8a81c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:01.384330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc273fcf22a84377ba959577ebc8a81c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:01.410236 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2847/5722] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:01 2022] DELETE /identity/v3/users/cc273fcf22a84377ba959577ebc8a81c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:01.415604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:01.416456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:01.416913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:01.456579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:01.461967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:01.492397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:01.642168 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2876/5723] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:01.703412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:01.704874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:01.912577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536b7c3-7cbb-4951-9ae9-c04d1c6a8a89 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:01.938471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:01.939212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:01.939602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:01.940940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:01.970241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:01.972278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e7028-31b4-4573-ae09-662df68988ee service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:01.999441 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2848/5724] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:03.021552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:03.026177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:03.043396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29464375-bed2-4ecb-aedb-0ff9a88bcde7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:03.108835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:03.111479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:03.112080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:03.112619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] PATH_INFO: `/v3/projects/91f1518377e6472e808f8fd8ac986c9c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:03.124352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f1518377e6472e808f8fd8ac986c9c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:03.126946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:03.285176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f1518377e6472e808f8fd8ac986c9c', 'request_id': 'req-33f202a7-2248-437c-9d92-cb5cd30d501d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:03.299401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f1518377e6472e808f8fd8ac986c9c', 'request_id': 'req-33f202a7-2248-437c-9d92-cb5cd30d501d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:03.329259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f1518377e6472e808f8fd8ac986c9c', 'request_id': 'req-33f202a7-2248-437c-9d92-cb5cd30d501d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:03.364025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] The token cache is being invalidate because project 91f1518377e6472e808f8fd8ac986c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:03.373556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:03.377144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:03.387746 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2877/5725] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:03 2022] DELETE /identity/v3/projects/91f1518377e6472e808f8fd8ac986c9c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:04.422798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a3cfa-a183-4225-b640-647d68723039 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:04.423407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a3cfa-a183-4225-b640-647d68723039 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:04.423557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a3cfa-a183-4225-b640-647d68723039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:04.468790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-512a3cfa-a183-4225-b640-647d68723039 None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:04.470131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-512a3cfa-a183-4225-b640-647d68723039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:04.500930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:04.502474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:04.646934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2849/5726] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:04.696430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f202a7-2248-437c-9d92-cb5cd30d501d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:04.704205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:04.705326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:04.705697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:04.706017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] PATH_INFO: `/v3/projects/5434a9961d86412595175726d5be3dc2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:04.707604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5434a9961d86412595175726d5be3dc2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:04.709836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:04.817915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:04.837908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5434a9961d86412595175726d5be3dc2', 'request_id': 'req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:04.846639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5434a9961d86412595175726d5be3dc2', 'request_id': 'req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:04.856942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5434a9961d86412595175726d5be3dc2', 'request_id': 'req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:04.897431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] The token cache is being invalidate because project 5434a9961d86412595175726d5be3dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:04.901095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:04.903211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-29e6cf0c-ead9-46ad-97c1-4ff28427a0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:04.906471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2878/5727] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:04 2022] DELETE /identity/v3/projects/5434a9961d86412595175726d5be3dc2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:04.912083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:04.912913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:04.913451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:04.955688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:04.956929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:04.965154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:05.126918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.127251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.127470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.130556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2850/5728] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:05.177061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:05.180466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:05.197551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2879/5729] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:05.202464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.218862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f35b4-ff6b-4d19-b19e-0609ed5c74ca None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.228186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.229759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.230529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.230773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.231649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:05.232027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.234877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.260633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.268051 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2851/5730] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:11:05.274499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fb4f0-a89e-4bf2-88ea-c768867ebd48 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.302095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.305015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.305968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.307718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.308911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.316942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.377557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2880/5731] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:05.379695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.395075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776f7c-85b4-4f19-8909-485d57dda4e1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.484204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.484924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.485210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.485491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.486310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.488431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.533094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2852/5732] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:05 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:05.535266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.556701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23308-e360-42f0-94f0-fadc49cd594c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.565295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.566175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.566613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.567040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.570759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.581155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.606812 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2881/5733] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:05.610723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.629817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33144d-69e3-43ef-b52e-c376c77d4326 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.638052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.639018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.639431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.639845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.641770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.643746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64caa4d5-8e99-48c6-b6e4-e1717107856e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.660061 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2853/5734] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:05.665063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.680481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd328be-3be2-4e93-8922-3a6aa247e6c1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:05.687329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:05.688336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.689161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.689161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] PATH_INFO: `/v3/projects/07ebdea331d34aa1ad5f3b07101896d4/users/c0548510232c458a8aad96511c334914/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.710227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ebdea331d34aa1ad5f3b07101896d4, user_id=c0548510232c458a8aad96511c334914, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:05.715068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:05.737493 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2882/5735] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:05 2022] PUT /identity/v3/projects/07ebdea331d34aa1ad5f3b07101896d4/users/c0548510232c458a8aad96511c334914/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:11:05.747909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:05.748317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:05.748735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:05.794118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] MFA Rules not processed for user `c0548510232c458a8aad96511c334914`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:05.796206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:05.912623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2854/5736] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:05.945506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:05.947142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:06.031917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a76fd-ef70-4563-bb59-588207c58902 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:06.042347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:06.043700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:06.046404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:06.046867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:06.061015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:06.062860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cdb82-4422-46d8-a942-c16fc576f726 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:06.082590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2883/5737] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:06.100198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:06.117306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:06.236834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cafaa-3af3-4704-bcc0-ea23b4c2afa4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:06.254993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:06.256641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:06.256930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:06.257208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] PATH_INFO: `/v3/users/c0548510232c458a8aad96511c334914` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:06.261152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0548510232c458a8aad96511c334914)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:06.263229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:06.386810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0548510232c458a8aad96511c334914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:06.392103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0548510232c458a8aad96511c334914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:06.397884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0548510232c458a8aad96511c334914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:06.398965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0548510232c458a8aad96511c334914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:06.430762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0548510232c458a8aad96511c334914'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:06.463564 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2855/5738] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:06 2022] DELETE /identity/v3/users/c0548510232c458a8aad96511c334914 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:06.470537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:06.470840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:06.471125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:06.501900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:06.503115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:06.620072 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2884/5739] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:06.647890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:06.650539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:06.772327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231626-0c65-4e8f-a582-27d2b1d98da5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:06.779677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:06.780671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:06.780973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:06.781557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:06.803387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:06.807957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cb83d-918b-498e-9151-f009957604e8 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:06.825304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2856/5740] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:07.471654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:07.473447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:07.490453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35441f-10ca-4c58-be4b-baaabfdcb72b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:07.499428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:07.502234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:07.502719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:07.503215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] PATH_INFO: `/v3/projects/07ebdea331d34aa1ad5f3b07101896d4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:07.505044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ebdea331d34aa1ad5f3b07101896d4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:07.507881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:07.510564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:07.566085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ebdea331d34aa1ad5f3b07101896d4', 'request_id': 'req-45c00c38-b649-40a4-bf2c-ea4c2c77704a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:07.573719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ebdea331d34aa1ad5f3b07101896d4', 'request_id': 'req-45c00c38-b649-40a4-bf2c-ea4c2c77704a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:07.580665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ebdea331d34aa1ad5f3b07101896d4', 'request_id': 'req-45c00c38-b649-40a4-bf2c-ea4c2c77704a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:07.598543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] The token cache is being invalidate because project 07ebdea331d34aa1ad5f3b07101896d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:07.599277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:07.600204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45c00c38-b649-40a4-bf2c-ea4c2c77704a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:07.604329 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2885/5741] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:07 2022] DELETE /identity/v3/projects/07ebdea331d34aa1ad5f3b07101896d4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:07.609339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:07.610151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:07.610588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:07.636021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:07.637637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:07.673816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:07.756337 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2857/5742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:07.766274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:07.767284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:07.767749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:07.792859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:07.794438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:07.804928 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2886/5743] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:07.809494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:07.823552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771ddb-ee93-4314-a135-8ed729488543 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:07.829501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:07.830421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:07.831311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:07.831908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:07.832912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:07.834057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:07.835101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:07.879140 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2858/5744] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:11:07.882276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:07.903300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d28bbc-f920-4183-a434-67bf14a51285 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:07.910815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:07.911905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:07.912585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:07.913009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:07.914375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:07.917313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:07.976710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2887/5745] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:07 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:07.977229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:07.994865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72507398-02fd-4c71-9385-dc9300db0fea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.095312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.096245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.096541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.096826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.097551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.101695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.162031 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2859/5746] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:07 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:11:08.165674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.189284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2b88d-066a-4b8d-8062-5d1301cc04a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.200216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.201842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.202692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.203172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.204358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.206643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.227291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2888/5747] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:08.231748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.254931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3ecdc-d580-421c-b3bd-23cef5121672 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.263607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.267113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.267409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.267727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.268520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.271065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecace0-7431-43a4-af56-5d777785d9b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.286021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2860/5748] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:08.290112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.306731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c6a87-3100-44b1-b697-bfcd5999f00f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.316985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.318087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.318632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.319025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] PATH_INFO: `/v3/projects/0a3a64114fac4463a413491b0c9814eb/users/3543143d38224382951e099fba0170ac/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.339164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3a64114fac4463a413491b0c9814eb, user_id=3543143d38224382951e099fba0170ac, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.350340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.390128 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2889/5749] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:08 2022] PUT /identity/v3/projects/0a3a64114fac4463a413491b0c9814eb/users/3543143d38224382951e099fba0170ac/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:08.401642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.402145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.402533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.440461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] MFA Rules not processed for user `3543143d38224382951e099fba0170ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:08.441989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:08.557880 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2861/5750] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:08.562407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.640768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a9715-a8a2-40ab-8b35-fda8dc07257f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.645953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.646628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.646943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.647347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.648816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.651034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.690014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2890/5751] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:08 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:08.692776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.751726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c53f12-d6eb-4136-a170-5a1ab2d30876 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.799190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:08.871431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.872181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.872466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.872742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.877986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.880474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.924209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2862/5752] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:08 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:08.925702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:08.943520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858e30f-72c2-4567-8851-c7a3a73d79a9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:08.960352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:08.962841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:08.964141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:08.964765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:08.965771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:08.968181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:08.991907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:09.009328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2891/5753] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:09.012968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:09.031251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e1bc4-c2a6-407f-9744-5799ba302351 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:09.044137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:09.046731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.047093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.048111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] PATH_INFO: `/v3/projects/fbb628e354294dc6a57f1a9127fefefc/users/1dc9f8c6c3504981aecf7d7a900baee1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.076396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb628e354294dc6a57f1a9127fefefc, user_id=1dc9f8c6c3504981aecf7d7a900baee1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:09.079086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:09.104735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2863/5754] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:09 2022] PUT /identity/v3/projects/fbb628e354294dc6a57f1a9127fefefc/users/1dc9f8c6c3504981aecf7d7a900baee1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:09.106503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:09.124490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67248-6a57-4b28-87d5-1838119e7a03 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:09.227740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:09.228478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.229121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.229399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.230396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:09.232213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6043d73-0a64-400c-adb9-f94b79b47f30 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:09.246445 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2892/5755] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:09.250542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:09.262600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685c7eb-75a1-4d2f-801b-464d46b89995 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:09.269284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:09.270729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.271156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.271647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] PATH_INFO: `/v3/projects/fbb628e354294dc6a57f1a9127fefefc/users/1dc9f8c6c3504981aecf7d7a900baee1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.274184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb628e354294dc6a57f1a9127fefefc, user_id=1dc9f8c6c3504981aecf7d7a900baee1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:09.277752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:09.292528 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2864/5756] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:09 2022] PUT /identity/v3/projects/fbb628e354294dc6a57f1a9127fefefc/users/1dc9f8c6c3504981aecf7d7a900baee1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:09.303063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.303543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.303903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.337513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] MFA Rules not processed for user `1dc9f8c6c3504981aecf7d7a900baee1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:09.338781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:09.447748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2893/5757] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:09.463451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:09.466571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:09.567092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c859808-ad5a-44cc-8849-3f038de7f89b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:09.578614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:09.579969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.579969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.580789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.606825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:09.608564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4819b3-c4cc-4d78-a2aa-e41355c1f83d service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:09.643629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2865/5758] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:09.748648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:09.766170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5af9fe-dd73-4dc3-b770-a698660dcdef None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:09.771571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:09.772318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:09.772522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:09.772974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:09.866360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:09.870074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:09.906179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2894/5759] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:15.548100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde20de7-327a-42f5-b9e2-515211f2ab8a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:15.549645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde20de7-327a-42f5-b9e2-515211f2ab8a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:15.551306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde20de7-327a-42f5-b9e2-515211f2ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:15.596547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cde20de7-327a-42f5-b9e2-515211f2ab8a None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:15.598425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cde20de7-327a-42f5-b9e2-515211f2ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:15.716707 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2866/5760] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:16.708681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:16.711366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:16.745972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:16.806879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb2ba-038a-4036-b8af-4ab3dfe3a867 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:16.814472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:16.815631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:16.815872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:16.816257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] PATH_INFO: `/v3/users/8be06f3ffd3d473f80443e87eec03017` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:16.817846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be06f3ffd3d473f80443e87eec03017)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:16.820287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:16.886003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be06f3ffd3d473f80443e87eec03017'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:16.897010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be06f3ffd3d473f80443e87eec03017'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:16.898194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be06f3ffd3d473f80443e87eec03017'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:16.899039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be06f3ffd3d473f80443e87eec03017'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:16.916030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be06f3ffd3d473f80443e87eec03017'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:16.937332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2895/5761] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:16 2022] DELETE /identity/v3/users/8be06f3ffd3d473f80443e87eec03017 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:16.942268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:16.943112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:16.943716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:16.984780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:16.986460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.012157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:17.109377 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2867/5762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:17.125945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:17.129377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.258893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b87c-f3e5-46b6-ab58-fd8291c797da admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:17.272815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:17.284257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:17.286151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:17.286547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:17.306095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:17.309223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:17.338323 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2896/5763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:17.423885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:17.426667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.536376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bd37-69fe-431c-865e-de9e524155da None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:17.543687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:17.545256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:17.545675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:17.546058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:17.548434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.569206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:17.572248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ec21a-c4ea-4809-a629-a1e04ae23a7c service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:17.606181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2868/5764] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:17.738387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:17.743593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:17.743957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:17.746319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.747137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:17.783568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1bb-b5e7-4f1e-8fcb-40d1c9591fca service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:17.796136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:17.797387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:17.801046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:17.802926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:17.803384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:17.803970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] PATH_INFO: `/v3/projects/02b1c0c103804925ae7c6ee99d35c946` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:17.806506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b1c0c103804925ae7c6ee99d35c946)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:17.808902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:17.908456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:17.916695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2869/5765] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:17.918084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:17.938502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b1c0c103804925ae7c6ee99d35c946', 'request_id': 'req-612c7120-dbdd-4727-8598-e1d0463c218d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:17.954099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725aaac-6b2b-4412-8d26-3869b142759c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:17.959101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b1c0c103804925ae7c6ee99d35c946', 'request_id': 'req-612c7120-dbdd-4727-8598-e1d0463c218d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:17.973840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b1c0c103804925ae7c6ee99d35c946', 'request_id': 'req-612c7120-dbdd-4727-8598-e1d0463c218d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:18.025086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] The token cache is being invalidate because project 02b1c0c103804925ae7c6ee99d35c946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:18.026016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:18.028388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-612c7120-dbdd-4727-8598-e1d0463c218d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:18.051577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2897/5766] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:17 2022] DELETE /identity/v3/projects/02b1c0c103804925ae7c6ee99d35c946 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:18.057486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcca56-8786-4e88-97de-15a21a9ca33e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.060065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcca56-8786-4e88-97de-15a21a9ca33e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.065565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcca56-8786-4e88-97de-15a21a9ca33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.136196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c9fcca56-8786-4e88-97de-15a21a9ca33e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:18.137961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9fcca56-8786-4e88-97de-15a21a9ca33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:18.189813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:18.226749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.228337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.230013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.231729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.239830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:18.261404 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2898/5767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:18.271053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.271626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.272048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.279453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.281582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.300356 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2870/5768] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:18.346080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:18.350546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:18.406120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2899/5769] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:18.407342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.426383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53460bf4-98b0-434d-bc62-78b2c3380b7a service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.435557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.437281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.437804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.438486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.439462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:18.439955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.441904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.459701 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2871/5770] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:11:18.467109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.484989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd337-bd5d-4276-ab2c-3c10453f1f8d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.499421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.500693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.500693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.501729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.501729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.504288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.563924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2900/5771] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:18 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:18.566968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.593844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef759ffc-704d-4772-b1f6-c7847eac378d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.725238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.726565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.727753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.730419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.733578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.738445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.788841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2872/5772] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:18 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:18.793149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.823275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee172-5369-487f-b4de-b637e6aa9751 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.838708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.839408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.839836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.840120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.840871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.842540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.883114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.883425 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2901/5773] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:18.899775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012517b-6d43-447c-ac9d-c1dbbd65723a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.907043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.907043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.907303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.907779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:18.908519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:18.911320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9d453-2741-49f9-a2e7-e899336bf368 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:18.942198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2873/5774] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:11:18.944019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:18.958575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdab70c-2815-47d4-adfc-463fb28b2a55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:18.973259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:18.974359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:18.974717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:18.975375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] PATH_INFO: `/v3/projects/8e0d454fa6b747e1a773339b2c13edf0/users/36a9b57c4c95432f9658d11b8481624c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:19.020702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0d454fa6b747e1a773339b2c13edf0, user_id=36a9b57c4c95432f9658d11b8481624c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:19.027332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:19.066124 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2902/5775] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:18 2022] PUT /identity/v3/projects/8e0d454fa6b747e1a773339b2c13edf0/users/36a9b57c4c95432f9658d11b8481624c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:19.077707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:19.078239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:19.078239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:19.149823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] MFA Rules not processed for user `36a9b57c4c95432f9658d11b8481624c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:19.151326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:19.342610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2874/5776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:19.354105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:19.356522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:19.487293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651e1ad-c8cc-4fe5-b9b6-7b56704d83ab admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:19.492519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:19.493366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:19.493656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:19.493938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:19.507921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:19.510885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9ea7-c45c-4f1b-b7b5-16a2856c3691 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:19.524075 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2903/5777] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:20.115201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:20.254952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:20.310975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93cf8-2171-4943-91f5-d1fe25d00319 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:20.324537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:20.325600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:20.329078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:20.329418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] PATH_INFO: `/v3/users/36a9b57c4c95432f9658d11b8481624c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:20.332967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9b57c4c95432f9658d11b8481624c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:20.337733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:20.482655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9b57c4c95432f9658d11b8481624c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:20.487311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9b57c4c95432f9658d11b8481624c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:20.509108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9b57c4c95432f9658d11b8481624c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:20.512323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9b57c4c95432f9658d11b8481624c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:20.545862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9b57c4c95432f9658d11b8481624c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:20.577724 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2875/5778] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:20 2022] DELETE /identity/v3/users/36a9b57c4c95432f9658d11b8481624c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:11:20.583253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:20.584230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:20.584684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:20.593812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:20.617750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:20.621526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:20.738450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2904/5779] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:20.745832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:20.747758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:20.841220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd99ef-80f8-48e6-ab55-281b7ab6990c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:20.846816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:20.848477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:20.848936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:20.849348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:20.863123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:20.865605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e8f00-0c68-4d90-a5a3-861330618d4c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:20.878608 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2876/5780] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:21.661503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:21.663002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:21.677862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9da5aa-1446-4510-ac66-4b00f7eb9570 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:21.686517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:21.687787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:21.688285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:21.688770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] PATH_INFO: `/v3/users/3543143d38224382951e099fba0170ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:21.692308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3543143d38224382951e099fba0170ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:21.694678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:21.813528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3543143d38224382951e099fba0170ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:21.823769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3543143d38224382951e099fba0170ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:21.824547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3543143d38224382951e099fba0170ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:21.825434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3543143d38224382951e099fba0170ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:21.846553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3543143d38224382951e099fba0170ac'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:21.870784 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2905/5781] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:21 2022] DELETE /identity/v3/users/3543143d38224382951e099fba0170ac => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:21.876711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:21.877282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:21.877282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:21.898895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:21.909537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.022205 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2877/5782] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:22.051753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.053946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.068531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.070229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.103036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881474-dd56-4194-8e02-fa9533ad2f7e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.130496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.132648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.139573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.140209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] PATH_INFO: `/v3/projects/8e0d454fa6b747e1a773339b2c13edf0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.145034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0d454fa6b747e1a773339b2c13edf0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.150259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.154944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:22.221459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441da2-956d-4a0c-bf8d-a47637de5aa4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.239826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.240573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.240863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.241209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.260188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.261669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8902-7a84-4c9c-bd38-c4e5aa27ce0c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.263747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0d454fa6b747e1a773339b2c13edf0', 'request_id': 'req-a7265c93-d602-4ba6-a70f-6561560b52c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:22.275502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0d454fa6b747e1a773339b2c13edf0', 'request_id': 'req-a7265c93-d602-4ba6-a70f-6561560b52c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:22.286988 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2906/5783] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:22.296533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0d454fa6b747e1a773339b2c13edf0', 'request_id': 'req-a7265c93-d602-4ba6-a70f-6561560b52c8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:22.326237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] The token cache is being invalidate because project 8e0d454fa6b747e1a773339b2c13edf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:22.326596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:22.327545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a7265c93-d602-4ba6-a70f-6561560b52c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:22.332853 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2878/5784] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:22 2022] DELETE /identity/v3/projects/8e0d454fa6b747e1a773339b2c13edf0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:22.334523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.334824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.335240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.368816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:22.370059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.405291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:22.499052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2907/5785] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:22.501545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.503462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.504237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.533074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:22.535753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.552021 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2879/5786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:22.552964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.566569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4359e55-2c6a-4a56-9cb2-a5018f9ee80c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.572949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.573651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.573950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.574228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.575084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:22.575570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.578827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.597326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2908/5787] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:11:22.602846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.615882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca3957-cf8b-41c7-a775-37b626f7fb42 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.622165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.623000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.623727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.623727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.624467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.627007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.703237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2880/5788] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:22 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:22.708400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.722363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e4a3-ade8-41c5-9971-3761217d8d27 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.790207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.792141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:22.907497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.908392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.908793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.909090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.909801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.916163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.936375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbad5cb-7a98-4a2f-925a-a6eea6735b25 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:22.947547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:22.948904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:22.949356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:22.949805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] PATH_INFO: `/v3/projects/0a3a64114fac4463a413491b0c9814eb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:22.961918 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2909/5789] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:22 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:22.962260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3a64114fac4463a413491b0c9814eb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:22.965875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:22.966635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:22.990155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebe44-c230-4e1b-9ec1-e2d7b78908b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:23.005069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:23.006344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.007473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.009978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.011050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:23.015340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:23.050257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2910/5790] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:23.051667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:23.076315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d157c5-5947-43a9-b7ac-0fae4ed5619e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:23.100853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3a64114fac4463a413491b0c9814eb', 'request_id': 'req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.111532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3a64114fac4463a413491b0c9814eb', 'request_id': 'req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.125829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3a64114fac4463a413491b0c9814eb', 'request_id': 'req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.128535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:23.159775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] The token cache is being invalidate because project 0a3a64114fac4463a413491b0c9814eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:23.160097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.161061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.167271 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2881/5791] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:22 2022] DELETE /identity/v3/projects/0a3a64114fac4463a413491b0c9814eb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:23.172662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:23.178710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:23.224350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:23.225733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.226132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.226514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.227812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:23.229555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:23.250412 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2911/5792] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:11:23.251486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:23.254219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:23.278335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2987f2-09c3-4222-abc9-3be208536587 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:23.289786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:23.293306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.293457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.293705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] PATH_INFO: `/v3/projects/e68f80580af543d69c6bdbb647816d9a/users/78099ad4223745278972020838fd9f70/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.315090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fd5cd-fe85-48c6-a972-cdf4b7eefa95 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:23.322339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:23.323468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.324310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.325180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] PATH_INFO: `/v3/users/1dc9f8c6c3504981aecf7d7a900baee1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.326753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc9f8c6c3504981aecf7d7a900baee1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:23.329176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:23.352669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68f80580af543d69c6bdbb647816d9a, user_id=78099ad4223745278972020838fd9f70, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:23.356497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f5071-878a-4baa-8df4-fa03b3318825 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:23.386813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:23.409678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2912/5793] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:23 2022] PUT /identity/v3/projects/e68f80580af543d69c6bdbb647816d9a/users/78099ad4223745278972020838fd9f70/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:23.416714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.416714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.417382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.463481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc9f8c6c3504981aecf7d7a900baee1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.464841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc9f8c6c3504981aecf7d7a900baee1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.476087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc9f8c6c3504981aecf7d7a900baee1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.478131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc9f8c6c3504981aecf7d7a900baee1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.491091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] MFA Rules not processed for user `78099ad4223745278972020838fd9f70`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:23.493017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:23.516754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc9f8c6c3504981aecf7d7a900baee1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:23.541331 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2882/5794] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:23 2022] DELETE /identity/v3/users/1dc9f8c6c3504981aecf7d7a900baee1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:23.608982 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2913/5795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:11:23.621185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:23.623699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:23.721685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40526-375f-412b-96b2-2b648d0bf072 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:23.726617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:23.727316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:23.727641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:23.727917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:23.776160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:23.853989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:23.856260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d4a2-515a-4403-9d03-3f9e600a4653 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:23.870678 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2883/5796] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:11:23.901202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:23.903635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:23.991629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724eac1-bb0d-4a43-a52a-8fd4f03d0080 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:24.064997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:24.066054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:24.066437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:24.066818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] PATH_INFO: `/v3/users/78099ad4223745278972020838fd9f70` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:24.068263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78099ad4223745278972020838fd9f70)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:24.070748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:24.123474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:24.137489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78099ad4223745278972020838fd9f70'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:24.146466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78099ad4223745278972020838fd9f70'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:24.147064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78099ad4223745278972020838fd9f70'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:24.147927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78099ad4223745278972020838fd9f70'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:24.165632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78099ad4223745278972020838fd9f70'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:24.186299 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2914/5797] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:11:23 2022] DELETE /identity/v3/users/78099ad4223745278972020838fd9f70 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:24.191107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:24.191636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:24.192008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:24.216277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:24.217964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:24.347764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2884/5798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:24.424643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:24.429139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:24.548356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80851e49-fe20-4352-9289-46af780ed0d8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:24.553775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:24.554293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:24.554747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:24.555807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:24.568231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:24.571090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e501f5d-42ff-4cdb-98d6-d70124d690ef service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:24.601110 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2915/5799] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:25.028645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.033089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:25.085893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e83bb-01ee-4b4c-aa2b-dff687238bcc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.095251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.096778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.104535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.104893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] PATH_INFO: `/v3/projects/fbb628e354294dc6a57f1a9127fefefc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.110062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb628e354294dc6a57f1a9127fefefc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.114017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.214365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb628e354294dc6a57f1a9127fefefc', 'request_id': 'req-b3f98539-524e-4318-abc9-13add13ed9cd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:25.222238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb628e354294dc6a57f1a9127fefefc', 'request_id': 'req-b3f98539-524e-4318-abc9-13add13ed9cd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:25.230011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb628e354294dc6a57f1a9127fefefc', 'request_id': 'req-b3f98539-524e-4318-abc9-13add13ed9cd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:25.250173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] The token cache is being invalidate because project fbb628e354294dc6a57f1a9127fefefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:25.250913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:25.251817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3f98539-524e-4318-abc9-13add13ed9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:25.254825 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2885/5800] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:25 2022] DELETE /identity/v3/projects/fbb628e354294dc6a57f1a9127fefefc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:25.261308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.262177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.262628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.297750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:25.299472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:25.394940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2916/5801] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:25.397260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.397667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.398024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.435287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:25.436920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:25.451913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.456007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:25.486806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2886/5802] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:25.493649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.513081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8254e-93f1-4725-9d18-18f883f20db3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.538771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.540658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.540658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.541786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.542706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:25.547047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.548841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.587181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2887/5803] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:11:25.591799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.613442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd29c-d2db-46d9-a3d3-c07809b6b3c7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.625899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.627567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.627952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.628155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.628832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.630839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.637843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:25.648484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26b15-0d7d-4d89-9d04-06f900aebadc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.657579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.658650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.659186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.659724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.665294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:25.677578 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2888/5804] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:25 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:25.681482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.692929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:25.747579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.750132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.771768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1f531-25a3-4cb8-9181-2a9bd3ad5fb2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.779342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.781290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.781290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.781290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.781644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.783801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.784921 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2917/5805] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:11:25.815785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2889/5806] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:25 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:11:25.820620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.871965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bf275-26c2-47e7-8175-94a7fa607bb0 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.878840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.880025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.881663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.884227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.885664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.890092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.916132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2918/5807] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:25.918368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.931800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601454e4-9723-49fd-b992-ad7a5d7ef844 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.937525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.938399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.938779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.939244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:25.940640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:25.942598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:25.957755 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2890/5808] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:25.962562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:25.981135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e5d3-65c5-4913-a18f-463cb554b95e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:25.992653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:25.993651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:25.993999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:25.994338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] PATH_INFO: `/v3/projects/d3bb2e403511423da10e8427c597ef6d/users/dbc154d4eba04bce8f41de44a97fd257/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.008261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.010483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:26.044916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf8e6-cd01-4f0f-ba39-b512c2efe29f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.062514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.064839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.066789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.067157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] PATH_INFO: `/v3/projects/e68f80580af543d69c6bdbb647816d9a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.071285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68f80580af543d69c6bdbb647816d9a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.073411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb2e403511423da10e8427c597ef6d, user_id=dbc154d4eba04bce8f41de44a97fd257, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.076537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44466ec-b64f-4593-a99b-abc96a0e7193 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.077386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.120559 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2919/5809] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:25 2022] PUT /identity/v3/projects/d3bb2e403511423da10e8427c597ef6d/users/dbc154d4eba04bce8f41de44a97fd257/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:11:26.129249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.129447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.130730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.181093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68f80580af543d69c6bdbb647816d9a', 'request_id': 'req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:26.199857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68f80580af543d69c6bdbb647816d9a', 'request_id': 'req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:26.203002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] MFA Rules not processed for user `dbc154d4eba04bce8f41de44a97fd257`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:26.207139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68f80580af543d69c6bdbb647816d9a', 'request_id': 'req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:26.214306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:26.244611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] The token cache is being invalidate because project e68f80580af543d69c6bdbb647816d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:11:26.245201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:26.246918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d4bfd9b-920e-479b-8be1-93acdb1e5d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:11:26.252976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2891/5810] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:11:26 2022] DELETE /identity/v3/projects/e68f80580af543d69c6bdbb647816d9a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:26.271733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7dd3-ae05-43c3-bd90-182de4806e4a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.271961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7dd3-ae05-43c3-bd90-182de4806e4a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.272243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7dd3-ae05-43c3-bd90-182de4806e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.339031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82de7dd3-ae05-43c3-bd90-182de4806e4a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:26.341979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82de7dd3-ae05-43c3-bd90-182de4806e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:26.417896 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2920/5811] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:11:26.422486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.426558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:26.527357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:26.527609 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2892/5812] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:26.529309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.529608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.529891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.541584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013e15f-51bd-48ff-9c0d-fe042c8c2302 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.554461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:26.556188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:26.556945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.557648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.557937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.558218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.561895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.568702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2893/5813] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:26.571244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.572448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.598699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:26.609110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50df689-fa6b-48c7-8f72-c0aed03ebc9f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.616011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.617911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.618918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.619442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.620941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:11:26.622048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.624919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.628437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2921/5814] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:26.630952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.662052 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2894/5815] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:11:26.680899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.698776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0980-eab7-4ef6-9851-96726ccfb8e5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.777014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96ab9b-2277-4866-884d-41c44ce60c34 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.782751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.783454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.783778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.784059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.785006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.787138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.825753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2922/5816] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:26.827046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.834658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.836094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.836396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.836773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.837425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.839309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.839808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb63628-1784-4071-92e0-ce8e60851563 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.845401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:26.846523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:26.846924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:26.847212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:26.848976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:26.853698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:26.871155 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2923/5817] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:11:26.874412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:26.899423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31de90-1a39-4306-b2d1-da1af1668a99 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:26.906655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2895/5818] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:26.914287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.031219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.032180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.032462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.032745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] PATH_INFO: `/v3/projects/964098f206704c74a4412ea1088ac847/users/aa941d0339d1414192e0c889a904fda7/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.057189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279a6ab-cfb4-4ade-9fbb-139a2eeb5488 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.062810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.063726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.064022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.064299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.065020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.069611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.077559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964098f206704c74a4412ea1088ac847, user_id=aa941d0339d1414192e0c889a904fda7, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.086627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.098616 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2896/5819] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:11:26 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:11:27.104139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.118881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2924/5820] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:26 2022] PUT /identity/v3/projects/964098f206704c74a4412ea1088ac847/users/aa941d0339d1414192e0c889a904fda7/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:27.120094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085a4b-1a59-420f-9806-2b338fd673ae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.126264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.205731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:27.249220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92c565-54e2-4c2b-8edc-e23fe0f3f831 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.261452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.262261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.262733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.263277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.264058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.265718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.278358 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2925/5821] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:27.281713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.283040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.283591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.283972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.284322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.285341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.289325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.296546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:27.300691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e64f-3479-411a-96be-77b082b77188 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.308703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2897/5822] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:27.309681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.312011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.313101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.313456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.314077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] PATH_INFO: `/v3/projects/964098f206704c74a4412ea1088ac847/users/aa941d0339d1414192e0c889a904fda7/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.316979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=964098f206704c74a4412ea1088ac847, user_id=aa941d0339d1414192e0c889a904fda7, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.320358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a1c69-0f5a-46b0-bf1c-574c23b1cfbb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.322681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf63c5-55e8-4715-8d46-e652b563b64b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.328412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.329170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.329528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.329871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.330832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.332643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.334143 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2926/5823] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:27 2022] PUT /identity/v3/projects/964098f206704c74a4412ea1088ac847/users/aa941d0339d1414192e0c889a904fda7/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:27.345226 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2898/5824] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:11:27.346483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.346790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.347060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.350663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.365381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007c080-ebdf-46c2-aa29-401d0fe2b4e9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.391421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] MFA Rules not processed for user `aa941d0339d1414192e0c889a904fda7`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:27.392815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:27.462268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.463520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.463824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.464332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] PATH_INFO: `/v3/projects/6fe3d750f67c4e10bee6a4ded8e6e1a0/users/93fcf13aed364a938eded5c30c316578/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.487284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe3d750f67c4e10bee6a4ded8e6e1a0, user_id=93fcf13aed364a938eded5c30c316578, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.490479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a07dc-2b3c-41fc-bc1f-18f3bd75a3a5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.515331 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2899/5825] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:11:27 2022] PUT /identity/v3/projects/6fe3d750f67c4e10bee6a4ded8e6e1a0/users/93fcf13aed364a938eded5c30c316578/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:11:27.516733 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2927/5826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:27.533445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.533641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.534078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.534529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.547973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:27.585067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] MFA Rules not processed for user `93fcf13aed364a938eded5c30c316578`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:27.586410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:27.686696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11eb7f4-7bb3-4ee8-83db-acb2cfbf706b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.718726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2900/5827] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:11:27.731574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:27.739248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:27.807387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.808130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.808384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.808664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.840903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:27.904810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96dad-880c-41a0-9e8c-20dd09c67193 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:27.908338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.910012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.918649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:27.919929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:27.920547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:27.920979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:27.924946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2928/5828] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:27.944760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:27.946877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2badf-63f7-420b-812c-9a86eb87c387 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:27.995557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2901/5829] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:34.108369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:34.119658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939852-4075-4667-84f2-0c724f1dbe96 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:34.126775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:34.127045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:34.127735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:34.128037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:34.237793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:34.239443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:34.287080 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2929/5830] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:37.320238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499e34-7c62-4cff-b351-a733a2b1a47f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:37.321490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499e34-7c62-4cff-b351-a733a2b1a47f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:37.322191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499e34-7c62-4cff-b351-a733a2b1a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:37.343638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:37.387799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-11499e34-7c62-4cff-b351-a733a2b1a47f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:37.393499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11499e34-7c62-4cff-b351-a733a2b1a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:37.609921 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2902/5831] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:11:37.611374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:37.614244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:37.881599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8785f9-63a4-44db-a3cb-b6fc6b3b87ab service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:37.893475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:37.894269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:37.895187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:37.895613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:37.920612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:37.922590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:37.965483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2930/5832] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:11:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:41.258740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:41.259379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:41.259379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:41.290291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:11:41.291865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:41.404268 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2903/5833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:11:47.953573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=80 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:50.439399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:11:50.469866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c11-98f4-49bf-973a-ef58fabb8dce service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:11:50.477254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:11:50.477254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:11:50.477884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:11:50.478422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:11:50.485413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:11:50.642642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:11:50.648328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:11:50.669305 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2931/5834] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:11:51.388563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=48 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:00.341963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:00.343728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:00.397466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024701c-60bb-42d7-b48b-472e298d73e9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:00.410657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:00.413787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:00.416273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:00.416988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] PATH_INFO: `/v3/users/f290b5d01a074e2c9859488bd4ff1162` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:00.418621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f290b5d01a074e2c9859488bd4ff1162)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:00.427138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:00.553015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f290b5d01a074e2c9859488bd4ff1162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:00.553785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f290b5d01a074e2c9859488bd4ff1162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:00.564365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f290b5d01a074e2c9859488bd4ff1162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:00.565089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f290b5d01a074e2c9859488bd4ff1162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:00.591926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-102deda1-0179-4fcd-b316-5149121cbb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f290b5d01a074e2c9859488bd4ff1162'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:00.625178 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2904/5835] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:00 2022] DELETE /identity/v3/users/f290b5d01a074e2c9859488bd4ff1162 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:00.661820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=30 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:00.935841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:00.975991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a8f4-08f4-4878-8b56-15e0881ed74b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.124047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.125149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.126490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.127292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] PATH_INFO: `/v3/projects/cfea83c42bb443459619d4d679aa1769` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.129017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfea83c42bb443459619d4d679aa1769)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.132967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.214598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfea83c42bb443459619d4d679aa1769', 'request_id': 'req-a6780d6f-e004-4f21-943f-f7fe273bb459'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:01.225686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfea83c42bb443459619d4d679aa1769', 'request_id': 'req-a6780d6f-e004-4f21-943f-f7fe273bb459'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:01.236114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfea83c42bb443459619d4d679aa1769', 'request_id': 'req-a6780d6f-e004-4f21-943f-f7fe273bb459'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:01.259333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] The token cache is being invalidate because project cfea83c42bb443459619d4d679aa1769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:01.259680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:01.260715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a6780d6f-e004-4f21-943f-f7fe273bb459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:01.263585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2932/5836] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:00 2022] DELETE /identity/v3/projects/cfea83c42bb443459619d4d679aa1769 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:01.268311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.268818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.269213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.298414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:01.299287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:01.383053 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2905/5837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:01.392935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.393346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.393831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.421499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:01.423387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:01.445224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2933/5838] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:01.451603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.465377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f9c16-ced4-4bdf-a6a2-1d4757fa1daf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.470903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.471920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.472355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.472776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.473774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:01.474229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.476307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.490871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2906/5839] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:01.496043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.508789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77d4ab-198c-4e4e-8796-6b9b2ec13f72 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.515645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.516419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.516738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.517064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.517890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.520404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.567692 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2934/5840] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:01.568590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.589677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380f553-d4ee-4815-8cfd-0d9adb2d1915 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.679616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.680358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.680648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.680943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.681888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.683919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.695184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:01.712741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2907/5841] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:01 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:01.716888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.730938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9693b7-6b64-4d54-b17f-277f3596703e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.741954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.743036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.743935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.744202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.745001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.747141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.766712 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2935/5842] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:01.772167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.783884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b0be5-047d-4945-8f84-47efeb33bf28 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.790084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.790850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.791108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.791394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.792272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.793936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901877f9-5f71-4649-a364-d5d253cd9a95 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.805425 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2908/5843] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:01.809848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:01.825896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313e41b-7eef-40e5-a438-9afa7f0817f5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:01.832492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:01.833452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.833736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.834052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] PATH_INFO: `/v3/projects/6f00fdd041ad47e69525f3e939dfa38e/users/d069147cbf9649279f79f6c0aac711ef/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.854772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f00fdd041ad47e69525f3e939dfa38e, user_id=d069147cbf9649279f79f6c0aac711ef, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:01.860683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:01.882054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2936/5844] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:01 2022] PUT /identity/v3/projects/6f00fdd041ad47e69525f3e939dfa38e/users/d069147cbf9649279f79f6c0aac711ef/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:01.893760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:01.894109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:01.894789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:01.954732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] MFA Rules not processed for user `d069147cbf9649279f79f6c0aac711ef`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:01.957727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:02.157342 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2909/5845] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:02.503787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:02.506659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:02.559963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:02.636325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:02.644207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:02.665171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c541a02-4c59-4518-b6f9-35f76ad99c1a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:02.678509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:02.679820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:02.680249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:02.680693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] PATH_INFO: `/v3/users/93fcf13aed364a938eded5c30c316578` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:02.683339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93fcf13aed364a938eded5c30c316578)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:02.688157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:02.783935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93fcf13aed364a938eded5c30c316578'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:02.802987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c15e2-8c49-4d1a-8c80-fd92aae23152 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:02.809246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93fcf13aed364a938eded5c30c316578'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:02.810352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93fcf13aed364a938eded5c30c316578'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:02.811230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93fcf13aed364a938eded5c30c316578'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:02.817934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:02.819314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:02.822901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:02.823388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:02.828579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:02.848387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93fcf13aed364a938eded5c30c316578'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:02.850965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:02.852650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601e0c9-758a-43e1-92bd-d6ea7192588a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:02.869719 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2910/5846] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:02.876585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2937/5847] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:02 2022] DELETE /identity/v3/users/93fcf13aed364a938eded5c30c316578 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:02.893705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:02.894268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:02.895139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:02.918427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:02.920073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.007622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:03.046283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2911/5848] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:03.055106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:03.056659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.202735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce69ab-5acf-4e5c-a700-c5801cfa31a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:03.214443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:03.216047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.218924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:03.219819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:03.220097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:03.220371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:03.235310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:03.237011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fe53a-010a-4c5a-a72d-826b2bb57650 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:03.239009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445a58-7dd7-42a3-8a24-19ca712ac03e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:03.253562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:03.254837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:03.255493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:03.257723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] PATH_INFO: `/v3/users/dbc154d4eba04bce8f41de44a97fd257` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:03.260664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc154d4eba04bce8f41de44a97fd257)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:03.263098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:03.263643 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2938/5849] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:03.387538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc154d4eba04bce8f41de44a97fd257'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:03.388663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc154d4eba04bce8f41de44a97fd257'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:03.399042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc154d4eba04bce8f41de44a97fd257'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:03.400772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc154d4eba04bce8f41de44a97fd257'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:03.423139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc154d4eba04bce8f41de44a97fd257'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:03.457738 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2912/5850] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:03 2022] DELETE /identity/v3/users/dbc154d4eba04bce8f41de44a97fd257 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:03.460275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:03.460599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:03.461308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:03.516259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:03.517483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.677837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:03.719200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2939/5851] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:03.753403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:03.756087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.864050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:03.870861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:03.899413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872412e1-9403-46c5-9e1c-88d676ceaca1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:03.911801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:03.912938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:03.913404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:03.914063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] PATH_INFO: `/v3/users/d069147cbf9649279f79f6c0aac711ef` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:03.915736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d069147cbf9649279f79f6c0aac711ef)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:03.918011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:03.938344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2754e-dbbc-4e8a-9aad-8380f5073b63 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:03.942863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:03.943995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:03.944442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:03.944877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:03.957132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:03.959009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:03.975490 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2913/5852] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:04.022534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd069147cbf9649279f79f6c0aac711ef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.032967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd069147cbf9649279f79f6c0aac711ef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.033959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd069147cbf9649279f79f6c0aac711ef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.034583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd069147cbf9649279f79f6c0aac711ef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.085536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3004a18a-b2c5-420e-9f1d-90e5fc141f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd069147cbf9649279f79f6c0aac711ef'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.094780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:04.097286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.122525 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2940/5853] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:03 2022] DELETE /identity/v3/users/d069147cbf9649279f79f6c0aac711ef => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:04.126581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711355-f7f5-4ab2-8394-4a474bc34ca6 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:04.129962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.130076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.130387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.172703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:04.175098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.281919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:04.284573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.284899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.285609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] PATH_INFO: `/v3/projects/6fe3d750f67c4e10bee6a4ded8e6e1a0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.289193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe3d750f67c4e10bee6a4ded8e6e1a0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:04.292166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:04.322006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:04.340312 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2941/5854] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:04.379842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:04.381761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.419868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe3d750f67c4e10bee6a4ded8e6e1a0', 'request_id': 'req-e30e8fec-9cda-4c31-a191-5948aaa152fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.428784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe3d750f67c4e10bee6a4ded8e6e1a0', 'request_id': 'req-e30e8fec-9cda-4c31-a191-5948aaa152fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.443160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe3d750f67c4e10bee6a4ded8e6e1a0', 'request_id': 'req-e30e8fec-9cda-4c31-a191-5948aaa152fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.474595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] The token cache is being invalidate because project 6fe3d750f67c4e10bee6a4ded8e6e1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:04.474595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.476122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e30e8fec-9cda-4c31-a191-5948aaa152fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.478927 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2914/5855] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:04 2022] DELETE /identity/v3/projects/6fe3d750f67c4e10bee6a4ded8e6e1a0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:04.484229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.484858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.485436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.493734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2192a-cfa1-4abd-b4b9-412a86be1875 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:04.534854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:04.539432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:04.540869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.585207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:04.587827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.588258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.588545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.595954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.690706 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2915/5856] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:04.698100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:04.699644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:04.699911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c519f8-0cbc-4ca6-a27c-5f3491d0319f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:04.701081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.716625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851c41-0b10-4db7-aa6b-9e0ef18aeda9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:04.723953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:04.725373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.725882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.726166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] PATH_INFO: `/v3/projects/d3bb2e403511423da10e8427c597ef6d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.727668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bb2e403511423da10e8427c597ef6d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:04.730240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:04.732951 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2942/5857] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:04.735665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.735966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.736252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.783352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:04.787656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.813443 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2943/5858] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:04.815683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:04.835053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bb2e403511423da10e8427c597ef6d', 'request_id': 'req-70c045b6-7335-4d3d-874b-10739e96f595'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.840771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747d799-3808-49d5-ab15-fcfde7751c56 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:04.853265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bb2e403511423da10e8427c597ef6d', 'request_id': 'req-70c045b6-7335-4d3d-874b-10739e96f595'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.871677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bb2e403511423da10e8427c597ef6d', 'request_id': 'req-70c045b6-7335-4d3d-874b-10739e96f595'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.900225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] The token cache is being invalidate because project d3bb2e403511423da10e8427c597ef6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:04.900838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.904107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:04.907260 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2916/5859] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:04 2022] DELETE /identity/v3/projects/d3bb2e403511423da10e8427c597ef6d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:04.912275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:04.916412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:04.977561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:04.989405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:04.990263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:04.990460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:04.991547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:04.991547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:04.991804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:04.993597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.010674 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2944/5860] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:05.015342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.018993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:05.036659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb251b7-b87c-4796-999d-c0e7d977f252 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.042829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.043584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.043876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.044155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.044970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.048045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.055771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c045b6-7335-4d3d-874b-10739e96f595 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.065677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.069032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.069542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.069813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] PATH_INFO: `/v3/users/aa941d0339d1414192e0c889a904fda7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.071946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa941d0339d1414192e0c889a904fda7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.074818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.086834 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2945/5861] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:05 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:05.094720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.159735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa941d0339d1414192e0c889a904fda7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:05.164101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa941d0339d1414192e0c889a904fda7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:05.172031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:05.183207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa941d0339d1414192e0c889a904fda7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:05.184153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa941d0339d1414192e0c889a904fda7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:05.211851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa941d0339d1414192e0c889a904fda7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:05.236238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2917/5862] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:04 2022] DELETE /identity/v3/users/aa941d0339d1414192e0c889a904fda7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:05.246485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab122bf-4d00-480f-9fa2-33431949e7f6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.341541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.342591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.343219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.343768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.345361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.347827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.406376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2946/5863] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:05 2022] POST /identity/v3/users => generated 289 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:05.411988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.414055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:05.438864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065bf5-b5e3-4775-ae39-b7142e5dffc3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.457182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.460749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.460749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.461415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.463454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.468216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.519788 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2918/5864] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:05.519965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.535139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e4afa-ff83-4465-933e-0e162b2fc54e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.544739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.545578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.545914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.546205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.547072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.551947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5f58-f1e5-47e6-a32e-c2d25622b308 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.574185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2947/5865] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:05.577010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.594716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a27c1-0b10-4472-b5a6-a295e08f9452 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:05.607828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:05.611739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.612619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.612906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] PATH_INFO: `/v3/projects/22eaaf101e61462d969eb2c85a09b5fe/users/37c41e9b48664fde91ed8d7fc866e84a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.655765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22eaaf101e61462d969eb2c85a09b5fe, user_id=37c41e9b48664fde91ed8d7fc866e84a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:05.659827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:05.733617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2919/5866] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:05 2022] PUT /identity/v3/projects/22eaaf101e61462d969eb2c85a09b5fe/users/37c41e9b48664fde91ed8d7fc866e84a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:05.748885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:05.749397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:05.749777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:05.813603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] MFA Rules not processed for user `37c41e9b48664fde91ed8d7fc866e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:05.815427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:05.944074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2948/5867] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:05.952006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.954210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:05.981972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:05.985018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.085894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:06.106940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aba93-ae0e-4295-9401-6ebb22798b08 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.111426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.112535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.113009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.113562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.125847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92ad7d-c9cd-4152-a689-89c99dd9bf3b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.132466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.133899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.134927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.135383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.137970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.138506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] PATH_INFO: `/v3/projects/964098f206704c74a4412ea1088ac847` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.140927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=964098f206704c74a4412ea1088ac847)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.145911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.153016 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2920/5868] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:06.228483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.233275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.251065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964098f206704c74a4412ea1088ac847', 'request_id': 'req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.254075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d2c9d-5d7c-43f4-ae1b-35c4c7686a3b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.262545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:06.268158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964098f206704c74a4412ea1088ac847', 'request_id': 'req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.289604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964098f206704c74a4412ea1088ac847', 'request_id': 'req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.327069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] The token cache is being invalidate because project 964098f206704c74a4412ea1088ac847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:06.327390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.329018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3b1fc276-9779-4dde-b5be-ebd9d6a7bcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.332750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2949/5869] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:05 2022] DELETE /identity/v3/projects/964098f206704c74a4412ea1088ac847 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:06.340637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbbf5-0700-483b-a730-4a8b546592cf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.342804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbbf5-0700-483b-a730-4a8b546592cf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.343263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbbbf5-0700-483b-a730-4a8b546592cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.398132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1bbbbbf5-0700-483b-a730-4a8b546592cf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:06.399926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1bbbbbf5-0700-483b-a730-4a8b546592cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.405429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.406871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.408025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.408403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] PATH_INFO: `/v3/projects/6f00fdd041ad47e69525f3e939dfa38e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.410806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f00fdd041ad47e69525f3e939dfa38e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.413880 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2950/5870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:06.417470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.424035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.424387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.424603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.470157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:06.471451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.482084 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2951/5871] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:06.486097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.500287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f016b-aab2-4c09-8e7c-d4b5964ba4a5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.514256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.517233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.517797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.518270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.521684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:06.527552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.527552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.545523 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2952/5872] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:12:06.550650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.564813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b3b89-5062-4b9a-87ae-fab34a447d03 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.587187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f00fdd041ad47e69525f3e939dfa38e', 'request_id': 'req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.598976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f00fdd041ad47e69525f3e939dfa38e', 'request_id': 'req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.609251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f00fdd041ad47e69525f3e939dfa38e', 'request_id': 'req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.637688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] The token cache is being invalidate because project 6f00fdd041ad47e69525f3e939dfa38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:06.638722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.639459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d7aac5be-0dd8-4f26-8bff-c968c6ad5287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:06.642887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2921/5873] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:06 2022] DELETE /identity/v3/projects/6f00fdd041ad47e69525f3e939dfa38e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:06.643940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.645665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.645990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.646442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.647632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.650584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.651431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6f40-193a-459e-9726-303451d0d09d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.652048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6f40-193a-459e-9726-303451d0d09d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.652634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6f40-193a-459e-9726-303451d0d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.687553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7c6f6f40-193a-459e-9726-303451d0d09d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:06.689347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7c6f6f40-193a-459e-9726-303451d0d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.691458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2953/5874] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:06.696569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.700827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.786120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:06.814227 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2922/5875] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:06.822822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.823785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.824621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.834574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf67bdb-d27a-460a-b913-579093d7b80e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.841030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.841975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.842506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.842885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.843906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.846192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.856030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:06.857991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:06.875996 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2923/5876] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:06.882614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.895245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e1957-8222-4c7c-96a0-10891eaae38d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.897365 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2954/5877] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:06.898925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.902561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.903751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.904248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.904990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.906038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:06.906597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.908740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.916878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b52f3-9a0e-4be4-b217-9a8a334b6fb3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.923303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.924571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.924851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.925125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.925904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.926666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2924/5878] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:06.932793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.933279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.947616 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2955/5879] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:06.951091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93012c-e26d-497c-b3fc-c8c9f9307f78 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.952844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:06.957788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.960311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.960826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.961551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.963189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.964659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3155e-7988-4c66-a34d-8cac924559c3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:06.967423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.970515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:06.971453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:06.971963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:06.972252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:06.973899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:06.975716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:06.996963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:06.999007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2956/5880] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:07.000284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.021275 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2925/5881] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:07.023609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.041718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f01aa-7800-4c85-90e4-d5f101eec9c3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.165577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358856-60b6-43dc-80d1-782a89719b79 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.182827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.183893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.184543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.185142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.187266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.193695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.212550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.221457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.221852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.222163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] PATH_INFO: `/v3/projects/6d95c6f6c7984ac08ef5118ec96da965/users/3470e522e0f54c29bfe5b6a359d78148/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.275387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d95c6f6c7984ac08ef5118ec96da965, user_id=3470e522e0f54c29bfe5b6a359d78148, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.278395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661912e-fd44-4e97-b354-1dc8b8a19708 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.282615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2926/5882] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:07 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:07.284467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.317871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d196c2-dba7-4a4f-87bc-6679e805e390 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.322591 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2957/5883] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:06 2022] PUT /identity/v3/projects/6d95c6f6c7984ac08ef5118ec96da965/users/3470e522e0f54c29bfe5b6a359d78148/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:07.336049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.336478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.336642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.431238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] MFA Rules not processed for user `3470e522e0f54c29bfe5b6a359d78148`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:07.432733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:07.517593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.520828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.521628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.522674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.525750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.531616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f96aee-3b45-4319-b6c3-dc92a3bace88 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.574909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2927/5884] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:07.574909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.574909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.574909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.622627 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2958/5885] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:07.625003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:07.626484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:07.629740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.673922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239ae7-faff-4d3a-a422-f88dd9880006 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.683865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.685233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.685806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.686774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.690102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.692815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.713886 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2959/5886] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:07.715038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.729674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b8a4-2a64-4c00-9eb5-f78c1415e078 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.739205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.740475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.740835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.741261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.742047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.744896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.753658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:07.759347 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2928/5887] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:07.761422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.781969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbcead-3743-47f4-95d4-d776f72889cf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:07.798733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:07.799922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:07.800297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:07.800586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] PATH_INFO: `/v3/projects/0b7bbfd7ad2348b1ba8a2490465828a3/users/5da6e74070e5462c93ad72515196cdab/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:07.820243 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2960/5888] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:07 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:07.820243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.823145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:07.848803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7bbfd7ad2348b1ba8a2490465828a3, user_id=5da6e74070e5462c93ad72515196cdab, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:07.856195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:07.888596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2929/5889] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:07 2022] PUT /identity/v3/projects/0b7bbfd7ad2348b1ba8a2490465828a3/users/5da6e74070e5462c93ad72515196cdab/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:07.889468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:07.912706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:07.976280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186cdf-8bec-4108-a2c1-8dc2effaa092 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:08.035888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe63e0-9316-4f65-8f86-771eab40a0d4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:08.046314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:08.047026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.047317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.047630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.048334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:08.050293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4f782-29e2-49a7-9bc1-5fb0b04809d1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:08.095160 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2930/5890] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:07 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:08.095160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414475d0-e616-4417-b271-250a419d0468 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.095160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414475d0-e616-4417-b271-250a419d0468 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.095160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414475d0-e616-4417-b271-250a419d0468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.135304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:08.136607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.136607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.136915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.188585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-414475d0-e616-4417-b271-250a419d0468 None None] MFA Rules not processed for user `5da6e74070e5462c93ad72515196cdab`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:08.189886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-414475d0-e616-4417-b271-250a419d0468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:08.316045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:08.323747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:08.367817 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2961/5891] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:12:08.373113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:08.410234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ff56f-38e1-45ac-a513-666dbc87a24a service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:08.423345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:08.424119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.424355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.424633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.425906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:08.431553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:08.459705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2931/5892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:08.465591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414475d0-e616-4417-b271-250a419d0468 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:08.494208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2962/5893] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:08.500433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:08.502440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414475d0-e616-4417-b271-250a419d0468 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:08.522925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:08.526330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.529224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.531183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.532978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:08.542675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58230f7-c0a9-4a50-bb28-7cf3c5e1d688 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:08.543955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74eb22-6be8-4f0b-a40f-d8fa512ca4f1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:08.580342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:08.590013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.590982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.591273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] PATH_INFO: `/v3/projects/e0a177499634477797d0ef41552bf5c8/users/2e2c1efe54cb40eaa10b266fc1af256d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.668823 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2932/5894] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:08 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:08.674646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:08.675645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:08.676077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:08.680783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a177499634477797d0ef41552bf5c8, user_id=2e2c1efe54cb40eaa10b266fc1af256d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:08.708106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:08.723017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:08.754987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:08.756589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:08.767424 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2963/5895] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:08 2022] PUT /identity/v3/projects/e0a177499634477797d0ef41552bf5c8/users/2e2c1efe54cb40eaa10b266fc1af256d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:08.770871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:08.988683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c684eb-53cf-45d5-960c-28977687e31e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.007075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.013104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.013443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.014137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.015467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.020322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:09.096589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2933/5896] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:09.097708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.136792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2964/5897] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:08 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:09.138179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.144993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f0818-62c1-4fa6-b8fd-8b4b871b8c44 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.157901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27281cb2-d2a8-4dcd-b1e9-950b06fb55b4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.159950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.163209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.163528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.166390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.167150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.168755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:09.170360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:09.187844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.190858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.192401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.194247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.197569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.203390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:09.215040 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2934/5898] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:09.228968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.236133 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2965/5899] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:09.240980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.258182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5d23-7a03-48ca-a1e9-1f2462c199b8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.265804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.267315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.267813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.268240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] PATH_INFO: `/v3/projects/451f0efbe9104d859907c18b713ecff6/users/bf4b2ade95334d61b4be4008e6a169d8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.271707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb8cc-4df2-48d3-b08d-acbfecc6325d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.286605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.289783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.290861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.292116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] PATH_INFO: `/v3/projects/e0a177499634477797d0ef41552bf5c8/users/2e2c1efe54cb40eaa10b266fc1af256d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.297385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a177499634477797d0ef41552bf5c8, user_id=2e2c1efe54cb40eaa10b266fc1af256d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.308203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451f0efbe9104d859907c18b713ecff6, user_id=bf4b2ade95334d61b4be4008e6a169d8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.310176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:09.315269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cedbe9-775f-4d7d-82eb-64742412a3e6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:09.351604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2935/5900] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:09 2022] PUT /identity/v3/projects/e0a177499634477797d0ef41552bf5c8/users/2e2c1efe54cb40eaa10b266fc1af256d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:09.353997 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2966/5901] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:09 2022] PUT /identity/v3/projects/451f0efbe9104d859907c18b713ecff6/users/bf4b2ade95334d61b4be4008e6a169d8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:09.358823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.364145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.364648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.365105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.436664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] MFA Rules not processed for user `2e2c1efe54cb40eaa10b266fc1af256d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:09.440990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:09.622440 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2967/5902] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:09.636685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:09.638332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:09.687230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f8586-e10e-4f4a-a01d-8f2db21a2605 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.732091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:09.805576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b04c8d-ff81-4322-8da6-e30879722c1f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:09.818905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.820175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.820175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.820462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.945704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:09.946468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:09.946694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:09.946975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:09.955949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:09.963996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:10.003802 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2936/5903] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 646 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:10.017459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:10.044513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:10.051136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767cb3e-b134-4a75-9509-dd4b8a4e16ab service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:10.063973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bdcb4-a005-4c5a-9891-518e2a888a03 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:10.087072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:10.088031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:10.088344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:10.089403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] PATH_INFO: `/v3/projects/451f0efbe9104d859907c18b713ecff6/users/bf4b2ade95334d61b4be4008e6a169d8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:10.094956 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2968/5904] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:10.098064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451f0efbe9104d859907c18b713ecff6, user_id=bf4b2ade95334d61b4be4008e6a169d8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:10.107561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:10.150329 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2937/5905] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:10 2022] PUT /identity/v3/projects/451f0efbe9104d859907c18b713ecff6/users/bf4b2ade95334d61b4be4008e6a169d8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:10.163424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:10.163885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:10.166669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:10.235381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] MFA Rules not processed for user `bf4b2ade95334d61b4be4008e6a169d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:10.237542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:10.445909 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2969/5906] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:10.448011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:10.471631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a173d-06db-4358-ae4f-fde18c0d8552 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:10.501634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:10.506121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:10.506892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:10.506892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:10.510845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:10.514987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:10.643354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2938/5907] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:10 2022] POST /identity/v3/projects => generated 350 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:10.647446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:10.667280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00613f3-c587-4272-9231-f1ef59a2d59f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:10.956891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:10.963135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:10.963712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:10.964216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:10.975800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:10.978170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.072331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:11.102367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2970/5908] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:10 2022] POST /identity/v3/projects => generated 350 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:11.106632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.126270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a685d7-7ae8-49e6-b8dd-824a9b63f398 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.284448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:11.300283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.301493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.302208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.302208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/users/5da6e74070e5462c93ad72515196cdab` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.303601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:get_user(user_id=5da6e74070e5462c93ad72515196cdab)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.306312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.312002 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2939/5909] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:12:11 2022] GET /identity/v3/users/5da6e74070e5462c93ad72515196cdab => generated 287 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:11.313037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.330369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f50a-91d4-4560-8d12-2ee80ec993d9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.390554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.395261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.395261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.399364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.399364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.405926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.460253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.470327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2971/5910] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Jun 4 21:12:11 2022] POST /identity/v3/credentials => generated 428 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:11.474380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69476d-d205-4daa-b814-bc5f6c9b8929 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.481434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.482556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.483059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.483985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.488854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.491219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.493856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.496193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.522075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.536858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2940/5911] 10.222.0.18 () {60 vars in 1357 bytes} [Sat Jun 4 21:12:11 2022] PATCH /identity/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf => generated 436 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:11.540489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67097adb-2874-4057-9dbf-2fa97235386b tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.554235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.559536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.560128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.560647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.563668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.567636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.577420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.596842 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2972/5912] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jun 4 21:12:11 2022] GET /identity/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf => generated 436 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:11.603893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8ac6-5f03-4b3d-8a6e-58e63cb37e93 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.614217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.618132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.621782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.622892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.628932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.639276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.704049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2941/5913] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Jun 4 21:12:11 2022] DELETE /identity/v3/credentials/ae73190912a6d2ed4fb7c929876c9f97d884433e4d560615a9a48beb5756dcaf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:11.710099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.730038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9637ea-76e5-4a50-a1b7-969b585e130d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.746743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.747560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.748108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.750026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.751970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.756692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.798732 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2973/5914] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Jun 4 21:12:11 2022] POST /identity/v3/credentials => generated 430 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:11.804641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.824975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc99d-7257-4275-a615-790e6da50acb tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.842388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.843740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.844309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.846223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.847293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.852748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:11.914354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2942/5915] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Jun 4 21:12:11 2022] POST /identity/v3/credentials => generated 431 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:11.919153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:11.960709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300066-7ae0-437e-b12f-1d917d0a4d99 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:11.973605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:11.975947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:11.976682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:11.977456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:11.978966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:11.981830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.008117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.013661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.023621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.028637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.037837 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2974/5916] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 21:12:11 2022] GET /identity/v3/credentials => generated 946 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:12.042110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:12.054976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed723f9-a9aa-4c58-8040-c440860b7dd9 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:12.075639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:12.076841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:12.077286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:12.077722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials/c5fb9a7d4f0a8620989575ef7ddcbc8b7bef2887a71875f03b531baba5a1c270` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:12.084481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=c5fb9a7d4f0a8620989575ef7ddcbc8b7bef2887a71875f03b531baba5a1c270)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.087495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.129027 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2943/5917] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Jun 4 21:12:12 2022] DELETE /identity/v3/credentials/c5fb9a7d4f0a8620989575ef7ddcbc8b7bef2887a71875f03b531baba5a1c270 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:12.133699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:12.151641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc596516-5cd7-4ddd-910b-7dd7ba66b58d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:12.159236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:12.161655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:12.162304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:12.162854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/credentials/38f270c422bf1523fd1bc6eb3f455c0f4ee9d9b4fa5069cff7b12f9f4f9de511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:12.166392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=38f270c422bf1523fd1bc6eb3f455c0f4ee9d9b4fa5069cff7b12f9f4f9de511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.170120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.209758 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2975/5918] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Jun 4 21:12:12 2022] DELETE /identity/v3/credentials/38f270c422bf1523fd1bc6eb3f455c0f4ee9d9b4fa5069cff7b12f9f4f9de511 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:12.215171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:12.233962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46fafe-4181-438e-a6a2-8646cfc5918d tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:12.249386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:12.259118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:12.260280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:12.260801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/projects/738af33e026c4d5db50163f38ca744f1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:12.264201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=738af33e026c4d5db50163f38ca744f1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.270089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:12.482348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738af33e026c4d5db50163f38ca744f1', 'request_id': 'req-3005044b-d503-4821-ba1f-294987d7599a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:12.514759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738af33e026c4d5db50163f38ca744f1', 'request_id': 'req-3005044b-d503-4821-ba1f-294987d7599a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:12.572314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738af33e026c4d5db50163f38ca744f1', 'request_id': 'req-3005044b-d503-4821-ba1f-294987d7599a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:12.660625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] The token cache is being invalidate because project 738af33e026c4d5db50163f38ca744f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:12.660945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:12.668775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:12.671155 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2944/5919] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:12 2022] DELETE /identity/v3/projects/738af33e026c4d5db50163f38ca744f1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:12.675354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:12.678354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:12.726524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c20057-e586-4d74-a349-8a334d775c05 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:12.902147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf4b2ade95334d61b4be4008e6a169d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '451f0efbe9104d859907c18b713ecff6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:12.904290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:12.904750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:12.906097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] PATH_INFO: `/v3/projects/a1d63710a2924d3b839f4e69294f0677` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:12.906959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1d63710a2924d3b839f4e69294f0677)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:12.918212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:13.485491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d63710a2924d3b839f4e69294f0677', 'request_id': 'req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:13.501140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d63710a2924d3b839f4e69294f0677', 'request_id': 'req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:13.521162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d63710a2924d3b839f4e69294f0677', 'request_id': 'req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:13.594427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] The token cache is being invalidate because project a1d63710a2924d3b839f4e69294f0677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:13.595001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:13.600264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e4c60572-f5ab-4708-9fa2-6388ab9ce1b4 tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:13.613957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2976/5920] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:12 2022] DELETE /identity/v3/projects/a1d63710a2924d3b839f4e69294f0677 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:13.614862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:13.616591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:13.914229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005044b-d503-4821-ba1f-294987d7599a tempest-CredentialsTestJSON-630535247 tempest-CredentialsTestJSON-630535247-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:14.062645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:14.140514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:14.142615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:14.143708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:14.144201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] PATH_INFO: `/v3/users/5da6e74070e5462c93ad72515196cdab` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:14.146895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da6e74070e5462c93ad72515196cdab)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:14.149668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:14.290558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da6e74070e5462c93ad72515196cdab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:14.294563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da6e74070e5462c93ad72515196cdab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:14.319193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da6e74070e5462c93ad72515196cdab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:14.325084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da6e74070e5462c93ad72515196cdab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:14.351950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da6e74070e5462c93ad72515196cdab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:14.392264 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2945/5921] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:13 2022] DELETE /identity/v3/users/5da6e74070e5462c93ad72515196cdab => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:14.398216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:14.399230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:14.400004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:14.438186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:14.439968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:14.498402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:14.577773 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2977/5922] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:14.599280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:14.604236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:14.764656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e158-3bd1-4b8e-826a-71e903ab3446 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:14.788229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:14.789578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:14.790103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:14.790595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:14.806481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:14.808592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a54c7-a5e5-44d4-9bbd-d5279c778608 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:14.825994 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2946/5923] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:14.956835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:14.958803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:14.979447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc19657-25eb-4477-b8d8-6ef80c7063b4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:14.986330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:14.987532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:14.988373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:14.988597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] PATH_INFO: `/v3/users/3470e522e0f54c29bfe5b6a359d78148` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:14.990571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3470e522e0f54c29bfe5b6a359d78148)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:14.993233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:15.192146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3470e522e0f54c29bfe5b6a359d78148'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.228713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3470e522e0f54c29bfe5b6a359d78148'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.230770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3470e522e0f54c29bfe5b6a359d78148'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.233021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3470e522e0f54c29bfe5b6a359d78148'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.267055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3470e522e0f54c29bfe5b6a359d78148'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.316610 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2978/5924] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:14 2022] DELETE /identity/v3/users/3470e522e0f54c29bfe5b6a359d78148 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:15.319002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:15.319258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:15.319643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:15.369465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:15.387540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:15.526908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:15.575340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2947/5925] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:15.615924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:15.617705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:15.715058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:15.716529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:15.751300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d061c-8476-452a-82fa-f4679b8c380c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:15.775338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:15.776777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:15.781804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:15.782345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] PATH_INFO: `/v3/projects/0b7bbfd7ad2348b1ba8a2490465828a3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:15.785879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7bbfd7ad2348b1ba8a2490465828a3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:15.803729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:15.852790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6bb6a-bc96-4ebd-b626-c7268a910432 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:15.871205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:15.872286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:15.873240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:15.873732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:15.909687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:15.912218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:15.947782 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2979/5926] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:15.976892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7bbfd7ad2348b1ba8a2490465828a3', 'request_id': 'req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:15.989281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7bbfd7ad2348b1ba8a2490465828a3', 'request_id': 'req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.002839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7bbfd7ad2348b1ba8a2490465828a3', 'request_id': 'req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.026244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] The token cache is being invalidate because project 0b7bbfd7ad2348b1ba8a2490465828a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:16.027001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.028334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.030815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2948/5927] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:15 2022] DELETE /identity/v3/projects/0b7bbfd7ad2348b1ba8a2490465828a3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:16.035017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:16.055544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81a1f-649d-4157-8435-7a162bd3d99a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:16.165191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:16.206123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:16.207227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:16.207545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:16.207838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] PATH_INFO: `/v3/users/bf4b2ade95334d61b4be4008e6a169d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:16.213873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4b2ade95334d61b4be4008e6a169d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:16.216125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:16.356123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4b2ade95334d61b4be4008e6a169d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.404161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4b2ade95334d61b4be4008e6a169d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.414505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4b2ade95334d61b4be4008e6a169d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.415429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4b2ade95334d61b4be4008e6a169d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.493521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4b2ade95334d61b4be4008e6a169d8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:16.574264 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2980/5928] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:16 2022] DELETE /identity/v3/users/bf4b2ade95334d61b4be4008e6a169d8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:17.203020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:17.205914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:17.243091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d37c-3e6f-4570-976c-ef6d5a91a1ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:17.403613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:17.404279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:17.404739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:17.405177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] PATH_INFO: `/v3/projects/451f0efbe9104d859907c18b713ecff6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:17.406792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451f0efbe9104d859907c18b713ecff6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:17.409291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:17.596043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451f0efbe9104d859907c18b713ecff6', 'request_id': 'req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.618134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:17.620027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:17.633354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451f0efbe9104d859907c18b713ecff6', 'request_id': 'req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.642294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451f0efbe9104d859907c18b713ecff6', 'request_id': 'req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.648529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5923074-86e6-46c0-9e46-6a77f3a270d1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:17.677383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] The token cache is being invalidate because project 451f0efbe9104d859907c18b713ecff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:17.679864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.693063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-841223a5-d4a3-40c1-93d3-8cbdbf5b1614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.700498 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2949/5929] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:17 2022] DELETE /identity/v3/projects/451f0efbe9104d859907c18b713ecff6 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:17.709298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125be2-4d86-4593-be01-5727d87b0109 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:17.710132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125be2-4d86-4593-be01-5727d87b0109 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:17.710635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125be2-4d86-4593-be01-5727d87b0109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:17.740811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:17.776968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-99125be2-4d86-4593-be01-5727d87b0109 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:17.778647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-99125be2-4d86-4593-be01-5727d87b0109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:17.837148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:17.838039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:17.838318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:17.838592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] PATH_INFO: `/v3/projects/6d95c6f6c7984ac08ef5118ec96da965` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:17.839827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d95c6f6c7984ac08ef5118ec96da965)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:17.842101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:17.953786 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2950/5930] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:17.968428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:17.969011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:17.969284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:17.980093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d95c6f6c7984ac08ef5118ec96da965', 'request_id': 'req-0150413f-c17c-447a-baac-5760213dbe86'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:17.991644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d95c6f6c7984ac08ef5118ec96da965', 'request_id': 'req-0150413f-c17c-447a-baac-5760213dbe86'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.006269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d95c6f6c7984ac08ef5118ec96da965', 'request_id': 'req-0150413f-c17c-447a-baac-5760213dbe86'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.018018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:18.022578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:18.030214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:18.036598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] The token cache is being invalidate because project 6d95c6f6c7984ac08ef5118ec96da965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:18.037844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.038933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.042466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2981/5931] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:17 2022] DELETE /identity/v3/projects/6d95c6f6c7984ac08ef5118ec96da965 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:18.059152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.064092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:18.186140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150413f-c17c-447a-baac-5760213dbe86 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.203668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.205070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.205619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.206279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] PATH_INFO: `/v3/users/2e2c1efe54cb40eaa10b266fc1af256d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.208478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2c1efe54cb40eaa10b266fc1af256d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.212614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.231196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2951/5932] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:18.251463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.276810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9892eec-c34a-4d50-a409-fa579f858e15 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.293235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.294212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.294983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.294983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.295684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:18.296351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.298576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.335171 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2952/5933] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:18.335395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2c1efe54cb40eaa10b266fc1af256d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.339446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.355968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2c1efe54cb40eaa10b266fc1af256d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.355968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2c1efe54cb40eaa10b266fc1af256d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.356727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2c1efe54cb40eaa10b266fc1af256d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.362808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13e08c-2ea7-4b33-99b4-7e8d5a83c6c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.376811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.377997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.378194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.379372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.383003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.385309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.390949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2c1efe54cb40eaa10b266fc1af256d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:18.421241 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2982/5934] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:18 2022] DELETE /identity/v3/users/2e2c1efe54cb40eaa10b266fc1af256d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:18.460276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2953/5935] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:18 2022] POST /identity/v3/projects => generated 391 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:18.461594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.463233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:18.616000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6e571-6d90-4030-991a-ab38b134c1b6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.702961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:18.805825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.807936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:18.813354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.814353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.814630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.814901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.816074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.818790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.833704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7b5e1-cb01-41a3-bed2-3d52fc15c267 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.848025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.848943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.849494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.849851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] PATH_INFO: `/v3/users/37c41e9b48664fde91ed8d7fc866e84a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.852944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c41e9b48664fde91ed8d7fc866e84a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.854916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.861893 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2983/5936] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:18 2022] POST /identity/v3/users => generated 296 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:18.865600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.885793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7951ef-6412-4229-85d3-746f1e07f4a4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.905891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.906563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.906845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.907484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.908727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:18.910060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:18.940437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2984/5937] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:18.943847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:18.979937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e25d5c-3a48-4458-a28b-c1731304d275 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:18.995699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:18.996437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:18.996716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:18.997996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:18.997996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.000075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.027692 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2985/5938] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:19.029110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.042950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c41e9b48664fde91ed8d7fc866e84a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.046430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c41e9b48664fde91ed8d7fc866e84a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.050995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58fca0-94b0-4e75-a524-1147bad8c6f8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.073259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.074208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.074491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.074764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] PATH_INFO: `/v3/projects/5ea7a353245d46519bcf36be90b561c1/users/9ad17763e50a4696b866fb0c4039f51e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.076630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c41e9b48664fde91ed8d7fc866e84a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.081996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c41e9b48664fde91ed8d7fc866e84a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.112580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:19.115542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea7a353245d46519bcf36be90b561c1, user_id=9ad17763e50a4696b866fb0c4039f51e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.118381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7d7b-3c20-4a3f-a128-dc5df355b53e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.139892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2f6be77-42bc-4f9c-a816-c8c28839c1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c41e9b48664fde91ed8d7fc866e84a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.155678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2986/5939] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:19 2022] PUT /identity/v3/projects/5ea7a353245d46519bcf36be90b561c1/users/9ad17763e50a4696b866fb0c4039f51e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:19.171653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.172367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.172367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.190383 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2954/5940] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:18 2022] DELETE /identity/v3/users/37c41e9b48664fde91ed8d7fc866e84a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:19.195657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.199267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.199695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.236312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] MFA Rules not processed for user `9ad17763e50a4696b866fb0c4039f51e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:19.242967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:19.256284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:19.259806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:19.432774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2955/5941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:19.438612 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2987/5942] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:19.443199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.444763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:19.458856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049626ba-5baa-4a1f-81c5-89d9a01b5c27 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.467215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.468125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.468824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.469137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.469491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.469694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:19.470255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.473001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.537815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2956/5943] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:19 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:19.539118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.625190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d042-af19-4893-aee1-a2ed6fe3bddd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.627181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47010-ca93-4226-a354-de73bf4f1e92 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.633470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.634336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.634927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.635280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.636218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.640033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.650496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:19.679033 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2957/5944] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:19 2022] POST /identity/v3/users => generated 301 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:19.680958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.704890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e496d8-4913-4349-9d10-e62b9aa3f67a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.719722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.722216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.722517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.724260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.725076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.729705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.751145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.754505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.754808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.755726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.761413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2958/5945] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:19.761413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.765393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:19.787532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.789432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.800297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162759c-183b-4fd6-8281-0d3ac99ba96f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.813008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.815741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.816095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.816389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] PATH_INFO: `/v3/projects/e0a177499634477797d0ef41552bf5c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.817216 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2988/5946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:19.818550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:19.821190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a177499634477797d0ef41552bf5c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.823780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.842140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0eaecc-a744-4067-bbec-306894519440 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:19.859363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:19.866981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:19.866981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:19.866981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] PATH_INFO: `/v3/projects/90f2b5663ad34a9faae3c3ac59607c87/users/30e5a54ea83843cbb045c725ce795719/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:19.916868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f2b5663ad34a9faae3c3ac59607c87, user_id=30e5a54ea83843cbb045c725ce795719, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:19.943649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:19.956564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:19.993355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2989/5947] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:19 2022] PUT /identity/v3/projects/90f2b5663ad34a9faae3c3ac59607c87/users/30e5a54ea83843cbb045c725ce795719/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:19.993581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a177499634477797d0ef41552bf5c8', 'request_id': 'req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:19.994867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.007727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a177499634477797d0ef41552bf5c8', 'request_id': 'req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:20.025183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a177499634477797d0ef41552bf5c8', 'request_id': 'req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:20.058422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] The token cache is being invalidate because project e0a177499634477797d0ef41552bf5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:20.058718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:20.060010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a469d68f-0b43-4f8e-b0a5-e72f208ce10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:20.063166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2959/5948] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:19 2022] DELETE /identity/v3/projects/e0a177499634477797d0ef41552bf5c8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:20.074128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab84f-9601-4077-88fc-f124d320876e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.074435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab84f-9601-4077-88fc-f124d320876e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.075750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab84f-9601-4077-88fc-f124d320876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.157793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5bdab84f-9601-4077-88fc-f124d320876e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:20.159298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5bdab84f-9601-4077-88fc-f124d320876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:20.216154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35c5b9-15cd-429b-b344-dd50d2b18017 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.249228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:20.252707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.253068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.253368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.254169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:20.267235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:20.331992 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2990/5949] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:20.334718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.343208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:20.376545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0850f-28c7-4d4a-8b59-616136bd522f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.389508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:20.390578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.390761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.391014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] PATH_INFO: `/v3/projects/90f2b5663ad34a9faae3c3ac59607c87/users/30e5a54ea83843cbb045c725ce795719/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.399019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f2b5663ad34a9faae3c3ac59607c87, user_id=30e5a54ea83843cbb045c725ce795719, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:20.416580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b868a-7b3e-4be3-be23-58763036a7a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:20.426467 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2960/5950] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:20.429158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.430792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.433886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.451925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2991/5951] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:20 2022] PUT /identity/v3/projects/90f2b5663ad34a9faae3c3ac59607c87/users/30e5a54ea83843cbb045c725ce795719/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:20.461384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.461780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.462191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.464891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:20.468025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:20.531437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] MFA Rules not processed for user `30e5a54ea83843cbb045c725ce795719`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:20.535448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:20.591192 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2961/5952] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:20.595768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.617592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c5d34-ec40-4615-a0f9-ce1ada1e76a5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.636672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:20.637387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.637679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.637965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.638987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:20.639308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:20.640993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:20.679897 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2962/5953] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:20.681054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.721427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92c474-3962-403a-b365-d4e016f4add4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.721963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:20.738138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:20.738881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.739174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.739458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.740925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:20.742841 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2992/5954] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:20.743936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.745302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:20.764694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a51bd-d44f-45d7-966e-24ac116c6623 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.780683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:20.781730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:20.784178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:20.784598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:20.787653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:20.797311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:20.812503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2963/5955] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:20.816499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.824017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:20.833031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2993/5956] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/domains => generated 275 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:20.839350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:20.908631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:20.991305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2365430-7abf-4f94-8ead-2aaff754f163 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:20.997174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b14a4-0f6a-4909-9645-5f1768c362c7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.009682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.010665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.010959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.011252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] PATH_INFO: `/v3/projects/22eaaf101e61462d969eb2c85a09b5fe` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.012857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22eaaf101e61462d969eb2c85a09b5fe)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.013025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.013820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.015091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.015228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.015568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.019713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.024977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.079493 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2994/5957] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:20 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:21.085161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.136590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22eaaf101e61462d969eb2c85a09b5fe', 'request_id': 'req-3537225e-4f70-4714-bf47-5548bd3a0b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:21.154899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22eaaf101e61462d969eb2c85a09b5fe', 'request_id': 'req-3537225e-4f70-4714-bf47-5548bd3a0b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:21.170981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22eaaf101e61462d969eb2c85a09b5fe', 'request_id': 'req-3537225e-4f70-4714-bf47-5548bd3a0b58'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:21.198934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] The token cache is being invalidate because project 22eaaf101e61462d969eb2c85a09b5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:21.199835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:21.201912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:21.207721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2964/5958] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:20 2022] DELETE /identity/v3/projects/22eaaf101e61462d969eb2c85a09b5fe => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:21.207721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.210434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:21.270613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80c819-d0c6-465b-b461-4c38cbcfc234 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.396002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537225e-4f70-4714-bf47-5548bd3a0b58 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.410172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.411040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.411801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.411801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.412748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.419860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097fb0-7531-4a5d-a040-37af6653e23c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.448367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.450212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.453288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.453591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.453706 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2965/5959] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:21.456101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.456765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.457855 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:21.457855 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:21.457855 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:21.458990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.459292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.461199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3358f8a-fa87-41a8-bafa-73840a862b74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.498612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:21.500294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:21.527757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:21.536411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2966/5960] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:21.536681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.556950 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2995/5961] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:12:21 2022] PUT /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config => generated 138 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:21.558399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.558984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.559268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.561622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a148fc-9fac-44c0-9b1b-1791f3611f35 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.581522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.584174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.584452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.584747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.585556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.587215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.608956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:21.622238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:21.636368 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2967/5962] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:21.637384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.649488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:21.656654 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2996/5963] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:21.663167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.693046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef8e4e-c5f3-4e16-b4fc-de010e8b6cfb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.694317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71fa97-b6f5-4587-85b1-a15143848ac5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.712397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.713344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.713625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.713904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] PATH_INFO: `/v3/projects/4fd1ca1698d14742981eb94fc11d64d8/users/b7385bf9cbff4b30b6f75566ee78d92a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.715549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.716502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.716796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.717585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.719046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28, group=identity)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.722827 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:21.722827 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:12:21.722827 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:12:21.724015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.747388 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2968/5964] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:12:21 2022] GET /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/identity => generated 45 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:21.750832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.765733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd1ca1698d14742981eb94fc11d64d8, user_id=b7385bf9cbff4b30b6f75566ee78d92a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.776389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.790740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693f11-e5d7-4783-9933-d49898a12640 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:21.796818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:21.798991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.799371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.800323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.804889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:21.805256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:21.811012 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2997/5965] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:21 2022] PUT /identity/v3/projects/4fd1ca1698d14742981eb94fc11d64d8/users/b7385bf9cbff4b30b6f75566ee78d92a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:21.815576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:21.817666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b4b81-aaa6-4a31-b3a5-9233260101a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:21.859883 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2969/5966] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:21.860093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:21.860245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:21.860527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:21.905935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:21.909265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:21.937840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:22.000214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265affa3-225d-4155-8be6-1399e92c0f08 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.017179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.018096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.018381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.018664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/identity/driver` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.023147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28, group=identity, option=driver)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.024247 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:22.024247 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:22.024247 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:22.030126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.048324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2998/5967] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:12:21 2022] GET /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/identity/driver => generated 31 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:22.049727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.110517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2970/5968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:22.111421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.128781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660ba4-a013-446f-a18a-63bcbbd2bad3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.134512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.136021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.136558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.136915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.138603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28, group=ldap)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.140881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.148068 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2971/5969] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap => generated 106 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:22.153588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.179876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadae6d1-aaef-416e-96b5-d3f91f6e188a tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.193759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.195446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.195770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.196060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap/url` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.198640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28, group=ldap, option=url)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.204777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.214483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920dd02-2d4e-471d-87e6-243efa894452 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.220136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2972/5970] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap/url => generated 46 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:22.221149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.226813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:22.228807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.229490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.229834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.230120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.230988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.232982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.301199 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 2999/5971] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:22 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:22.301199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.397682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c682-a940-42c9-99a5-c266c7624826 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.442186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:22.484311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70448-81c3-4826-99e9-24c3cc6b3b5c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.501825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.502763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.503057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.503338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap/user_tree_dn` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.507237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28, group=ldap, option=user_tree_dn)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.508892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.526397 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3000/5972] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config/ldap/user_tree_dn => generated 63 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:22.528496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.534378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.535202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.535430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.535789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.683697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6d26-6bf9-4c42-9d44-65264b8b6e8b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.689301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.689981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.690260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.690532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.691225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.694346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.728598 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3001/5973] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:22 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:22.732890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.743124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.744737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.761678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edcf6c-1a8b-4a8f-8374-4b59dcd26c53 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.771223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2973/5974] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:22.773867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.777743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.778666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.778961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.779289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.780057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=032a8c3d22fa4513a4062a2e023f0b28)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.782791 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:22.782791 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:22.782791 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:22.783612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:22.784318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.792255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030c670-5aca-48ab-a4b0-48b72e9a0ba3 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.807268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.808274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.808590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.808870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.810536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.813856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.821531 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3002/5975] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:22 2022] DELETE /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28/config => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:22.826635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.862529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ae4c-5a74-458f-837c-690047459031 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.865323 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2974/5976] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:22.869408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.882739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.883796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.884084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.884364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.888006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=032a8c3d22fa4513a4062a2e023f0b28)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.893751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.896139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f9e4-87e5-485e-ba90-b78bed7cf472 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:22.903312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:22.903945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:22.904246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:22.904501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:22.905681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:22.908297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:22.937134 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2975/5977] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:22.941199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:22.965002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:22.967858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.000838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee1d8-ae63-4e56-9d84-8130b7cbea59 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:23.074083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.075193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.086289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3003/5978] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:22 2022] PATCH /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28 => generated 276 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:12:23.087382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:23.089097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:23.206309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:23.207675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:23.212081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:23.212917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] PATH_INFO: `/v3/projects/4d9e98bceae84c35b931e95dc2e5e31f/users/1edc2788969c45f7b84273de587cb240/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:23.257671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9e98bceae84c35b931e95dc2e5e31f, user_id=1edc2788969c45f7b84273de587cb240, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:23.269726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534189c-ae68-4d7b-b178-ecd5357ec357 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:23.274829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20377c-bac6-456b-a676-1b9d68a2b425 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:23.290065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:23.291021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:23.291293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:23.291590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:23.306041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2976/5979] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:22 2022] PUT /identity/v3/projects/4d9e98bceae84c35b931e95dc2e5e31f/users/1edc2788969c45f7b84273de587cb240/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:23.322474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:23.323554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:23.324061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:23.326154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=032a8c3d22fa4513a4062a2e023f0b28)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:23.330971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:23.378089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] MFA Rules not processed for user `1edc2788969c45f7b84273de587cb240`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:23.380901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:23.407658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:23.419548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.438165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.620991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.663411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.683316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2977/5980] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:23.696107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:23.698796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:23.700800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.741175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] The token cache is being invalidate because project 032a8c3d22fa4513a4062a2e023f0b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:23.741175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.742690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.777840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.781483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.795037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '032a8c3d22fa4513a4062a2e023f0b28', 'request_id': 'req-9cda2539-cd99-485b-a413-34f0411315d3'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:23.817270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3004/5981] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:23 2022] DELETE /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:23.822629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:23.824514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:23.933962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23b8df-b890-45e8-bcbc-6b531d31ca21 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:23.971828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:24.072327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda2539-cd99-485b-a413-34f0411315d3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.090486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.091188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.096042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.096269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.100474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.102164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.125190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.126199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.126835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.127327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.133909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:24.142013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3005/5982] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:12:23 2022] POST /identity/v3/domains => generated 275 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:24.147110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.267229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.269056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.290104 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2978/5983] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:24.297978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:24.305890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782328-0d67-4a54-a414-1f9683e6f827 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.326005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.327088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.327380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.327707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.329595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.331900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.402035 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3006/5984] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:12:24 2022] PUT /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 138 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:24.411805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.427651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9dc71-7f30-4866-8971-c5a07ac3ece2 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.447147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.448437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.448983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.449667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.450654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.452010 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:24.452010 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:12:24.452010 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:12:24.456397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.543120 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2979/5985] 10.222.0.18 () {60 vars in 1270 bytes} [Sat Jun 4 21:12:24 2022] PATCH /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 142 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:24.545987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.591006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce010-5e0b-47f0-a63f-232b19bfa18d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.662485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.664553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.664871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.665298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.681400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.689983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.710438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3007/5986] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:24 2022] GET /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 142 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:24.713453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.747593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c60d1f-66f0-4ffa-bddc-40d92cd83f67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.770406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.771794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.772259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.772639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.773713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.775458 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:24.775458 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:12:24.775458 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:12:24.777756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.809713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2980/5987] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:24 2022] DELETE /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:24.811378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.827222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a59de-3b97-4b1f-b528-eb21715c65c4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.847559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.854690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.855006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.855482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.859731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.861478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find any options in domain configuration for domain a5350f7d87a54840b96d604393c5e26b.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a5350f7d87a54840b96d604393c5e26b. Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:24.906883 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a5350f7d87a54840b96d604393c5e26b. Jun 04 21:12:24.908467 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:12:24.914843 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3008/5988] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:24 2022] GET /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 151 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:24.919297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:24.936351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fa51a-04f6-4eb9-ab75-b9a80c8824b8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:24.951777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:24.959640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:24.960068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:24.960698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b/config` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:24.963481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:24.966234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:24.983122 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2981/5989] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:24 2022] DELETE /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b/config => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:24.987241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:25.009092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34add00-f5d9-44cd-9179-ac416e31ffb0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:25.024321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:25.025410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:25.033285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:25.033705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:25.040941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:25.043352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:25.106408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.107547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.189858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.193332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.200341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3009/5990] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:24 2022] PATCH /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b => generated 276 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:25.202314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:25.204781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:25.257737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827378e-cb93-4bca-9a7f-3c0b54d7ad74 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:25.428271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:25.429479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:25.429926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:25.430368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:25.496132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a5350f7d87a54840b96d604393c5e26b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:25.504838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:25.535904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:25.574891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.584959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.744967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.761236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.780390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.865309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] The token cache is being invalidate because project a5350f7d87a54840b96d604393c5e26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:25.865607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.867813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.881257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.910557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.912391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a5350f7d87a54840b96d604393c5e26b', 'request_id': 'req-a2e63f59-21ea-4a1b-b155-91afe0b26d67'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:25.930822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2982/5991] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:25 2022] DELETE /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:25.936269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:25.953201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743953c-4bf4-413f-9d6c-a2b614cbb824 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:26.138769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:26.140462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:26.141130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.141455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.141695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.141941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:26.143867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:26.146688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:26.178165 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3010/5992] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:12:25 2022] POST /identity/v3/domains => generated 276 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:26.183793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:26.188071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:26.264131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63f59-21ea-4a1b-b155-91afe0b26d67 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:26.361843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d13bf-490e-4037-a020-87f723b610bb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:26.375089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:26.375089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.376199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.376918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.377957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:26.380177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:26.390995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:26.399044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:26.415422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:26.416863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.419545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.420745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] PATH_INFO: `/v3/users/1edc2788969c45f7b84273de587cb240` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.425631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edc2788969c45f7b84273de587cb240)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:26.438001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:26.488167 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3011/5993] 10.222.0.18 () {60 vars in 1268 bytes} [Sat Jun 4 21:12:26 2022] PUT /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config => generated 138 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:26.491937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:26.517267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6d8b-4140-4662-8c86-71980cddca14 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:26.532322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:26.533788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.534532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.535328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.536471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:26.538226 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:26.538226 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:26.538226 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:26.539480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4e2dd-2021-42ad-8ab7-d6dca6f6ee75 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:26.577557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edc2788969c45f7b84273de587cb240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:26.578749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edc2788969c45f7b84273de587cb240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:26.599432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edc2788969c45f7b84273de587cb240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:26.602403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edc2788969c45f7b84273de587cb240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:26.649762 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3012/5994] 10.222.0.18 () {60 vars in 1296 bytes} [Sat Jun 4 21:12:26 2022] PATCH /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity => generated 177 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:26.655581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142f54-4dc5-4db7-894c-85a2f17b5e55 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.655581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142f54-4dc5-4db7-894c-85a2f17b5e55 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.657029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03142f54-4dc5-4db7-894c-85a2f17b5e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.657940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edc2788969c45f7b84273de587cb240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:26.700163 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2983/5995] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:26 2022] DELETE /identity/v3/users/1edc2788969c45f7b84273de587cb240 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:26.701330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:26.704520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:26.735592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-03142f54-4dc5-4db7-894c-85a2f17b5e55 None None] MFA Rules not processed for user `b7385bf9cbff4b30b6f75566ee78d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:26.737669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-03142f54-4dc5-4db7-894c-85a2f17b5e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:26.910198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b84075-aa76-4855-b242-df78260a6d7a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:26.926186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:26.927575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.928034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.928626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:26.929660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity, option=driver)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:26.933138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:26.942461 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3013/5996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:26.946588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:26.946912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:26.960919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.009794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2984/5997] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Jun 4 21:12:26 2022] PATCH /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver => generated 176 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:27.013624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:27.015937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.018518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:27.025410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:27.132156 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3014/5998] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:27.133706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.154877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73631f-3758-4e70-84d0-02f9694be7eb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.165006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.165967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.166254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.166850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.167611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity, option=driver)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.169719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.213192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3015/5999] 10.222.0.18 () {58 vars in 1298 bytes} [Sat Jun 4 21:12:27 2022] DELETE /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:27.214121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.217507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:27.222316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:27.237215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3ba3b-e3f8-437c-bdcb-8f6fb599702e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.243610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:27.255117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.257411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.259180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.259657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.260654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.263819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.319554 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2985/6000] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:27.329544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.386677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cebdf-4961-4352-8555-b08eca7cc786 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.505862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9972fc-5eff-4ac9-b5b1-63d5943688c9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.523930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.524923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.525254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.525547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.529084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity, option=driver)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.531324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.538574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.540905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.541388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.542729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find option driver in group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:27.550177 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:27.551218 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:27.561343 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2986/6001] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:12:27 2022] GET /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity/driver => generated 171 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:27.562923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.710719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.715445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.738047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3016/6002] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:27.738898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.755686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133a7-41cb-49bf-858e-658de0f2cea7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.757029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34e89e-95e6-45de-b772-2aa66aa1f234 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.768901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.769993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.770233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.770518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.771342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.773511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.775304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.776696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.777229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.777656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.779063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.783084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.826795 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2987/6003] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:27 2022] POST /identity/v3/users => generated 295 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:27.829866 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3017/6004] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 21:12:27 2022] DELETE /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:27.833642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.836102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.868012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5c3b-2aa7-49e9-8d74-043a9fe0522b tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.880635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224564d-436d-41fa-b616-4d5540c1bf6b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:27.889111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.899613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.900931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.903827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.906922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:27.907669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:27.907963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:27.909787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa, group=identity)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.912194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.913355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:27.914236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:27.916041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:27.941726 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:27.943699 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:12:27.949067 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3018/6005] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:12:27 2022] GET /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config/identity => generated 154 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:27.953413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.970410 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2988/6006] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:27.979150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:27.997040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20570e9-55bf-4d3a-9088-157ab5d92f35 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.011379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.013755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.014807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdadf35-ba0b-4054-8b12-0c50ee3094ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.015302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.017412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.018270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c815124e14994bc7ae3810fbe2ad84aa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.027386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.039970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.041098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.041255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.041453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] PATH_INFO: `/v3/projects/1a6e988944a545519706b148cf3b45a4/users/7654c81064024179985cb210c3bd7b9d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.065442 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3019/6007] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:27 2022] DELETE /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa/config => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:28.073936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:28.133853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934637d-a18c-4aa9-a852-0bdd3db4926e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.143112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6e988944a545519706b148cf3b45a4, user_id=7654c81064024179985cb210c3bd7b9d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.158767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.166766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.171867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.174707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.175025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.193504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c815124e14994bc7ae3810fbe2ad84aa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.200739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.226198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2989/6008] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:27 2022] PUT /identity/v3/projects/1a6e988944a545519706b148cf3b45a4/users/7654c81064024179985cb210c3bd7b9d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:28.235111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:28.313283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.316973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.401598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:28.406867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:28.431223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.434348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.450385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3020/6009] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:28 2022] PATCH /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa => generated 277 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:28.451322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:28.458915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:28.460153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86c01e-3288-4fc5-98d5-9ef8af186908 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.618050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.619207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.619207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.619448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.620361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.622494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a07e7-f6bd-4298-ab53-75eacea833c0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.636623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2990/6010] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:28.638078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47986481-63ba-41eb-b598-0536af753982 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.638365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47986481-63ba-41eb-b598-0536af753982 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.638645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47986481-63ba-41eb-b598-0536af753982 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.640073 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2991/6011] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:12:28.646773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47986481-63ba-41eb-b598-0536af753982 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:28.648835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47986481-63ba-41eb-b598-0536af753982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:28.663207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618267-dbda-40d1-9102-2f87ff5cbe63 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.669444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47986481-63ba-41eb-b598-0536af753982 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.675277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.676509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.677538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.677823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.678156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] PATH_INFO: `/v3/projects/1a6e988944a545519706b148cf3b45a4/users/7654c81064024179985cb210c3bd7b9d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.679777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.680474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.680693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6e988944a545519706b148cf3b45a4, user_id=7654c81064024179985cb210c3bd7b9d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.681103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.685333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972c8f3-f954-407b-bc5f-83fc09cd712f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.700519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2992/6012] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:28 2022] PUT /identity/v3/projects/1a6e988944a545519706b148cf3b45a4/users/7654c81064024179985cb210c3bd7b9d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:28.702085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.702374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.702651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.714878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c815124e14994bc7ae3810fbe2ad84aa)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.719535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.727020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:28.729188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:28.782949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.795870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.821123 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2993/6013] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:28.829384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:28.832150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:28.870317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5515fd1-9d0f-43c4-9f79-d8616ef463b7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:28.880381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:28.883101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:28.883346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:28.883685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:28.902718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:28.908148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:28.938179 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2994/6014] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:28.951260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.969240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:28.986281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.044562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] The token cache is being invalidate because project c815124e14994bc7ae3810fbe2ad84aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:29.044870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.046839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.066378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.068634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.077831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c815124e14994bc7ae3810fbe2ad84aa', 'request_id': 'req-a52b2e4a-974a-4620-be5f-b61005e71ca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:29.099041 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3021/6015] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:28 2022] DELETE /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:29.104038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.283671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23dff5-2243-47ce-bb5b-63bc568b3417 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.297171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:29.467331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.468270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.468824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.469125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.471657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.472779 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:29.472779 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:12:29.472779 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:12:29.478051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.495085 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2995/6016] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:29.500276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.501803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:29.539540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b2e4a-974a-4620-be5f-b61005e71ca9 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.545834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.546480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.546752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.547540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.548740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.550725 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:29.550725 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:29.550725 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:29.553423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.556908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3022/6017] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:29.560821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.576603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9986d-f667-4192-b0f2-f259e982ab61 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.596039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.596871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.597159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.597537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.598342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.600953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.605137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2996/6018] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:29.606870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.629254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93235bab-caca-4389-b374-f3086b6c2d5c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.642756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.645030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.649519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.649519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.650522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.660742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.667004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.670151 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3023/6019] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 04 21:12:29.696084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bb0c-de72-4a24-ab53-f7e1f4b34dae tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.711659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.712515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.715968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.716574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.717866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.732206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.742805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.746221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2997/6020] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:29.773858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c778-91d6-455b-8652-c7d3f03e26b4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.816731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.817598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.817888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.818164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.818850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.826632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.839274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3024/6021] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:29.842410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.860841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f192ec-1689-42b4-b4a9-75c846ded6cb tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.874163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.875565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.876101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.876597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.877486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.887350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.888791 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2998/6022] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:29.893214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.913509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906fa9-4666-4e93-bc53-5a66dcfc7699 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.927259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.929072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.929373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.929654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.934982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.938396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:29.941211 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3025/6023] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 04 21:12:29.945540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.961201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702db80-8356-44d8-98e3-fd9317b8d493 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:29.976059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:29.978377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:29.980548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:29.980903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:29.984754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:29.986059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:29.987407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:29.992047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.003452 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 2999/6024] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:29 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.007028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.043690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:30.047095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef016594-d8ad-49ac-b160-0cabce037771 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.072744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.077563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.078152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.081469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.084032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.095307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.099904 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3000/6025] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.104565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.158286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c0588-5707-4493-9fff-90e3f9f9beac tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.180783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.186903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.187210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.187496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.191571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.197651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.202663 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3001/6026] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.205222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.222751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0348364-99f8-4e96-a06a-f2cf2bf0b777 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.247077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.248383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.248875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.249330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] PATH_INFO: `/v3/projects/4d9e98bceae84c35b931e95dc2e5e31f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.252307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9e98bceae84c35b931e95dc2e5e31f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.254889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.257996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51518201-f841-4151-b3a9-12d045e4bf62 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.275888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.278260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.278557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.280171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.280872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.287981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.294939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3002/6027] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.298988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.344681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53ed70-d6a5-43aa-8f2f-582188423d7e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.364857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.372834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.373173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.373468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.380889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.386954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.396446 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3003/6028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.400131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.442576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed451f38-5f9c-4e63-af98-78777602cbca tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.457265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9e98bceae84c35b931e95dc2e5e31f', 'request_id': 'req-a534a316-f674-4057-8695-2a373fed601a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:30.482248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9e98bceae84c35b931e95dc2e5e31f', 'request_id': 'req-a534a316-f674-4057-8695-2a373fed601a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:30.503639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9e98bceae84c35b931e95dc2e5e31f', 'request_id': 'req-a534a316-f674-4057-8695-2a373fed601a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:30.555300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] The token cache is being invalidate because project 4d9e98bceae84c35b931e95dc2e5e31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:30.556377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:30.569495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a534a316-f674-4057-8695-2a373fed601a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:30.575387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3026/6029] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:29 2022] DELETE /identity/v3/projects/4d9e98bceae84c35b931e95dc2e5e31f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:30.581654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72a64-29d5-4616-8e97-ecadcdb83531 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.581984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72a64-29d5-4616-8e97-ecadcdb83531 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.582248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72a64-29d5-4616-8e97-ecadcdb83531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.667974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2fa72a64-29d5-4616-8e97-ecadcdb83531 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:30.669920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2fa72a64-29d5-4616-8e97-ecadcdb83531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:30.804794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.805503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.805788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.806068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.806747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.811830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.817196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3004/6030] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.818819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.823058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:30.857826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b507d7-a0cc-49e4-bfa6-c239931b683c tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.878269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.879234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.879633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.880267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.881164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.883089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.887448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3005/6031] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:30.894646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.900005 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3027/6032] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:30.907036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3c18-a987-4305-a965-c572868e6b3a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.907838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3c18-a987-4305-a965-c572868e6b3a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.908360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3c18-a987-4305-a965-c572868e6b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.924556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4392c-9259-4f19-a78f-7ddf38bd6ecd tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.939537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:30.940663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:30.940943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:30.941225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:30.941898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:30.948419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:30.952774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3006/6033] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 04 21:12:30.961131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6ffa3c18-a987-4305-a965-c572868e6b3a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:30.963857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:30.975137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ffa3c18-a987-4305-a965-c572868e6b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:30.993937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30978df6-d39d-4cf5-8745-60b703aa1de7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:30.998061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3028/6034] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:31.006219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.007951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.012338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.015944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.016286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.016576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.016860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.017549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.029270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.039137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3007/6035] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:12:30 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.042439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.091491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] MFA Rules not processed for user `7654c81064024179985cb210c3bd7b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:31.093086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:31.103839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13047c-95fe-4bf5-a27c-2b7194baad23 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.116040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.116817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.117215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.117491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.118268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:31.118673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.120398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.141821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:31.157118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3008/6036] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:31.157118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.194277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69576-078b-487a-a2de-14f31089d1bd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.212393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.213613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.213906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.214192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.216250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.220808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.223976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3009/6037] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.224728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.255117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ba7a-a9eb-40ab-92b8-bcbd2b4ef80d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.267138 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3029/6038] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:31.268498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.279000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.280099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.280635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.281168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.282358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.284955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.313073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471299-5ffb-4806-a5cb-81fc56d38633 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.329889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.330890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.331375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.331858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.332688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.335702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a13bd-db75-4d9c-a882-002c0852b200 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.340103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3030/6039] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.342553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.343067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.343571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.346185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:31.374814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] MFA Rules not processed for user `b7385bf9cbff4b30b6f75566ee78d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:31.376556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:31.439316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3010/6040] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:31 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:31.440308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.542343 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3031/6041] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:31.542974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.566615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599345b-a1e5-4244-a2d3-4f13cf772045 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.652710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656715ca-306f-4e6f-9e64-42843c2da636 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.668840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.669272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.669591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.669857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.670563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.672452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.679396 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3011/6042] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.679396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.686737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:31.719827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.720559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.720845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.721128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.721864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.725258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.778403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3032/6043] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:31 2022] POST /identity/v3/users => generated 282 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:31.784500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.805142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737c5c7-77d0-44f7-8235-cb1ee60b6984 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.828421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.829163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.829451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.829734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.830417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.832121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.834235 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3033/6044] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.835135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.866130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608be2e-2a9c-4d1a-a9f7-b1b04e5ca67d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.877548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.878533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.878965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.879424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.880616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.882682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.919050 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3034/6045] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:31.920689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:31.940842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962fb46-2160-448f-ae9e-e43dad40cda7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.941284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6bf77-24a4-49b0-b5a0-bc4151910089 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:31.949398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.952880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.954224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.954224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.954511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:31.954997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:31.955565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:31.955859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:31.956196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:31.958278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:31.958431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:31.974635 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3035/6046] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:31.976092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.003702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95e7d-4277-40cb-8621-860db3494471 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.020293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.021788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.022375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.023462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.024718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.028635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.057428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3036/6047] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:32.062373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.094032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd40386-2b6f-47ce-ac67-5a61c677a696 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.106141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.108869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.109731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.112066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.112624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.113182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.114059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.116293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.129546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3037/6048] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:32.132635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.150581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3012/6049] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:32.153901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.164024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4cac0-78ca-49f6-8946-035f28ac5912 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.178045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.180599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.181878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.183111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d0336-8e55-460c-89eb-cfef9b092e40 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.184066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] PATH_INFO: `/v3/projects/bce89fde8e134ff5947115b901ea4528/users/27a3fedbad0c428ca81e3204eaa09004/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.196852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.199912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.200368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.200770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.203684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.206076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:32.207875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.212293 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3013/6050] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:32.217940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.232014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce89fde8e134ff5947115b901ea4528, user_id=27a3fedbad0c428ca81e3204eaa09004, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.238322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.247096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ff12a-7fe2-4eba-b382-03b7589e0ec2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.267482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.271643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.275686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.278576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.280949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.282157 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3038/6051] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:32 2022] PUT /identity/v3/projects/bce89fde8e134ff5947115b901ea4528/users/27a3fedbad0c428ca81e3204eaa09004/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:32.285988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.288092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a403779-e6b1-44f9-a44d-77f589211d2d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.290464 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3014/6052] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:32.296191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.297991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.298684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.299732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:32.347240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:32.416170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] MFA Rules not processed for user `27a3fedbad0c428ca81e3204eaa09004`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:32.417445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:32.480953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6ca8-351e-4f5c-9db2-c284c50d5dd1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.493475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.495413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.496078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.497218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.504235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:32.666010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3015/6053] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:32.667033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.699856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.703824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.735912 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3039/6054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:32.738750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.742925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:32.813295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14d001-7f6b-4630-be3a-18b9b3975d3a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.828531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.829033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.829167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.829600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.830442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:32.832925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:32.842074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3016/6055] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:32.843072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:32.959029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a87b8-a124-47e9-b39b-f9c2ac1faaab service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:32.963617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:32.964730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:32.965006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:32.965354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:32.967386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:32.998346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.001159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0ef3-21e1-4d89-b22d-6691bf1ca8b2 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.001668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.015634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.016312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.016601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.016883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.017689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.020036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.022160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3040/6056] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:33.025699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.043553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a2aab-c8fe-4488-a8c1-de578fbe825a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.051415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.054748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.054748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.054748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.055488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.058517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.060796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3041/6057] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.068014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.080511 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3017/6058] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:32 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:33.086878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.103009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471691a6-f667-49f1-b60a-d8cb17036e90 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.171891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:33.181566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:33.254715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e01-c5d4-49a7-891e-f57abae00d99 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.270779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.271832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.272236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.272826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.273994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.280369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.280617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.281266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.281611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.281894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.282776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.284676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.287186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3042/6059] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.290671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.313640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30d644-2d48-4b63-814e-54fbc91be7a5 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.323369 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3018/6060] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:33 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:33.328287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.344610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.345819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.346174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.346624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.351491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.353763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.355625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836b87d-55fc-421c-8f4c-105abe5bb338 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.357876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3043/6061] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.370014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.396463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.397926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.398493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.399378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79090b7-206f-4fc8-b2c9-4d0db82aebd1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.400626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.412281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.413304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.413684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.414620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.415768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.417843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.419247 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3044/6062] 10.222.0.18 () {58 vars in 1307 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.422343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.423350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.424911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.446056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3019/6063] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:33.452872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e91d-bed9-4c2c-a463-2ef035db07c8 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.453409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.471124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fa47-0296-478a-95d8-05b22751eb78 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.473205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.474338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.475067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.475211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.475956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.477595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.479120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.479348 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3045/6064] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.480701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.481213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.482842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] PATH_INFO: `/v3/projects/972155fa06a844579903ddeaba12c772/users/828ba30565a2475fb4a33b731710e9f1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.482999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.509280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972155fa06a844579903ddeaba12c772, user_id=828ba30565a2475fb4a33b731710e9f1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.512523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.522287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829e1f-3ee8-4673-bdc9-9dd02399c4f6 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.528351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.529621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.529949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.530251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.530925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.532797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.534436 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3046/6065] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.538680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.558801 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3020/6066] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:33 2022] PUT /identity/v3/projects/972155fa06a844579903ddeaba12c772/users/828ba30565a2475fb4a33b731710e9f1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:33.561910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7788-0145-4e54-b5c2-b221ef474470 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.563120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.689485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64bc2-28e5-4b2a-ae60-a7e5696b2ff2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.699751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.701596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.701884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.702158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.703718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.707020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.784680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3021/6067] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:33.787121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.788093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.788414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.790432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.790720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.795656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.797838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.804661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3047/6068] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.810296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.820839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0c5f-54b0-4555-8300-715de3eeef0a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.836992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266df27-4130-46ba-b12d-e4f8a66ad077 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.844021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.846554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.847814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.848383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] PATH_INFO: `/v3/projects/972155fa06a844579903ddeaba12c772/users/828ba30565a2475fb4a33b731710e9f1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.852648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:33.853230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972155fa06a844579903ddeaba12c772, user_id=828ba30565a2475fb4a33b731710e9f1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.853478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.853768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.854048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.854713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:33.856680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.857587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f53d6-49d2-4b15-94eb-c5a8b0af4e49 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:33.860933 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3048/6069] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:33.862335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:33.888492 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3022/6070] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:33 2022] PUT /identity/v3/projects/972155fa06a844579903ddeaba12c772/users/828ba30565a2475fb4a33b731710e9f1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:33.891098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889379e2-edb4-4287-99e8-1fa04aea4318 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:33.901909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:33.902238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:33.902526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:33.970439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] MFA Rules not processed for user `828ba30565a2475fb4a33b731710e9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:33.972731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:34.056664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.057510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.057796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.058235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.058916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.063005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.070263 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3049/6071] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:12:33 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.073883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.146516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:34.149228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a01dd9-2040-4221-b33a-c27473c4289d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.164283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.166565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.167185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.167758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.168823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.171081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.179017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3050/6072] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.181994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.225546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915cb42-2951-4023-88f5-46438442ad08 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.268205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.269056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.269765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.270032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.275533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.277313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.280210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3051/6073] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.287383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.290934 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3023/6074] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:34.304211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.308173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:34.311552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12e636-d88f-4114-96ef-b46ecf74c288 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.325850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.327184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.327664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.328653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.329868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.333165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.342224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3052/6075] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.343319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.391484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824de7b-f4e5-44c6-b0f1-9e5e2c2d1800 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.398230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131c9d7-db41-4a46-aa79-5e95a6652b48 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.399232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.400168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.400801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.401251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.417290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.419258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.439405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.443098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.444796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.445189 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3024/6076] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:34.445858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.448912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.478427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.485977 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3053/6077] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.490902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.505213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955143a-6991-4691-acdf-0a0194834eab service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.509972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.510870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.511373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.511903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.524922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.528886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.532685 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3025/6078] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.537956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.568453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2201bd1-78e4-4b25-85ff-22442a90d98d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.599052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.606294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.608743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.611910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.614494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.618390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.626942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3054/6079] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.632333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.652045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94a439-6cf4-4a31-9140-591c23e02986 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.669840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.672147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.672524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.673641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.675255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.683160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.688814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3026/6080] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.710015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.744001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bc4-b462-4212-8757-f86337431066 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.764356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.765234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.765541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.776745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.779485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.786566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.795625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3055/6081] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.798071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.825036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92373f0-9025-4c66-adbe-9ca7ec83e3a1 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.836325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.837243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.838289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.838698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.839582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.844197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.847053 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3027/6082] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 04 21:12:34.855279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.876675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ffabb-3367-450b-a707-7336dd0b73fc tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.896497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.897625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.898101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.898646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.899545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.900953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.901790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.903884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3056/6083] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:34.907681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:34.908351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:34.938602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a7c5-31c3-4910-ba7d-05474fbc9422 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:34.966523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:34.968127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:34.968127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:34.968531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:34.969334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:34.977338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:34.980306 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3057/6084] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 04 21:12:34.983079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.004590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d05a4-819c-4a97-b6f1-9dcdc69d04f7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.028636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.029518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.029866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.030695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.032259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.041764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.045913 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3058/6085] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.051355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.073286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456296-6e7f-40a2-9719-d1798e9a1ead tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.092300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.093403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.099803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.099803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.099803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.099803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.112932 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3059/6086] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.113847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8ffcc-a004-4c03-a07b-469c9abfc54e tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.115473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.122423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.123185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.123596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.123890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.126252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:35.145560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.147930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.177545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3028/6087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:35.180579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c90ae-8bce-4b09-8905-27aace9b1d3d tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.190038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.191378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.191914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.192464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.193674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.195771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.198368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3060/6088] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.201844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.221311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636a77f-cd71-425b-b3fd-c12cb1132e26 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.242586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.243426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.243842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.244042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.244719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.247196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.248900 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3029/6089] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.255157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.262640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:35.276539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f4da-1fda-4a10-8ad4-558f326ed172 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.306862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.308573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.310982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.312762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.314106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.317233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.323832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3061/6090] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.328595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.361239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13acf9-bdba-4453-b668-143b8c481e51 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.382550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.384584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.385081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.385562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.386875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.389105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eb7da-796d-4eae-a7fb-7f06e855c0d0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.391082 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3030/6091] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.395662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.433642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.434637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.435061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.444149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09eb57c-8baf-4fb6-ae2f-43b3f2e50ab7 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.484256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.485452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.485452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.485670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.486364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.506855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.515120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3062/6092] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.519711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.533668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:35.535804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:35.569168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fdd64-b330-4949-9d54-8ea7b1954917 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.583612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.586902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.589261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.590583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.591969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.601798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.608911 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3063/6093] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 21:12:35 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:12:35.610258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.757457 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3031/6094] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:35.762179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.774215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:35.790101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640bb92-88b7-45d9-ac5d-7595d45d0105 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.806404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.807417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.807940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.808287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/c815124e14994bc7ae3810fbe2ad84aa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.826762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:12:35.849392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4ef0-c3d0-47d6-ae44-18a54e752814 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.864593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.866252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.866711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.867190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] PATH_INFO: `/v3/users/27a3fedbad0c428ca81e3204eaa09004` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.868986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a3fedbad0c428ca81e3204eaa09004)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:35.879982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find domain: c815124e14994bc7ae3810fbe2ad84aa.: keystone.exception.DomainNotFound: Could not find domain: c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:35.880281 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:35.881955 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:12:35.883457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c815124e14994bc7ae3810fbe2ad84aa. Jun 04 21:12:35.885436 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:35.892846 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3032/6095] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:35 2022] PATCH /identity/v3/domains/c815124e14994bc7ae3810fbe2ad84aa => generated 112 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:35.899243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:35.937993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457139-0e41-45f8-8631-ef5668991ba0 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:35.952341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:35.953351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:35.953704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:35.954046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/a5350f7d87a54840b96d604393c5e26b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:35.978180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:12:35.998251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a3fedbad0c428ca81e3204eaa09004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find domain: a5350f7d87a54840b96d604393c5e26b.: keystone.exception.DomainNotFound: Could not find domain: a5350f7d87a54840b96d604393c5e26b. Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a5350f7d87a54840b96d604393c5e26b. Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:36.006523 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:36.007997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:12:36.009199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a5350f7d87a54840b96d604393c5e26b. Jun 04 21:12:36.010363 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.018965 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3033/6096] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:35 2022] PATCH /identity/v3/domains/a5350f7d87a54840b96d604393c5e26b => generated 112 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:36.020639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:36.021245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a3fedbad0c428ca81e3204eaa09004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.022255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a3fedbad0c428ca81e3204eaa09004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.023093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a3fedbad0c428ca81e3204eaa09004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.038008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5b4c7ea8-2fc7-4347-bf80-f9459965d569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a3fedbad0c428ca81e3204eaa09004'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.047364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c48e-6b2f-4e93-853e-ff41f1ae6fd3 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:36.070596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30e5a54ea83843cbb045c725ce795719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90f2b5663ad34a9faae3c3ac59607c87', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:36.072460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:36.072619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:36.078743 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3064/6097] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:35 2022] DELETE /identity/v3/users/27a3fedbad0c428ca81e3204eaa09004 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:36.079910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] PATH_INFO: `/v3/domains/032a8c3d22fa4513a4062a2e023f0b28` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:36.080444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:36.080903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:36.081339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:36.104788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Could not find domain: 032a8c3d22fa4513a4062a2e023f0b28.: keystone.exception.DomainNotFound: Could not find domain: 032a8c3d22fa4513a4062a2e023f0b28. Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 032a8c3d22fa4513a4062a2e023f0b28. Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:36.119627 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:36.120829 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:12:36.122251 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 032a8c3d22fa4513a4062a2e023f0b28. Jun 04 21:12:36.123648 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:36.128074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3034/6098] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:36 2022] PATCH /identity/v3/domains/032a8c3d22fa4513a4062a2e023f0b28 => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:36.129703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:36.133080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:36.139371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:36.147297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:36.178568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f363e3-bebb-40fd-b28f-d97c2f503ec4 tempest-DomainConfigurationTestJSON-715100571 tempest-DomainConfigurationTestJSON-715100571-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:36.334408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:36.336185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:36.336716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:36.337566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] PATH_INFO: `/v3/users/9ad17763e50a4696b866fb0c4039f51e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:36.339219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad17763e50a4696b866fb0c4039f51e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:36.343121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:36.416179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3065/6099] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:36.425324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:36.429615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:36.443187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:36.573702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad17763e50a4696b866fb0c4039f51e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.577666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad17763e50a4696b866fb0c4039f51e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.606815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad17763e50a4696b866fb0c4039f51e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.608213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad17763e50a4696b866fb0c4039f51e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.672805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671209a7-3c37-4aff-bfd1-7a283d600f84 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:36.688930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:36.689674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:36.690421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:36.690539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:36.692679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:36.715393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:36.717699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:36.722697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d3fbf37a-141d-4d66-89e2-26688f0cf77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad17763e50a4696b866fb0c4039f51e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:36.754105 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3035/6100] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:36 2022] DELETE /identity/v3/users/9ad17763e50a4696b866fb0c4039f51e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:36.755430 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3066/6101] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:36.761130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:36.761445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:36.761687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:36.810060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:36.812792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:36.999217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:37.065489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3036/6102] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:37.098698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:37.108477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:37.178665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedc84b-f8ed-4f23-9c5a-9ffb57239fea service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:37.337031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:37.338000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:37.338450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:37.338882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:37.361045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:37.362799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:37.417780 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3067/6103] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:38.294413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:38.296105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:38.319743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b50bb-a425-4838-bb4b-903a3f5496a5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:38.330746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:38.336671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:38.337137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:38.337294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] PATH_INFO: `/v3/projects/bce89fde8e134ff5947115b901ea4528` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:38.340950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce89fde8e134ff5947115b901ea4528)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:38.345369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:38.512843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce89fde8e134ff5947115b901ea4528', 'request_id': 'req-184ecc49-22d7-4caf-9e11-605d60611e44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.532961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce89fde8e134ff5947115b901ea4528', 'request_id': 'req-184ecc49-22d7-4caf-9e11-605d60611e44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.554040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce89fde8e134ff5947115b901ea4528', 'request_id': 'req-184ecc49-22d7-4caf-9e11-605d60611e44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.591323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] The token cache is being invalidate because project bce89fde8e134ff5947115b901ea4528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:38.591780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.592589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.598023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3037/6104] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:38 2022] DELETE /identity/v3/projects/bce89fde8e134ff5947115b901ea4528 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:38.599690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:38.614685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb45c-f65b-4bfe-ae4e-aa616b47936d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:38.727482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:38.728487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:38.729048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:38.729517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] PATH_INFO: `/v3/users/828ba30565a2475fb4a33b731710e9f1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:38.731965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828ba30565a2475fb4a33b731710e9f1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:38.734213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:38.805422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:38.818556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828ba30565a2475fb4a33b731710e9f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.835036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828ba30565a2475fb4a33b731710e9f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.836341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828ba30565a2475fb4a33b731710e9f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.837182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828ba30565a2475fb4a33b731710e9f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.858225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828ba30565a2475fb4a33b731710e9f1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:38.892363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3068/6105] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:38 2022] DELETE /identity/v3/users/828ba30565a2475fb4a33b731710e9f1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:39.059074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:39.060880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:39.082427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ecc49-22d7-4caf-9e11-605d60611e44 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:39.191923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:39.193706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:39.194024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:39.194759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] PATH_INFO: `/v3/projects/5ea7a353245d46519bcf36be90b561c1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:39.196376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea7a353245d46519bcf36be90b561c1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:39.202459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:39.349909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea7a353245d46519bcf36be90b561c1', 'request_id': 'req-b558dfe3-c5ab-466e-aae5-9181274797db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.385684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea7a353245d46519bcf36be90b561c1', 'request_id': 'req-b558dfe3-c5ab-466e-aae5-9181274797db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.401561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea7a353245d46519bcf36be90b561c1', 'request_id': 'req-b558dfe3-c5ab-466e-aae5-9181274797db'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.433843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] The token cache is being invalidate because project 5ea7a353245d46519bcf36be90b561c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:39.434214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.437026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.440302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3038/6106] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:39 2022] DELETE /identity/v3/projects/5ea7a353245d46519bcf36be90b561c1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:39.445693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:39.447391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:39.483609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646949e-0ce1-4c8c-9883-ba248866dc42 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:39.624756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:39.625679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:39.625964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:39.626239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] PATH_INFO: `/v3/users/30e5a54ea83843cbb045c725ce795719` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:39.628371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e5a54ea83843cbb045c725ce795719)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:39.632873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:39.762714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e5a54ea83843cbb045c725ce795719'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.802207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e5a54ea83843cbb045c725ce795719'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.803716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e5a54ea83843cbb045c725ce795719'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.804819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e5a54ea83843cbb045c725ce795719'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.849139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93b049b4-5306-4f07-a20f-c0344b4b1bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e5a54ea83843cbb045c725ce795719'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:39.852511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:39.854274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:39.876791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfe3-c5ab-466e-aae5-9181274797db admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:39.881315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3069/6107] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:39 2022] DELETE /identity/v3/users/30e5a54ea83843cbb045c725ce795719 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:39.888224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:39.889311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:39.891203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:39.892210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] PATH_INFO: `/v3/projects/972155fa06a844579903ddeaba12c772` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:39.896336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972155fa06a844579903ddeaba12c772)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:39.900781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:39.907020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:40.046326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972155fa06a844579903ddeaba12c772', 'request_id': 'req-5dfabff9-d419-483e-9ac8-2243aef45c64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:40.060844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972155fa06a844579903ddeaba12c772', 'request_id': 'req-5dfabff9-d419-483e-9ac8-2243aef45c64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:40.071294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972155fa06a844579903ddeaba12c772', 'request_id': 'req-5dfabff9-d419-483e-9ac8-2243aef45c64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:40.109406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] The token cache is being invalidate because project 972155fa06a844579903ddeaba12c772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:40.109720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:40.110616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dfabff9-d419-483e-9ac8-2243aef45c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:40.112938 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3039/6108] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:39 2022] DELETE /identity/v3/projects/972155fa06a844579903ddeaba12c772 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:40.121088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.121379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.127740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.162681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:40.164701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:40.196417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:40.264190 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3070/6109] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:40.267083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.267383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.267712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.294880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:40.296283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:40.313773 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3040/6110] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:40.318026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.331271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826e860-e0f0-41f4-a583-9d0b3860acd7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.337515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.338559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.340008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.340514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.341468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:40.342063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.344137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.360607 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3071/6111] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:40.368700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.383687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ea28e-eab8-4635-b816-9c083ca6de00 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.406785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.407890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.410002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.411126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.412667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.414843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.502527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.503202 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3041/6112] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:40 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:40.514161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b0329-6b48-404a-aeed-8182fc7de469 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.643543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.646230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.646602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.654683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.655905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.657912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.690060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3072/6113] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:40 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:40.691587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.723333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781ece6-6d53-41af-8720-5c288529fed5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.739903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.740961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.741613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.742109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.744028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.747563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.775415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3042/6114] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:40.779774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.796591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434716bf-e9bb-44b4-8b03-8b3507534148 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.806712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.807464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.807781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.808121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.808910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.810692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6456b-d150-4be7-ad87-b2bfb2b008a2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.833854 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3073/6115] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:40.834191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:40.845297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a36cb9-58ab-4c98-8bb5-4948ba2f7db5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:40.851960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:40.853153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.854283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.854728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] PATH_INFO: `/v3/projects/3cb222a5b84448e49efb0ffffc35b928/users/477aa1f663c440a496dcc85d31b2310e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.877458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb222a5b84448e49efb0ffffc35b928, user_id=477aa1f663c440a496dcc85d31b2310e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:40.881367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:40.919227 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3043/6116] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:40 2022] PUT /identity/v3/projects/3cb222a5b84448e49efb0ffffc35b928/users/477aa1f663c440a496dcc85d31b2310e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:40.920104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:40.920395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:40.920674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:40.988481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] MFA Rules not processed for user `477aa1f663c440a496dcc85d31b2310e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:40.990715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:41.136575 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3074/6117] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:41.141346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.238181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817714e7-5d52-4889-8ad2-d66833bbe8b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.253097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.253781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.254065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.255725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.256427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.258525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.299706 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3044/6118] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:41 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:41.304474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.321800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51c637-fac3-4360-8708-081be2e6a759 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.382721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:41.452103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.453292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.453292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.453527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.454063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.456921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.503615 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3075/6119] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:41 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:41.508407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.526421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545316-e671-4573-b529-53aa6de004ce admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.532117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.532903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.533304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.533642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.534504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.536614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.556726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3045/6120] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:41.560815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.574940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592318e1-fc1f-4421-9922-7be12f9f5b12 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.584476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.585660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.586253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.586735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.587788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.593082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b9f70-119e-438f-ad11-914a755d0c9c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.617212 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3076/6121] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:41.619819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.625569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:41.637977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fb6ec-2249-4c9b-96ec-e449e2d6312b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.644577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.646463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.646755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.647034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] PATH_INFO: `/v3/projects/6a5c70a4e24a46a79443a500d0377519/users/76ed058cc15d4866b27264b19a74206e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.665346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c70a4e24a46a79443a500d0377519, user_id=76ed058cc15d4866b27264b19a74206e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.668199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.701054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.701635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.701635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.703812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3046/6122] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:41 2022] PUT /identity/v3/projects/6a5c70a4e24a46a79443a500d0377519/users/76ed058cc15d4866b27264b19a74206e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:41.742056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] MFA Rules not processed for user `76ed058cc15d4866b27264b19a74206e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:41.743411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.744010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:41.746065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:41.862186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f574b4-b4a3-4105-884d-28804db07104 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.876497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.880152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.880152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.880873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] PATH_INFO: `/v3/projects/90f2b5663ad34a9faae3c3ac59607c87` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.881710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3077/6123] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:41.885378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f2b5663ad34a9faae3c3ac59607c87)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.886917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:41.887101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:41.912266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd95f9-e244-49cb-8821-e8da6ada54a1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:41.927690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:41.928491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:41.928837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:41.929174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:41.929950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:41.933173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.001347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3078/6124] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:41 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:42.001593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f2b5663ad34a9faae3c3ac59607c87', 'request_id': 'req-428e5103-f60d-43cf-936f-89ac0f3c79c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:42.002913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.010473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f2b5663ad34a9faae3c3ac59607c87', 'request_id': 'req-428e5103-f60d-43cf-936f-89ac0f3c79c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:42.026822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f2b5663ad34a9faae3c3ac59607c87', 'request_id': 'req-428e5103-f60d-43cf-936f-89ac0f3c79c2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:42.066257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] The token cache is being invalidate because project 90f2b5663ad34a9faae3c3ac59607c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:42.066562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:42.069044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-428e5103-f60d-43cf-936f-89ac0f3c79c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:42.071962 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3047/6125] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:41 2022] DELETE /identity/v3/projects/90f2b5663ad34a9faae3c3ac59607c87 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:42.078272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f328ec-870c-4cc7-a423-bd0634f4501b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.078572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f328ec-870c-4cc7-a423-bd0634f4501b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.078842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f328ec-870c-4cc7-a423-bd0634f4501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.136917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e1f328ec-870c-4cc7-a423-bd0634f4501b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:42.138800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e1f328ec-870c-4cc7-a423-bd0634f4501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:42.151174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3048/6126] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:42.151375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da79a4-0a82-4d9d-b1a1-542fb55bbd9e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.161339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.163480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.163756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.164194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.164583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.165524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.166579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.167293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.172169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.213158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:42.219544 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3079/6127] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:42.225086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.226869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:42.229572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:42.230230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:42.245786 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3049/6128] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:42.249395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.266798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c7660-6deb-4690-9398-5af706b15add admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.272498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5289a-79f1-4468-8944-c6b735b85f3a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.277125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.278956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.279553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.280451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.281764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.283973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.284592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.285937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.286312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.288234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.290692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:42.291022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.295912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.306954 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3080/6129] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:42.320578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.325326 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3050/6130] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:42.329984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.352343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617c7f-9877-4cb3-af67-722d0112f44e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.352606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5356f-c599-432b-9f5e-e0bb0043a36d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.364577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.365947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.366287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.366590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.366972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.367176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] PATH_INFO: `/v3/projects/b2e81354dc53406c8242c2d9653f1167/users/effce95b613c4decac851b4e04085814/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.367297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.367549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.368263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.380517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.402818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e81354dc53406c8242c2d9653f1167, user_id=effce95b613c4decac851b4e04085814, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.406149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.434026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3081/6131] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:42 2022] PUT /identity/v3/projects/b2e81354dc53406c8242c2d9653f1167/users/effce95b613c4decac851b4e04085814/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:42.437878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.439284 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3051/6132] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:42.443849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.506236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:42.551623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0a5c9-e7f8-4328-9d0a-0f5bb1786c69 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.603191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b381e7-ddfb-4cde-90ba-74d275aa8d7f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.615908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.616916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.617446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.618054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.618895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.620957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.669836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3052/6133] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:42.673755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.689262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.693744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.694039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.694643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.697113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.699464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.700336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8fa2-b24c-4ec9-95c2-977055646717 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.718694 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3082/6134] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:42.719725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.724858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.730162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.730511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.730838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.731730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381ef7a-d9f4-450a-b2a7-2a21320fffcd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.734838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.737571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.738318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b302176-25a8-4def-9c18-b42c1d315cb4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.740570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.740921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.741367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] PATH_INFO: `/v3/projects/b2e81354dc53406c8242c2d9653f1167/users/effce95b613c4decac851b4e04085814/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.744715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e81354dc53406c8242c2d9653f1167, user_id=effce95b613c4decac851b4e04085814, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.750208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.786622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3053/6136] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:42.787985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.788282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.788562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.790377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3083/6136] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:42 2022] PUT /identity/v3/projects/b2e81354dc53406c8242c2d9653f1167/users/effce95b613c4decac851b4e04085814/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:42.791332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.877597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:42.884989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c705-6ed3-4bc6-a532-47b6eb5cbc80 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.892628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.892842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] MFA Rules not processed for user `effce95b613c4decac851b4e04085814`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:42.893088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.893419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.893705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.893829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:42.894971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.897513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:42.914519 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3084/6137] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:42.917202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:42.930106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce387-049e-469d-b52b-6a2406b76e35 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:42.936790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:42.937763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:42.938049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:42.938327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] PATH_INFO: `/v3/projects/da80f2ea607c49208087e0c788b6a0c2/users/e95913d9ed204561aa320e18ab549f94/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:42.960967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da80f2ea607c49208087e0c788b6a0c2, user_id=e95913d9ed204561aa320e18ab549f94, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:42.963830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2272cbb-8a6c-4bbb-a554-f60ffdac4d8c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.003243 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3085/6138] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:42 2022] PUT /identity/v3/projects/da80f2ea607c49208087e0c788b6a0c2/users/e95913d9ed204561aa320e18ab549f94/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:43.006472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.006777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.007220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.048581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3054/6139] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:43.059136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] MFA Rules not processed for user `e95913d9ed204561aa320e18ab549f94`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:43.060608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:43.063632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.066766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:43.189687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa880c50-435f-4cd2-b188-08c08a0da98c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:43.194748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3086/6140] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:43.199633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.318398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:43.337013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cfcc1-ab4c-4ccd-85ac-6d4597a27895 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:43.346777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:43.347459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.347763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.348039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.352228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:43.352973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.353254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.353530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.354320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:43.356869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.428778 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3087/6141] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:43 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:43.432499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.529942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:43.531783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.548719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:43.556036 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3055/6142] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:43.574597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da461b55-61fe-442a-9d80-7615d20ca1fc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:43.582241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:43.583103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.583492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.583888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.584924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:43.586932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.621624 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3088/6143] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:43 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:43.624698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.647459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edcfe9-871c-42c5-b134-e42d82e3d69a service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:43.655933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:43.656656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.657075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.657358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.658231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:43.660645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.677531 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3056/6144] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:12:43.682107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.697818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0562af-8bc2-4f8e-8410-5a288876f686 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:43.723452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:43.725471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:43.726423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:43.727576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] PATH_INFO: `/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2/users/4feb1681a93440acb6604651cfdea793/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:43.769887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e579cf8c96b42aeb32b03596e1b8ff2, user_id=4feb1681a93440acb6604651cfdea793, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:43.776799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:43.805420 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3089/6145] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:43 2022] PUT /identity/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2/users/4feb1681a93440acb6604651cfdea793/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:43.807929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:43.833903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b279c-ad8d-43c6-98d0-badbfb3ffee0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.026866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.027630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.027917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.028232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.028974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.030757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16adac8-70c4-4d92-b389-5a11b30c90af admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:44.064704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3057/6146] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:44.069139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.088789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c727-e70d-4f66-9668-f09d6aa68dd4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.110769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.111065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.111347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.124306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.125244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.125528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.125904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] PATH_INFO: `/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2/users/4feb1681a93440acb6604651cfdea793/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.143307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e579cf8c96b42aeb32b03596e1b8ff2, user_id=4feb1681a93440acb6604651cfdea793, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.152216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc9f2e-bcd2-4df7-b2e0-85de7e134b92 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:44.174631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:44.176094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:44.188266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3090/6147] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:12:44 2022] PUT /identity/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2/users/4feb1681a93440acb6604651cfdea793/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:44.198971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.199366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.199587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.255218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] MFA Rules not processed for user `4feb1681a93440acb6604651cfdea793`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:44.256473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:44.346361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3058/6148] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:44.366822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.369141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:44.458951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:44.485483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3091/6149] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:44.493853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.524660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ce70-6341-416a-8e24-ba8a861c85f8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.538468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.539237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.552245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.552245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.552245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.552245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:44.603266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872604-8b04-4186-99fa-faa0c51bf50f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.610076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.610834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.611115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.611912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.616078 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3092/6150] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:44 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:44.620962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.631697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.638361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:44.651868 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3059/6151] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:12:44.756674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:44.777290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b9430-bd16-4ece-bb64-0b886a98b67b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.802278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.805520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.805859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.806138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.806873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.809219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:44.899869 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3093/6152] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:12:44 2022] POST /identity/v3/users => generated 416 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:44.900863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.912249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:44.915657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a7f01-befd-4144-bd83-81ad83eaf1ec service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:44.918484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:44.936085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:44.936990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:44.937273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:44.937551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/users/69713a3c032a493e8041370fe531020f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:44.992460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_user(user_id=69713a3c032a493e8041370fe531020f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:44.996585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:45.002832 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3060/6153] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:12:44 2022] GET /identity/v3/users/69713a3c032a493e8041370fe531020f => generated 416 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:45.011337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:45.029567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8569c-ac39-47e5-aa3b-3c5186ddc6bc tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:45.043540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:45.044715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:45.045169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:45.045619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/users/69713a3c032a493e8041370fe531020f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:45.047206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_user(user_id=69713a3c032a493e8041370fe531020f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:45.050812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:45.084335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af341d8-ade5-463d-a519-a85213b0e2a3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:45.097887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:45.098981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:45.099420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:45.100118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:45.103686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:45.155969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69713a3c032a493e8041370fe531020f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.158282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69713a3c032a493e8041370fe531020f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.176274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69713a3c032a493e8041370fe531020f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.177719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69713a3c032a493e8041370fe531020f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.205106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69713a3c032a493e8041370fe531020f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.247622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3061/6154] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:45 2022] DELETE /identity/v3/users/69713a3c032a493e8041370fe531020f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:45.251264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:45.258980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:45.294169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:45.307173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:45.344597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3094/6155] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:45.463200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc3bc-bd5a-4fc9-a714-6b5cb8fde56a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:45.478890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:45.480141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:45.481299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:45.482382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/c92bcad4e9484d79b9e91111bff46cc9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:45.484642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c92bcad4e9484d79b9e91111bff46cc9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:45.496328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:45.531715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:45.645770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92bcad4e9484d79b9e91111bff46cc9', 'request_id': 'req-da090847-b6cc-408e-ae8c-8c110ed4a029'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.662434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92bcad4e9484d79b9e91111bff46cc9', 'request_id': 'req-da090847-b6cc-408e-ae8c-8c110ed4a029'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.681600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92bcad4e9484d79b9e91111bff46cc9', 'request_id': 'req-da090847-b6cc-408e-ae8c-8c110ed4a029'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.718693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project c92bcad4e9484d79b9e91111bff46cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:45.718693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.718693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:45.727957 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3062/6156] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:45 2022] DELETE /identity/v3/projects/c92bcad4e9484d79b9e91111bff46cc9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:45.729819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:45.749756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175978ba-dc74-46e0-bc42-877d3eb48334 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:45.907721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:45.908676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:45.909057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:45.910346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:45.911871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:45.914095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:45.940489 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3095/6157] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:45 2022] POST /identity/v3/projects => generated 348 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:45.944516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:45.946502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:45.970214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090847-b6cc-408e-ae8c-8c110ed4a029 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:46.138810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:46.141103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:46.143158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:46.144486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:46.147273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:12:46.148091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:46.152530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:46.212263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3063/6158] 10.222.0.18 () {58 vars in 1159 bytes} [Sat Jun 4 21:12:45 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:46.216720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:46.229429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aefdc-d4c1-4a29-94ca-6435c663d100 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:46.235184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:46.236110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:46.236519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:46.236914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:46.237879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:46.239890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:46.269530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:46.270531 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3096/6159] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:12:46 2022] GET /identity/v3/domains => generated 829 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:46.284042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f0d0-5c93-4de4-adb5-c671c4cd602c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:46.297054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:46.302962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:46.302962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:46.302962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/49ec28ac980742fead422e15e8d6c925` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:46.302962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_project(project_id=49ec28ac980742fead422e15e8d6c925)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:46.303482 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:46.303482 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:12:46.303482 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:12:46.304755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:46.324168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.325470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.411439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.416840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.429447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3064/6160] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:12:46 2022] PATCH /identity/v3/projects/49ec28ac980742fead422e15e8d6c925 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:46.431092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:46.437721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:46.467655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefe784-8b6b-4307-8a42-d68b1ac0fd32 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:46.518147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:46.583059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:46.584153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:46.584515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:46.584898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/49ec28ac980742fead422e15e8d6c925` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:46.617688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49ec28ac980742fead422e15e8d6c925)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:46.620285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:46.673885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.687473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '49ec28ac980742fead422e15e8d6c925'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.803735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.824150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.832485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.869278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project 49ec28ac980742fead422e15e8d6c925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:46.870372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.872655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.890515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.891740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.896503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '49ec28ac980742fead422e15e8d6c925', 'request_id': 'req-183d8d94-f39e-4a69-93be-4e387e94e4a2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:46.903865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3097/6161] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:46 2022] DELETE /identity/v3/projects/49ec28ac980742fead422e15e8d6c925 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:46.908928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:46.927024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34671-f3ef-4909-983d-7799822e9c26 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:46.997966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:47.002305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:47.080677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:47.104542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:47.109983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:47.110307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:47.110606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:47.111344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:47.124189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:47.205291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8d94-f39e-4a69-93be-4e387e94e4a2 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:47.215717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:47.216324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:47.216607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:47.216885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:47.222823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:47.244910 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3065/6162] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:46 2022] POST /identity/v3/projects => generated 360 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:47.246136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:47.246284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:47.247797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:47.253402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:47.280641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3098/6163] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:47.452135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430450e-7da6-4feb-bb97-564156487d19 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:47.457301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:47.458409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:47.459102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:47.459394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/a2fbfaba0b4142b18adecf2fca6952d3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:47.460664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=a2fbfaba0b4142b18adecf2fca6952d3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:47.462876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:47.466223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3066/6164] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:47 2022] GET /identity/v3/projects/a2fbfaba0b4142b18adecf2fca6952d3 => generated 360 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:47.470523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:47.478810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:47.493330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8d350-99e0-4681-aab9-e768bbe17a64 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:47.511259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:47.511977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:47.512264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:47.512556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/a2fbfaba0b4142b18adecf2fca6952d3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:47.515250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2fbfaba0b4142b18adecf2fca6952d3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:47.517458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:47.594025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fbfaba0b4142b18adecf2fca6952d3', 'request_id': 'req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:47.606989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fbfaba0b4142b18adecf2fca6952d3', 'request_id': 'req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:47.613953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fbfaba0b4142b18adecf2fca6952d3', 'request_id': 'req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:47.637446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project a2fbfaba0b4142b18adecf2fca6952d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:47.638060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:47.639082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:47.641972 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3099/6165] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:47 2022] DELETE /identity/v3/projects/a2fbfaba0b4142b18adecf2fca6952d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:47.648815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:47.650980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:47.674321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de98f8-63ed-4f81-9bf9-5e89f535d896 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:47.780975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:47.781810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:47.782279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:47.782644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:47.783426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:47.787576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:47.847896 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3067/6166] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:47 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:47.852221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:47.882994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b6e1e-8d9b-44bd-8eac-bd23c2a77770 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:48.000103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:48.001093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:48.001447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:48.002381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/407f856ced9f4aaeb6ff80452e3101e8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:48.004846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=407f856ced9f4aaeb6ff80452e3101e8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:48.007471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:48.009848 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3100/6167] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:47 2022] GET /identity/v3/projects/407f856ced9f4aaeb6ff80452e3101e8 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:48.014027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:48.030389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406a1a-a41c-4e53-a8c2-f49b9cef922e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:48.039358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:48.040866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:48.041160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:48.041586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/407f856ced9f4aaeb6ff80452e3101e8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:48.062152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=407f856ced9f4aaeb6ff80452e3101e8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:48.064724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:48.189014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407f856ced9f4aaeb6ff80452e3101e8', 'request_id': 'req-f32cba7d-da3a-493f-885e-a6b45d16988b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.199617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407f856ced9f4aaeb6ff80452e3101e8', 'request_id': 'req-f32cba7d-da3a-493f-885e-a6b45d16988b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.220517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407f856ced9f4aaeb6ff80452e3101e8', 'request_id': 'req-f32cba7d-da3a-493f-885e-a6b45d16988b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.224889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:48.252081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project 407f856ced9f4aaeb6ff80452e3101e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:48.252632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.254341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.266942 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3068/6168] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:48 2022] DELETE /identity/v3/projects/407f856ced9f4aaeb6ff80452e3101e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:48.273688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:48.275612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:48.306557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239079b-0c4b-4b15-836c-141eb6aa04f7 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:48.523807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:48.524554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:48.524853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:48.525132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:48.525823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:48.539333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:48.635723 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3101/6169] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:12:48 2022] POST /identity/v3/projects => generated 347 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:48.640139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:48.657487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cba7d-da3a-493f-885e-a6b45d16988b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:48.788532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:48.789545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:48.789899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:48.790486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/ccad10bbc9994bdabddd9cdb6e0e306a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:48.791712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=ccad10bbc9994bdabddd9cdb6e0e306a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:48.793904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:48.796914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3069/6170] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:48 2022] GET /identity/v3/projects/ccad10bbc9994bdabddd9cdb6e0e306a => generated 347 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:48.801455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:48.817087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035f17-d5b8-45f5-b2ec-0180fc4ed63d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:48.823265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:48.824364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:48.824719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:48.825068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/ccad10bbc9994bdabddd9cdb6e0e306a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:48.826359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ccad10bbc9994bdabddd9cdb6e0e306a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:48.829114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:48.845743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:48.935932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccad10bbc9994bdabddd9cdb6e0e306a', 'request_id': 'req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.947976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccad10bbc9994bdabddd9cdb6e0e306a', 'request_id': 'req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:48.958224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccad10bbc9994bdabddd9cdb6e0e306a', 'request_id': 'req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:49.000066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project ccad10bbc9994bdabddd9cdb6e0e306a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:49.000974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:49.004952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:49.012426 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3102/6171] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:48 2022] DELETE /identity/v3/projects/ccad10bbc9994bdabddd9cdb6e0e306a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:49.012653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:49.014891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:49.064037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288aac-1196-4390-b86a-cf26b28d9961 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:49.252979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:49.255251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:49.255584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:49.255878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:49.256660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:49.259083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:49.306750 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3070/6172] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:12:49 2022] POST /identity/v3/domains => generated 275 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:49.310139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:49.323380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2defc-4bb7-40d7-b22e-8ddfcae3a9b4 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:49.493373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:49.494294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:49.494742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:49.495189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:49.497456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:49.503446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:49.585538 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3103/6173] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:49 2022] POST /identity/v3/projects => generated 404 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:49.590144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:49.604078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bd25-2ed3-4ad3-8bb5-cab0f91f15b1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:49.731447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:49.734311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:49.736059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:49.736575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/0260c38a1e9c4a769526dddbbd8c00fc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:49.738183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=0260c38a1e9c4a769526dddbbd8c00fc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:49.741932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:49.749595 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3071/6174] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:49 2022] GET /identity/v3/projects/0260c38a1e9c4a769526dddbbd8c00fc => generated 404 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:49.750295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:49.769529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f736f9-3a7b-4b35-a7ae-31520717b826 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:49.783649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:49.789908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:49.789908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:49.790214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/0260c38a1e9c4a769526dddbbd8c00fc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:49.792647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0260c38a1e9c4a769526dddbbd8c00fc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:49.797822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:49.956357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0260c38a1e9c4a769526dddbbd8c00fc', 'request_id': 'req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:49.975436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0260c38a1e9c4a769526dddbbd8c00fc', 'request_id': 'req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:49.995146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0260c38a1e9c4a769526dddbbd8c00fc', 'request_id': 'req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.001211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:50.027286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project 0260c38a1e9c4a769526dddbbd8c00fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:50.027940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.030675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.032670 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3104/6175] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:49 2022] DELETE /identity/v3/projects/0260c38a1e9c4a769526dddbbd8c00fc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:50.036861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:50.038870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:50.061598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e961927-241e-4896-aaad-fb8bff10bcd0 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:50.135828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:50.228321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:50.233755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:50.234045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:50.234333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/d8d8a16f005b4235abaef984b683a344` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:50.243544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d8d8a16f005b4235abaef984b683a344)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:50.251724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:50.335594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.336391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.416461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.419091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.426052 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3072/6176] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:50 2022] PATCH /identity/v3/domains/d8d8a16f005b4235abaef984b683a344 => generated 276 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:50.430849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:50.451491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7c7d-1894-4ab9-b1a8-f4f37eb827fe tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:50.586859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:50.590152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:50.590690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:50.591076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/d8d8a16f005b4235abaef984b683a344` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:50.664126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d8d8a16f005b4235abaef984b683a344)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:50.669038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:50.767233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.771920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd8d8a16f005b4235abaef984b683a344'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.773064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:50.774891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:50.864624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.879120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.887569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.939472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project d8d8a16f005b4235abaef984b683a344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:50.941272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.943149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.945095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6acafc-addc-4fa5-b896-a69cad4d3660 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:50.980153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.982233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:50.996608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd8d8a16f005b4235abaef984b683a344', 'request_id': 'req-4abfb9f1-a452-42cb-a8c8-ff571265a34f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:51.021170 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3105/6177] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:50 2022] DELETE /identity/v3/domains/d8d8a16f005b4235abaef984b683a344 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:51.024274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:51.028657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:51.096080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:51.105220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:51.105899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:51.106183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:51.106459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:51.117193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:51.192521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb9f1-a452-42cb-a8c8-ff571265a34f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:51.213475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:51.214195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:51.214481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:51.214762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:51.215535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:51.221468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:51.258593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:51.263442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:51.270705 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3106/6178] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:12:51 2022] POST /identity/v3/domains => generated 277 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:51.275042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:51.295471 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3073/6179] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:12:51.575810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a770e6-5f66-4a65-a617-842545c5d190 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:51.600723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:51.601932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:51.602467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:51.602948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:51.604242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:51.620054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:51.841385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3107/6180] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:51 2022] POST /identity/v3/projects => generated 410 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:51.842944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:51.865140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f424cf0-1ddb-4437-a8cf-458e728d9bfa service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:51.881630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:52.023221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:52.024044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:52.024398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:52.024748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:52.025527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:52.027662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:52.108589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:52.109627 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3074/6181] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:51 2022] POST /identity/v3/projects => generated 405 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:52.123992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47532c-9051-46e1-a7f3-442742695407 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:52.334245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:52.336548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:52.341740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:52.342255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/fce00f4c4a564bb29b45b68a718b7d79` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:52.347168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fce00f4c4a564bb29b45b68a718b7d79)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:52.353100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:52.495866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:52.507580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce00f4c4a564bb29b45b68a718b7d79', 'request_id': 'req-1e01f07a-69ca-40d6-8f71-dde94ac63362'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.538400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce00f4c4a564bb29b45b68a718b7d79', 'request_id': 'req-1e01f07a-69ca-40d6-8f71-dde94ac63362'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.561863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce00f4c4a564bb29b45b68a718b7d79', 'request_id': 'req-1e01f07a-69ca-40d6-8f71-dde94ac63362'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.626557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project fce00f4c4a564bb29b45b68a718b7d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:52.627061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.628878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.637219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:52.638505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3108/6182] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:52 2022] DELETE /identity/v3/projects/fce00f4c4a564bb29b45b68a718b7d79 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:52.642592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:52.669647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84e25-5149-4ce9-ace6-a58485c5148a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:52.793748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:52.794686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:52.795182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:52.795402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/f38942fe373a45f58ba94560e4a456af` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:52.796689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f38942fe373a45f58ba94560e4a456af)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:52.798726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:52.905251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38942fe373a45f58ba94560e4a456af', 'request_id': 'req-184d0b0f-ccae-4785-9111-6171b3823236'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.913578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38942fe373a45f58ba94560e4a456af', 'request_id': 'req-184d0b0f-ccae-4785-9111-6171b3823236'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.928620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38942fe373a45f58ba94560e4a456af', 'request_id': 'req-184d0b0f-ccae-4785-9111-6171b3823236'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.975971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project f38942fe373a45f58ba94560e4a456af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:52.976360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.977322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:52.979240 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3075/6183] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:52 2022] DELETE /identity/v3/projects/f38942fe373a45f58ba94560e4a456af => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:52.983705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:52.994713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f07a-69ca-40d6-8f71-dde94ac63362 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:53.156262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:53.159071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:53.159481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:53.159873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/be2b32ccfb9440eaaa334037332faf55` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:53.162369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=be2b32ccfb9440eaaa334037332faf55)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:53.167269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:53.227187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.228277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.279365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.285444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.295027 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3109/6184] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:52 2022] PATCH /identity/v3/domains/be2b32ccfb9440eaaa334037332faf55 => generated 278 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:53.295190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:53.296843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:53.318603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d0b0f-ccae-4785-9111-6171b3823236 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:53.347775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:53.464535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:53.465663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:53.465956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:53.466241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/be2b32ccfb9440eaaa334037332faf55` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:53.482633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=be2b32ccfb9440eaaa334037332faf55)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:53.485041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:53.517220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.523713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.641698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.651540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.667755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.687204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project be2b32ccfb9440eaaa334037332faf55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:53.687591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.688719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.701623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.702602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.703312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'be2b32ccfb9440eaaa334037332faf55', 'request_id': 'req-61abe036-5874-42cd-a6b5-7e80e12d5d37'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:53.722488 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3076/6185] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:53 2022] DELETE /identity/v3/domains/be2b32ccfb9440eaaa334037332faf55 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:53.723952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:53.725753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:53.749567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226874ee-f786-49c1-8513-af0549b188f3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:53.879777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:53.882207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:53.885365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:53.886654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:53.888306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:53.894765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:53.980106 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3110/6186] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:53 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:53.980359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:53.981732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:54.003974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abe036-5874-42cd-a6b5-7e80e12d5d37 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:54.117390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:54.128814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:54.133583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:54.133583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:54.133583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/c996beaa3075480da6e0ad890d708e4a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:54.135100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=c996beaa3075480da6e0ad890d708e4a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:54.138134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:54.143600 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3077/6187] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:53 2022] GET /identity/v3/projects/c996beaa3075480da6e0ad890d708e4a => generated 377 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:54.148357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:54.175407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d9e8f-b2e2-46db-8a5f-cdc524ec2db3 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:54.214253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:54.214969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:54.215262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:54.215594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:54.224543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:54.228448 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:54.228448 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:54.228448 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:54.230403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:54.344955 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3111/6188] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:12:54 2022] GET /identity/v3/projects => generated 7294 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:12:54.349986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:54.374029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731d5e5-fd2a-4174-951d-f6c8446b8c4d tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:54.380781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:54.381922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:54.382376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:54.382742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/c996beaa3075480da6e0ad890d708e4a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:54.386105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c996beaa3075480da6e0ad890d708e4a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:54.407953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:54.594268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c996beaa3075480da6e0ad890d708e4a', 'request_id': 'req-d0cbf643-240e-49f2-b53c-ee90646d7d70'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:54.610221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c996beaa3075480da6e0ad890d708e4a', 'request_id': 'req-d0cbf643-240e-49f2-b53c-ee90646d7d70'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:54.640421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c996beaa3075480da6e0ad890d708e4a', 'request_id': 'req-d0cbf643-240e-49f2-b53c-ee90646d7d70'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:54.685912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project c996beaa3075480da6e0ad890d708e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:54.686315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:54.687973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:54.692535 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3078/6189] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:54 2022] DELETE /identity/v3/projects/c996beaa3075480da6e0ad890d708e4a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:54.698260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:54.700339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:54.732375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee1f0e-8b37-4e13-bc26-dbf32e3b21ed tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:54.761223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:54.882975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:54.885592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:54.886077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:54.886853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:54.888504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:54.892559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:54.963742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:54.967333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3112/6190] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:12:54 2022] POST /identity/v3/projects => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:54.980763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbf643-240e-49f2-b53c-ee90646d7d70 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.138884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.140846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.141544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:55.142035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.142394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.142743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.144480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_project(project_id=ef6487bf432943ab9b190b2fac4c4dd7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.146531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.206472 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3079/6191] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:12:54 2022] PATCH /identity/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7 => generated 360 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:12:55.214065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.234858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bea61-76af-460f-a47a-15e492fe5c46 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.241642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.242640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.242924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.243195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.268045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=ef6487bf432943ab9b190b2fac4c4dd7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.270720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.273234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3080/6192] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:55 2022] GET /identity/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7 => generated 347 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:55.277670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.290135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c1586-9959-4248-8ece-f9c461b0b5d1 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.301643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.302769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.303409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.303833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.305532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef6487bf432943ab9b190b2fac4c4dd7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.308603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.309882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0542b3e-c111-461b-b1f2-8ea921295d9a tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.325982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.327164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.327658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.328125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] PATH_INFO: `/v3/users/477aa1f663c440a496dcc85d31b2310e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.331858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477aa1f663c440a496dcc85d31b2310e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.334358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.393878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:55.418074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6487bf432943ab9b190b2fac4c4dd7', 'request_id': 'req-071f40c2-5a70-4d20-9df7-e04e2cc3c676'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.431599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6487bf432943ab9b190b2fac4c4dd7', 'request_id': 'req-071f40c2-5a70-4d20-9df7-e04e2cc3c676'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.445666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477aa1f663c440a496dcc85d31b2310e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.448643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6487bf432943ab9b190b2fac4c4dd7', 'request_id': 'req-071f40c2-5a70-4d20-9df7-e04e2cc3c676'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.454419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477aa1f663c440a496dcc85d31b2310e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.455473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477aa1f663c440a496dcc85d31b2310e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.456195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477aa1f663c440a496dcc85d31b2310e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.478833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project ef6487bf432943ab9b190b2fac4c4dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:55.479649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.480342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.482448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3081/6193] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:55 2022] DELETE /identity/v3/projects/ef6487bf432943ab9b190b2fac4c4dd7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:55.487812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.489524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:55.491105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4f2dfe5-632f-49a0-831e-c8c811b9c1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477aa1f663c440a496dcc85d31b2310e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:55.513832 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3113/6194] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:55 2022] DELETE /identity/v3/users/477aa1f663c440a496dcc85d31b2310e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:55.518843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.519585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.520070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.549109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:55.550504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:55.570220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:55.603445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f40c2-5a70-4d20-9df7-e04e2cc3c676 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.675402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3114/6195] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:12:55.689174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.690960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:55.733735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.734568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.734865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.735151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.737765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.740490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.789047 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3082/6196] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:55 2022] POST /identity/v3/projects => generated 361 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:12:55.792428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:55.802457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1390d7-06c2-47d4-ab35-4261311046a5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.885656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.886736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.887316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.887663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.928743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9d24a-bcd3-4c9c-a252-9c9b49743f08 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:55.941796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:55.942699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:55.943046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:55.943332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/3e28a84275984bf6b8bbb2194d224c1f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:55.946971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_project(project_id=3e28a84275984bf6b8bbb2194d224c1f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:55.949367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:55.951868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:56.019550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.021940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.046227 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3083/6197] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:12:55 2022] PATCH /identity/v3/projects/3e28a84275984bf6b8bbb2194d224c1f => generated 373 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:56.049714 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3115/6198] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:56.058166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.085401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e73ea-85f4-4673-8c94-9efc2ee1ef7f tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.103204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.104330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.104834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.105284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/3e28a84275984bf6b8bbb2194d224c1f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.147253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=3e28a84275984bf6b8bbb2194d224c1f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.149676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.160163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.168282 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3084/6199] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:56 2022] GET /identity/v3/projects/3e28a84275984bf6b8bbb2194d224c1f => generated 360 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:56.176963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c5a03-b855-4b33-85aa-2065836c6251 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.197997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.199323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.199539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.199858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/3e28a84275984bf6b8bbb2194d224c1f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.205713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e28a84275984bf6b8bbb2194d224c1f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.207836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.226897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:56.276382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e28a84275984bf6b8bbb2194d224c1f', 'request_id': 'req-2eb10045-89c8-426a-9f7e-24244836a734'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:56.289824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e28a84275984bf6b8bbb2194d224c1f', 'request_id': 'req-2eb10045-89c8-426a-9f7e-24244836a734'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:56.300244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e28a84275984bf6b8bbb2194d224c1f', 'request_id': 'req-2eb10045-89c8-426a-9f7e-24244836a734'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:56.346269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project 3e28a84275984bf6b8bbb2194d224c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:56.349430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:56.351381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:56.361996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.362368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3116/6200] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:56 2022] DELETE /identity/v3/projects/3e28a84275984bf6b8bbb2194d224c1f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:56.365248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:56.393480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94c017-8b15-419d-8a55-8d0a03ce0f49 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.547843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.549527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.550158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.550931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.552737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.556507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.608637 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3085/6201] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:12:56 2022] POST /identity/v3/projects => generated 353 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:12:56.613176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.631866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb10045-89c8-426a-9f7e-24244836a734 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.696104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.697026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.697319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.697611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/df41640b47b74b30a8d91111eaa86e73` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.699466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:update_project(project_id=df41640b47b74b30a8d91111eaa86e73)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.700800 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:12:56.700800 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:12:56.700800 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:12:56.703183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.785133 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3117/6202] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:12:56 2022] PATCH /identity/v3/projects/df41640b47b74b30a8d91111eaa86e73 => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:12:56.789589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.808163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791ea-b5ba-4675-b03b-9f19fade08e8 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.818645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.820339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.820781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.821618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/df41640b47b74b30a8d91111eaa86e73` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.842260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:get_project(project_id=df41640b47b74b30a8d91111eaa86e73)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.847156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:56.856434 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3086/6203] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:12:56 2022] GET /identity/v3/projects/df41640b47b74b30a8d91111eaa86e73 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:12:56.860768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:56.879250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031c163-9575-4bcc-bf41-80330d6e6091 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:56.888024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:56.890228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:56.890623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:56.891496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/projects/df41640b47b74b30a8d91111eaa86e73` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:56.896460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df41640b47b74b30a8d91111eaa86e73)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:56.902362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:57.046202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df41640b47b74b30a8d91111eaa86e73', 'request_id': 'req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.076693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df41640b47b74b30a8d91111eaa86e73', 'request_id': 'req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.104707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df41640b47b74b30a8d91111eaa86e73', 'request_id': 'req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.142155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] The token cache is being invalidate because project df41640b47b74b30a8d91111eaa86e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:57.142853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.143870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.154326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.154919 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3118/6204] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:56 2022] DELETE /identity/v3/projects/df41640b47b74b30a8d91111eaa86e73 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:57.156960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:57.175461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0fced-6743-42c8-b1b4-c40633ff942c tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:57.350334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:57.351972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.352464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.353415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.353647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/be2b32ccfb9440eaaa334037332faf55` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.361843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:57.368282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:12:57.372910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Could not find domain: be2b32ccfb9440eaaa334037332faf55.: keystone.exception.DomainNotFound: Could not find domain: be2b32ccfb9440eaaa334037332faf55. Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be2b32ccfb9440eaaa334037332faf55. Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:57.398948 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:57.400095 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be2b32ccfb9440eaaa334037332faf55. Jun 04 21:12:57.401301 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.406007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3087/6205] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:57 2022] PATCH /identity/v3/domains/be2b32ccfb9440eaaa334037332faf55 => generated 112 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:12:57.408370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.447725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9f085-a43d-4834-af42-9f69fd730f38 tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:57.466550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feb1681a93440acb6604651cfdea793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e579cf8c96b42aeb32b03596e1b8ff2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:57.478463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.478762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.479049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] PATH_INFO: `/v3/domains/d8d8a16f005b4235abaef984b683a344` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.491236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d6ac7-894a-4bbb-8c25-2baebabefc1e tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:57.492085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:12:57.500445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:57.502184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.502709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.503215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] PATH_INFO: `/v3/projects/3cb222a5b84448e49efb0ffffc35b928` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.504732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb222a5b84448e49efb0ffffc35b928)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:57.506934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Could not find domain: d8d8a16f005b4235abaef984b683a344.: keystone.exception.DomainNotFound: Could not find domain: d8d8a16f005b4235abaef984b683a344. Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d8d8a16f005b4235abaef984b683a344. Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:12:57.507748 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:12:57.508745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d8d8a16f005b4235abaef984b683a344. Jun 04 21:12:57.509662 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:12:57.514347 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3088/6206] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:12:57 2022] PATCH /identity/v3/domains/d8d8a16f005b4235abaef984b683a344 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:12:57.518503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.521950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:57.539699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51057b-d30f-4b9b-9a94-f3bdb33f343b tempest-ProjectsTestJSON-794732708 tempest-ProjectsTestJSON-794732708-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:57.550391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:57.551358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.551831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.552212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] PATH_INFO: `/v3/users/e95913d9ed204561aa320e18ab549f94` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.553610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95913d9ed204561aa320e18ab549f94)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:57.555833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:57.562361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:57.629363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb222a5b84448e49efb0ffffc35b928', 'request_id': 'req-7fe6d733-008d-4612-9dec-be81b374ae6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.657717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb222a5b84448e49efb0ffffc35b928', 'request_id': 'req-7fe6d733-008d-4612-9dec-be81b374ae6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.661555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95913d9ed204561aa320e18ab549f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.663084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95913d9ed204561aa320e18ab549f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.674305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95913d9ed204561aa320e18ab549f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.675835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95913d9ed204561aa320e18ab549f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.697416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb222a5b84448e49efb0ffffc35b928', 'request_id': 'req-7fe6d733-008d-4612-9dec-be81b374ae6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.702306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-44ab3034-a9d3-4de7-9e8a-18d69ed41169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95913d9ed204561aa320e18ab549f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.721574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] The token cache is being invalidate because project 3cb222a5b84448e49efb0ffffc35b928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:57.722024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.723239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:57.728341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3119/6207] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:57 2022] DELETE /identity/v3/projects/3cb222a5b84448e49efb0ffffc35b928 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:57.730991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.736250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:57.740250 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3089/6208] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:57 2022] DELETE /identity/v3/users/e95913d9ed204561aa320e18ab549f94 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:57.751037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.751331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.752080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.778557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:12:57.780007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:57.933762 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3090/6209] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:12:57.940228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6d733-008d-4612-9dec-be81b374ae6a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:57.961123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:57.966377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:57.968088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:57.970402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] PATH_INFO: `/v3/users/76ed058cc15d4866b27264b19a74206e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:57.975753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ed058cc15d4866b27264b19a74206e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:57.977760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:57.981413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:57.982888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:58.109807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:58.127527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ed058cc15d4866b27264b19a74206e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:58.144854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ed058cc15d4866b27264b19a74206e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:58.145894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ed058cc15d4866b27264b19a74206e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:58.148536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ed058cc15d4866b27264b19a74206e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:58.183065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ed058cc15d4866b27264b19a74206e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:58.209363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3120/6210] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:57 2022] DELETE /identity/v3/users/76ed058cc15d4866b27264b19a74206e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:58.235474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e142-0b11-4749-b45a-f35c1b7aae83 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:58.317045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:58.330489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:58.331937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:58.334344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:58.334344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:58.338939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:58.491797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:58.496261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:58.526497 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3091/6211] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:12:59.183538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:59.185878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:59.205353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5e27-a0ae-4276-9137-24ea03725f33 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:59.211544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:59.212958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:59.213244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:59.213517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] PATH_INFO: `/v3/projects/6a5c70a4e24a46a79443a500d0377519` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:59.214909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5c70a4e24a46a79443a500d0377519)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:59.217177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:59.321076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5c70a4e24a46a79443a500d0377519', 'request_id': 'req-98ffe148-e683-4198-a4fd-f9597f056d39'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.334911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5c70a4e24a46a79443a500d0377519', 'request_id': 'req-98ffe148-e683-4198-a4fd-f9597f056d39'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.351281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5c70a4e24a46a79443a500d0377519', 'request_id': 'req-98ffe148-e683-4198-a4fd-f9597f056d39'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.387686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] The token cache is being invalidate because project 6a5c70a4e24a46a79443a500d0377519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:59.388283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.392440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.399800 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3121/6212] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:59 2022] DELETE /identity/v3/projects/6a5c70a4e24a46a79443a500d0377519 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:59.401355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:59.411790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb4e2b-1b75-4ea5-b85b-984430c3f885 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:59.491603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:59.492875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:59.493527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:59.494535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] PATH_INFO: `/v3/users/effce95b613c4decac851b4e04085814` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:59.511729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=effce95b613c4decac851b4e04085814)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:59.515964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:59.520891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:59.522510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:59.562448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe148-e683-4198-a4fd-f9597f056d39 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:59.591892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:59.593086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:59.593583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:59.593860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] PATH_INFO: `/v3/projects/da80f2ea607c49208087e0c788b6a0c2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:59.596820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da80f2ea607c49208087e0c788b6a0c2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:59.598852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:12:59.661153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effce95b613c4decac851b4e04085814'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.662131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effce95b613c4decac851b4e04085814'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.672380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effce95b613c4decac851b4e04085814'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.673399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effce95b613c4decac851b4e04085814'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.699796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effce95b613c4decac851b4e04085814'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.709199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da80f2ea607c49208087e0c788b6a0c2', 'request_id': 'req-427a3201-85de-4986-b513-7cb447a4592c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.725419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da80f2ea607c49208087e0c788b6a0c2', 'request_id': 'req-427a3201-85de-4986-b513-7cb447a4592c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.738730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da80f2ea607c49208087e0c788b6a0c2', 'request_id': 'req-427a3201-85de-4986-b513-7cb447a4592c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.742814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3092/6213] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:59 2022] DELETE /identity/v3/users/effce95b613c4decac851b4e04085814 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:12:59.771529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] The token cache is being invalidate because project da80f2ea607c49208087e0c788b6a0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:12:59.772540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.773964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:12:59.781878 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3122/6214] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:12:59 2022] DELETE /identity/v3/projects/da80f2ea607c49208087e0c788b6a0c2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:12:59.783151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:12:59.784780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:12:59.804826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:59.915002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262507a8-9ea6-49ff-9502-e584ed4273dc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:12:59.932385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:12:59.933559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:12:59.933845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:12:59.934122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] PATH_INFO: `/v3/users/4feb1681a93440acb6604651cfdea793` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:12:59.938606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4feb1681a93440acb6604651cfdea793)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:12:59.941012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:00.050899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4feb1681a93440acb6604651cfdea793'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.051906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4feb1681a93440acb6604651cfdea793'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.067193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4feb1681a93440acb6604651cfdea793'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.068013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4feb1681a93440acb6604651cfdea793'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.091108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4feb1681a93440acb6604651cfdea793'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.118285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3093/6215] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:12:59 2022] DELETE /identity/v3/users/4feb1681a93440acb6604651cfdea793 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:00.447875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:00.449884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:00.491686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:00.556579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3201-85de-4986-b513-7cb447a4592c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:00.658976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:00.661091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:00.741343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:00.742770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:00.743252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:00.743726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] PATH_INFO: `/v3/projects/b2e81354dc53406c8242c2d9653f1167` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:00.745216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e81354dc53406c8242c2d9653f1167)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:00.747350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:00.806493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef6174-0a93-4514-82bd-4f2769e07fda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:00.816014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:00.816014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:00.816398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:00.816513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] PATH_INFO: `/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:00.818371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e579cf8c96b42aeb32b03596e1b8ff2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:00.820931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:00.836335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e81354dc53406c8242c2d9653f1167', 'request_id': 'req-3105fe82-7429-4787-bc20-1eb8bf4dff21'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.846478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e81354dc53406c8242c2d9653f1167', 'request_id': 'req-3105fe82-7429-4787-bc20-1eb8bf4dff21'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.854537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e81354dc53406c8242c2d9653f1167', 'request_id': 'req-3105fe82-7429-4787-bc20-1eb8bf4dff21'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.881297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:00.892486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] The token cache is being invalidate because project b2e81354dc53406c8242c2d9653f1167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:00.896749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.897837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3105fe82-7429-4787-bc20-1eb8bf4dff21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.898117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e579cf8c96b42aeb32b03596e1b8ff2', 'request_id': 'req-3044f028-b3c0-4f73-b2d0-16b0300651b2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.902484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3123/6216] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:00 2022] DELETE /identity/v3/projects/b2e81354dc53406c8242c2d9653f1167 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:00.906992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e579cf8c96b42aeb32b03596e1b8ff2', 'request_id': 'req-3044f028-b3c0-4f73-b2d0-16b0300651b2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.911243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3671c-0395-4ea5-b2dc-58d0d77c7715 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:00.911785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3671c-0395-4ea5-b2dc-58d0d77c7715 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:00.912232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3671c-0395-4ea5-b2dc-58d0d77c7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:00.916840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e579cf8c96b42aeb32b03596e1b8ff2', 'request_id': 'req-3044f028-b3c0-4f73-b2d0-16b0300651b2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.938745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] The token cache is being invalidate because project 4e579cf8c96b42aeb32b03596e1b8ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:00.939219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.950412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3044f028-b3c0-4f73-b2d0-16b0300651b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:00.953459 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3094/6217] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:00 2022] DELETE /identity/v3/projects/4e579cf8c96b42aeb32b03596e1b8ff2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:00.961988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2375-25c6-4b54-89ce-d5d4bfa99eea None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:00.963878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2375-25c6-4b54-89ce-d5d4bfa99eea None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:00.965444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db2375-25c6-4b54-89ce-d5d4bfa99eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:00.971982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-19e3671c-0395-4ea5-b2dc-58d0d77c7715 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:00.973462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19e3671c-0395-4ea5-b2dc-58d0d77c7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.005611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c6db2375-25c6-4b54-89ce-d5d4bfa99eea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:01.007010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c6db2375-25c6-4b54-89ce-d5d4bfa99eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.058734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:01.101520 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3124/6218] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:01.102841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3095/6219] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:01.110721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.111160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.111569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.112244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.112848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.113141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.136448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:01.137694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.153242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3096/6220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:01.154014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:01.154246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.155478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.167897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f2c63-1ff6-441c-abf1-9243627956eb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.174801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.175616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.175936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.176304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.177210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:01.177537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.180835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3125/6221] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:01.180997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.182415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.196168 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3097/6222] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:01.201220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.203757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85130ac6-a91a-4846-8a02-0110a4329af6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.211703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.212564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.212984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.213697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.214608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:01.215036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.217838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.231323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4438-6dfd-46c9-bf34-a9743cfe61b0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.236463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.237227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.237580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.237931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.239535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.241625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.256067 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3126/6223] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:13:01.262118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.281388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85087acc-3e66-49c0-a74c-565c9f335402 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.286853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.287691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.288037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.288384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.289313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.291489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.300344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3098/6224] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:01.308712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.333292 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3127/6225] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/projects => generated 393 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:01.338448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.400370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f04fea-e728-4b08-a883-f63f48680a5e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.439789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3477ec-4869-4a9b-b762-105f820e4813 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.444251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:01.453311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.454356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.454646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.454925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.455656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.458571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.515663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3128/6226] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:01.525659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.544306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907845f8-e9a7-4d57-8322-7d417a182c7d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.551124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.552134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.552428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.552706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.553410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.556213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.565673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.566377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.566694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.566972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.567894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.573310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.610516 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3129/6227] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:01.617441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.634684 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3099/6228] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:01.637461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.673853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a762ab5-f399-43d1-b965-0c0e1010db0f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.677371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff7d9a-88fb-4554-966a-8ccc90f70808 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.691086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.691925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.692218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.692504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.693252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.694914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.700895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.701600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.701876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.702161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.702936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.709195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.718427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3100/6229] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:01.722894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.734853 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3130/6230] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:01.738874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.743466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92db3-f469-41ed-b62e-fe10b260e39a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.751432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.752165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.753095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.753386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.754439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.757361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.772585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3101/6231] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:01.777011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:01.777459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a879d2-8ded-45dd-9199-d2de02f1ddb2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.785779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.787165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.787697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.788273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] PATH_INFO: `/v3/projects/e6c3f759fbde4b209d7d15ae2d262603/users/6aac9857ea644526845c71b5ff77e327/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.802182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a6e5-ddf9-4afa-8313-55dc8afc8225 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:01.808711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:01.810112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.811806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.812312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] PATH_INFO: `/v3/projects/a3e9bf162b68485fa63f583ca2c89f2e/users/a2af25a3801843c0a30f0d68dcc2a9dd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.819677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c3f759fbde4b209d7d15ae2d262603, user_id=6aac9857ea644526845c71b5ff77e327, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.828519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3ca0-80cb-499c-beec-c5323684aa07 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.849887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e9bf162b68485fa63f583ca2c89f2e, user_id=a2af25a3801843c0a30f0d68dcc2a9dd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:01.853241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597df07b-a45a-423b-83d6-a99917cb76bc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:01.887562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3131/6232] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:01 2022] PUT /identity/v3/projects/e6c3f759fbde4b209d7d15ae2d262603/users/6aac9857ea644526845c71b5ff77e327/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:01.887961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3102/6233] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:01 2022] PUT /identity/v3/projects/a3e9bf162b68485fa63f583ca2c89f2e/users/a2af25a3801843c0a30f0d68dcc2a9dd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:01.897268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.897419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:01.897581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.897863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.898000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:01.898375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:01.939674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] MFA Rules not processed for user `6aac9857ea644526845c71b5ff77e327`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:01.941397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.958891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] MFA Rules not processed for user `a2af25a3801843c0a30f0d68dcc2a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:01.965986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:01.992403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:02.050537 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3132/6234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:02.056271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.133741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3103/6235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:02.135054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.232498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320078-eb8a-4898-8a45-ab48e9501ebb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.249718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.250410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.251412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.251725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.252435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.254434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.319858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:02.336480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439765f7-6c82-4621-88b2-ebe322fe237d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.344142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.344864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3133/6236] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:02 2022] POST /identity/v3/projects => generated 393 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:02.345433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.345685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.345963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.346705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.349168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.354223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.420908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3104/6237] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:02 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:02.422091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.501441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f7b-721c-4574-94b8-abf306509bb9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.554116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd47ba-bf82-47d7-b9f0-0e13af5c6788 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.569265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.570234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.570664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.571116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.571991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.576058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.636137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3105/6238] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:02 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:02.640666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.655933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2caded-bbe6-4971-90e2-26f9ddcf2634 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.663033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.663240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.663791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.664222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.664510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.665256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.665668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.666509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.666949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.667704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.672191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.681322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.706055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:02.709695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3106/6239] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:02.720251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.733329 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3134/6240] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:02 2022] POST /identity/v3/users => generated 303 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:02.739425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.750012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f8f8c-6b10-4672-aeeb-f3c6af14d4d5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.766442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737131fe-e4c9-4068-bf60-e528121cc874 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.766704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.767376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.767694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.767976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] PATH_INFO: `/v3/projects/979571e7136e49898d076e6a8dc98b37/users/2abb393924294ba9b52f2332c2e145b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.779997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.781244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.781740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.782234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.783283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.785480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.812397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979571e7136e49898d076e6a8dc98b37, user_id=2abb393924294ba9b52f2332c2e145b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.816894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.817946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3135/6241] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:02.822830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.853815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3107/6242] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:02 2022] PUT /identity/v3/projects/979571e7136e49898d076e6a8dc98b37/users/2abb393924294ba9b52f2332c2e145b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:02.855064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:02.862595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0850-7ee8-424e-8469-f3167cea0bd0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.961364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.962416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.962712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.962995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] PATH_INFO: `/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1/users/eea13ecf15d94a76a56ff0cc5cd31c1b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.983202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11b2dbb5c9d48e3a516a60dd60d6ad1, user_id=eea13ecf15d94a76a56ff0cc5cd31c1b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.986212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23107ee6-bbdb-448a-b94a-ed1b25b2ce79 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:02.986839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:02.993617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:02.994325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:02.994629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:02.994888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:02.995665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:02.997326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.016435 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3136/6243] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:02 2022] PUT /identity/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1/users/eea13ecf15d94a76a56ff0cc5cd31c1b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:03.023665 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3108/6244] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:03.024760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.025190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.048331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489df61-fd4c-4ce9-8f5c-60eb48e023c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.122606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:03.135540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8a107-374e-410c-be22-a809707c3314 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.141886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.142574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.142862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.143151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.144468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.146141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.159551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3137/6245] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:03.163976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.168329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.169431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.169810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.170011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] PATH_INFO: `/v3/projects/979571e7136e49898d076e6a8dc98b37/users/2abb393924294ba9b52f2332c2e145b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.172391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=979571e7136e49898d076e6a8dc98b37, user_id=2abb393924294ba9b52f2332c2e145b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.175301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668ee9b-a42d-45da-8279-f597f1d237ed admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.179402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98e01-538c-4eb6-b8b6-7c40edfa590e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.185042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.186869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.187800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.188326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] PATH_INFO: `/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1/users/eea13ecf15d94a76a56ff0cc5cd31c1b/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.190687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11b2dbb5c9d48e3a516a60dd60d6ad1, user_id=eea13ecf15d94a76a56ff0cc5cd31c1b, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.195646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47915-9ca3-4d7d-9071-cef11972425a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.203095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3109/6246] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:03 2022] PUT /identity/v3/projects/979571e7136e49898d076e6a8dc98b37/users/2abb393924294ba9b52f2332c2e145b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:03.204708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc569142-9334-4aed-aedc-3c778014715b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.205003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc569142-9334-4aed-aedc-3c778014715b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.205284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc569142-9334-4aed-aedc-3c778014715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.223213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3138/6247] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:03 2022] PUT /identity/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1/users/eea13ecf15d94a76a56ff0cc5cd31c1b/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:03.225856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.226382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.226907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.237297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bc569142-9334-4aed-aedc-3c778014715b None None] MFA Rules not processed for user `2abb393924294ba9b52f2332c2e145b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:03.238560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc569142-9334-4aed-aedc-3c778014715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:03.293747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] MFA Rules not processed for user `eea13ecf15d94a76a56ff0cc5cd31c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:03.295310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:03.388251 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3110/6248] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:03.392723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc569142-9334-4aed-aedc-3c778014715b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.406267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc569142-9334-4aed-aedc-3c778014715b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.413507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2abb393924294ba9b52f2332c2e145b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979571e7136e49898d076e6a8dc98b37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.414277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.414567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.414855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.415645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.417753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.430128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:03.486264 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3139/6249] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:03.498732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.501788 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3111/6250] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:03 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:03.505431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:03.510276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.629639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a040a-fe2d-480f-b658-cc58039c2fab tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.642366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2af25a3801843c0a30f0d68dcc2a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3e9bf162b68485fa63f583ca2c89f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.644780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.645098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.645380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] PATH_INFO: `/v3/projects/8910e4c421b249ebbe53699c910e4ab3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.646952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] RBAC: Authorizing `identity:delete_project(project_id=8910e4c421b249ebbe53699c910e4ab3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.648437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfff27-b7d5-483b-b19c-c51df5722770 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jun 04 21:13:03.686349 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 04 21:13:03.687836 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:13:03.692023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3112/6251] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:03 2022] DELETE /identity/v3/projects/8910e4c421b249ebbe53699c910e4ab3 => generated 136 bytes in 186 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:13:03.693806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:03.776477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.778293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.779451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.781062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.810422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:03.856297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba71e6-e63f-4797-8fc7-858848466c6e tempest-ProjectsNegativeTestJSON-1554772270 tempest-ProjectsNegativeTestJSON-1554772270-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:03.866357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2abb393924294ba9b52f2332c2e145b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979571e7136e49898d076e6a8dc98b37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:03.867974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:03.868187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:03.868615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] PATH_INFO: `/v3/projects/8910e4c421b249ebbe53699c910e4ab3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:03.869873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8910e4c421b249ebbe53699c910e4ab3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.874391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.930864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:03.935718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:03.961456 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3140/6252] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:04.006088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8910e4c421b249ebbe53699c910e4ab3', 'request_id': 'req-7d2656ed-e094-4e14-b636-43ce8fd5d277'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.012993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8910e4c421b249ebbe53699c910e4ab3', 'request_id': 'req-7d2656ed-e094-4e14-b636-43ce8fd5d277'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.020223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8910e4c421b249ebbe53699c910e4ab3', 'request_id': 'req-7d2656ed-e094-4e14-b636-43ce8fd5d277'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.053478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] The token cache is being invalidate because project 8910e4c421b249ebbe53699c910e4ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:04.053810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.056361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.060655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3113/6253] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:03 2022] DELETE /identity/v3/projects/8910e4c421b249ebbe53699c910e4ab3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:04.068237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:04.074822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:04.083848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:04.227545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:04.302068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425180a-54ca-43f1-bc06-d193f6db4a6f service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:04.321169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2656ed-e094-4e14-b636-43ce8fd5d277 tempest-ProjectsNegativeTestJSON-1346737978 tempest-ProjectsNegativeTestJSON-1346737978-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:04.332426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:04.333301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:04.333576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:04.333851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:04.338524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:04.433511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:04.438499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:04.438753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:04.439040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] PATH_INFO: `/v3/users/a2af25a3801843c0a30f0d68dcc2a9dd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:04.443109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2af25a3801843c0a30f0d68dcc2a9dd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:04.452824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:04.525098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:04.526998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399f409-a3f5-4966-a3d4-daa97bb43f71 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:04.579439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2af25a3801843c0a30f0d68dcc2a9dd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.580097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3114/6254] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:04.595385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2af25a3801843c0a30f0d68dcc2a9dd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.596640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2af25a3801843c0a30f0d68dcc2a9dd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.603315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2af25a3801843c0a30f0d68dcc2a9dd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.629448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2af25a3801843c0a30f0d68dcc2a9dd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:04.659791 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3141/6255] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:04 2022] DELETE /identity/v3/users/a2af25a3801843c0a30f0d68dcc2a9dd => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:04.665017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:04.668614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:04.668614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:04.720335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:04.721653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:04.778100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:04.946679 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3115/6256] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:04.957066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:04.961466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:05.122719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b25013-ff98-4df9-9799-7bc4725ded10 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:05.127048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:05.127747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:05.128033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:05.128312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:05.153570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:05.155349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:05.176192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3142/6257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:06.484151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:06.485741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:06.505492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3cfef-db36-40ef-b133-7b9450410caf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:06.520620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:06.522462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:06.523243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:06.523610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] PATH_INFO: `/v3/projects/a3e9bf162b68485fa63f583ca2c89f2e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:06.541457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e9bf162b68485fa63f583ca2c89f2e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:06.544258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:06.628717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e9bf162b68485fa63f583ca2c89f2e', 'request_id': 'req-7dced2a2-58b1-4175-846c-bfd4e2be0862'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:06.638709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e9bf162b68485fa63f583ca2c89f2e', 'request_id': 'req-7dced2a2-58b1-4175-846c-bfd4e2be0862'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:06.652496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e9bf162b68485fa63f583ca2c89f2e', 'request_id': 'req-7dced2a2-58b1-4175-846c-bfd4e2be0862'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:06.674097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] The token cache is being invalidate because project a3e9bf162b68485fa63f583ca2c89f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:06.674435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:06.675088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:06.681232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3116/6258] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:06 2022] DELETE /identity/v3/projects/a3e9bf162b68485fa63f583ca2c89f2e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:06.688818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:06.728380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafaaeb-1120-4d01-89d9-2d4cab6a6ebc service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:06.755565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:06.913949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:06.914911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:06.915248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:06.915559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] PATH_INFO: `/v3/users/2abb393924294ba9b52f2332c2e145b9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:06.922567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abb393924294ba9b52f2332c2e145b9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:06.924647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:07.038588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abb393924294ba9b52f2332c2e145b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:07.048288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abb393924294ba9b52f2332c2e145b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:07.050123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abb393924294ba9b52f2332c2e145b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:07.050968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abb393924294ba9b52f2332c2e145b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:07.069285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92f96df1-9333-41db-aaed-697401147ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abb393924294ba9b52f2332c2e145b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:07.106514 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3143/6259] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:06 2022] DELETE /identity/v3/users/2abb393924294ba9b52f2332c2e145b9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:07.877061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:07.879564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:07.897265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dced2a2-58b1-4175-846c-bfd4e2be0862 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:07.981963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:07.982890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:07.983172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:07.983448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] PATH_INFO: `/v3/projects/979571e7136e49898d076e6a8dc98b37` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:07.985348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=979571e7136e49898d076e6a8dc98b37)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:07.987656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.049508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:08.052068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979571e7136e49898d076e6a8dc98b37', 'request_id': 'req-9c4de99e-4481-402d-abd8-9a2ff7604e1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:08.062545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979571e7136e49898d076e6a8dc98b37', 'request_id': 'req-9c4de99e-4481-402d-abd8-9a2ff7604e1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:08.069145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979571e7136e49898d076e6a8dc98b37', 'request_id': 'req-9c4de99e-4481-402d-abd8-9a2ff7604e1c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:08.086853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] The token cache is being invalidate because project 979571e7136e49898d076e6a8dc98b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:08.087057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:08.087767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c4de99e-4481-402d-abd8-9a2ff7604e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:08.089624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3117/6260] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:07 2022] DELETE /identity/v3/projects/979571e7136e49898d076e6a8dc98b37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:08.098122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.098726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.099123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.146271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:08.159635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:08.258721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3144/6261] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:08.267756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880709f-ddfe-470a-885a-3f1eeb49202e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.268146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880709f-ddfe-470a-885a-3f1eeb49202e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.268497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880709f-ddfe-470a-885a-3f1eeb49202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.301371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5880709f-ddfe-470a-885a-3f1eeb49202e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:08.303804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5880709f-ddfe-470a-885a-3f1eeb49202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:08.335453 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3118/6262] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:08.340378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.357397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047c02-4bd0-40ad-95d9-3977199d144b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.370746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.371776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.374329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.374678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.376143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:08.376928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:08.384910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.398512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.399251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.399631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.422339 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3145/6263] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:08.427365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.441007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197404-ec79-47f1-b3dd-c371f7d3b399 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.449191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.449874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.450163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.450443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.451146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:08.453465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:08.453620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.454855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:08.458618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:08.498004 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3146/6264] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/projects => generated 395 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:08.502022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.614420 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3119/6265] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:08.620935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.623787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:08.651980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c95fe5-979b-4f30-a344-65ba11145aa5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.659011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.660606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.661082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.661367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.662111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:08.664368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.706906 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3147/6266] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/users => generated 304 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:08.712072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.726179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5e24-790b-409d-9b97-04ea81a292e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.752098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.753689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.754242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.754388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.755260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:08.762676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.764786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0ce2c-a208-452b-a203-ebfe1404a3dc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.787402 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3148/6267] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:08.788348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:08.819042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe77c-1640-4358-9929-3397ea7da0c6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:08.837366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.841340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.841777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.843184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] PATH_INFO: `/v3/projects/6a109de609c04d8cbaacb65f33390eb7/users/79d4e9ad741144cd8b46aef4594e7693/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.872557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:08.899163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a109de609c04d8cbaacb65f33390eb7, user_id=79d4e9ad741144cd8b46aef4594e7693, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:08.902999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b440c-3bc9-4d7f-be7e-1a51d7c02f1c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:08.907116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f073-1624-497b-a35b-027168355d7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:08.908845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f073-1624-497b-a35b-027168355d7d service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.908845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f073-1624-497b-a35b-027168355d7d service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.908845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90f073-1624-497b-a35b-027168355d7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.932248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3149/6268] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:08 2022] PUT /identity/v3/projects/6a109de609c04d8cbaacb65f33390eb7/users/79d4e9ad741144cd8b46aef4594e7693/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:08.935687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:08.936152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:08.937350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:08.971769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:08.974678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:09.028582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f073-1624-497b-a35b-027168355d7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.030910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90f073-1624-497b-a35b-027168355d7d service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.045994 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3120/6269] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:13:09.065204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f073-1624-497b-a35b-027168355d7d service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.077623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90f073-1624-497b-a35b-027168355d7d service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.141839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3150/6270] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:09.198391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.199086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.199441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.199754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.200507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.202305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3c24-8476-4045-9e2b-3c70056f8678 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.217053 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3121/6271] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:09.221387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.240004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127821f5-096b-4d9f-9a1c-2098ef1a2cb9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.244925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.245840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.246125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.246403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] PATH_INFO: `/v3/projects/6a109de609c04d8cbaacb65f33390eb7/users/79d4e9ad741144cd8b46aef4594e7693/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.248785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a109de609c04d8cbaacb65f33390eb7, user_id=79d4e9ad741144cd8b46aef4594e7693, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.251656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.276505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3151/6272] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:09 2022] PUT /identity/v3/projects/6a109de609c04d8cbaacb65f33390eb7/users/79d4e9ad741144cd8b46aef4594e7693/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:09.278386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.278762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.279047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.320513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] MFA Rules not processed for user `79d4e9ad741144cd8b46aef4594e7693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:09.321981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:09.472261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3122/6273] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:09.490077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.537484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:09.591412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ee874-5177-47ad-82eb-b50b8866fd09 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.622680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.623793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.624533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.625006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.627168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.630577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.712344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3152/6274] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:09 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:09.717364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.734968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27317cc5-385d-4a7e-8a42-588faa84cb85 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.790256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:09.807341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.813454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:09.862099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.862765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.865697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.865987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.866717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.877845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.920291 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3123/6275] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:09 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:09.922665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:09.941516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314129c-27ce-40cc-83fd-c9a4f45e47a5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.946049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8f2b-7a71-444d-8a34-4423dc6c1370 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:09.953560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.954748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.955083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.955364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] PATH_INFO: `/v3/users/6aac9857ea644526845c71b5ff77e327` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.957256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aac9857ea644526845c71b5ff77e327)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.959941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:09.960203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:09.960914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:09.961199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:09.961477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:09.966813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:09.977902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:10.003489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3124/6276] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:10.007974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:10.024796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04011a66-1b6d-47ad-97aa-8a86fb85d01b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:10.039540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:10.040422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.042257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.043600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.044581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aac9857ea644526845c71b5ff77e327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:10.044737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:10.049044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:10.052629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aac9857ea644526845c71b5ff77e327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:10.053374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aac9857ea644526845c71b5ff77e327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:10.054686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aac9857ea644526845c71b5ff77e327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:10.067238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3125/6277] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:10.069597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8a3bac89-d57a-4f3f-9462-151fed975aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aac9857ea644526845c71b5ff77e327'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:10.070689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:10.073370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.099148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d7a4-95ed-4ca0-b9f4-2a18fac9698e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:10.102891 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3153/6278] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:09 2022] DELETE /identity/v3/users/6aac9857ea644526845c71b5ff77e327 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:10.105370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:10.106367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.106716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.107104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] PATH_INFO: `/v3/projects/8a6d8a47a056483684135e79abcbeeed/users/665e22b683f84e07b32b384f651e335f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.110043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.110781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.111249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.128530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6d8a47a056483684135e79abcbeeed, user_id=665e22b683f84e07b32b384f651e335f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:10.132684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaffb4-846e-4dce-a948-871985801c98 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:10.142920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:10.145788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.171289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3126/6279] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:10 2022] PUT /identity/v3/projects/8a6d8a47a056483684135e79abcbeeed/users/665e22b683f84e07b32b384f651e335f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:10.180773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.181372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.181657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.193852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:10.243351 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3154/6280] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:10.253019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:10.254478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.255390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] MFA Rules not processed for user `665e22b683f84e07b32b384f651e335f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:10.256937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.343328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96be3e-a8c1-4d9b-819e-16a9e415acfc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:10.348791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:10.355871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.356076 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3127/6281] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:10.356168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.356168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.366508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:10.366508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cb599-44ae-4f00-8a2d-36efd6cf5a4c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:10.376348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:10.380070 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3155/6282] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:10.392923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.577516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf665f4-f693-48c4-82a0-d878aca73234 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:10.606684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:10.607763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:10.608048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:10.608321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:10.618361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:10.653181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:10.772428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:10.775979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:10.791766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3128/6283] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:11.164432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.166310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.166766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.186809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:11.189882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.200493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:11.201772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.272244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748760f8-a835-4f95-9a35-421a54c07108 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:11.293692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:11.294798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.295292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.295732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] PATH_INFO: `/v3/projects/e6c3f759fbde4b209d7d15ae2d262603` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.297788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c3f759fbde4b209d7d15ae2d262603)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:11.300474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:11.320888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3156/6284] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:11.357417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:11.359237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.434900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c3f759fbde4b209d7d15ae2d262603', 'request_id': 'req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.442876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c3f759fbde4b209d7d15ae2d262603', 'request_id': 'req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.451713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c3f759fbde4b209d7d15ae2d262603', 'request_id': 'req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.474935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] The token cache is being invalidate because project e6c3f759fbde4b209d7d15ae2d262603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:11.475347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.476901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.478624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3129/6285] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:11 2022] DELETE /identity/v3/projects/e6c3f759fbde4b209d7d15ae2d262603 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:11.479191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:11.482768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477893ef-cd8f-4b56-ab4b-b671218e66da None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:11.484138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.536430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:11.586109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:11.586362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee9ae7-67f7-4bdb-84b4-88de93f7e1ea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:11.587244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.587816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.588245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.590600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.593585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:11.594899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.595356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.595848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] PATH_INFO: `/v3/users/79d4e9ad741144cd8b46aef4594e7693` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.597406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d4e9ad741144cd8b46aef4594e7693)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:11.599796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:11.658660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:11.676947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d4e9ad741144cd8b46aef4594e7693'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.677619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d4e9ad741144cd8b46aef4594e7693'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.686486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:11.688178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d4e9ad741144cd8b46aef4594e7693'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.688610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:11.689156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d4e9ad741144cd8b46aef4594e7693'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.700427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3157/6286] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:13:11.701549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:11.705077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.706445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d4e9ad741144cd8b46aef4594e7693'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:11.735610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3130/6287] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:11 2022] DELETE /identity/v3/users/79d4e9ad741144cd8b46aef4594e7693 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:11.736500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:11.737994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.825686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ca00-9545-4726-a18d-bcc685903438 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:11.897257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:11.897772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.898120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.898449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.900527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:11.937832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:11.937832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ff19b-1641-4c4a-876b-8359a12f2ed2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:11.960239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3158/6288] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:11.961806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.964128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3d0a-0011-4c69-8d37-119c46be893f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:11.964810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.965225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:11.990554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:11.992884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:11.996219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:11.996561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] PATH_INFO: `/v3/users/eea13ecf15d94a76a56ff0cc5cd31c1b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:12.003342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea13ecf15d94a76a56ff0cc5cd31c1b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:12.005754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:12.014448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:12.016844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:12.052621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3159/6289] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:12.104947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:12.107633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:12.134742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9a861-5188-4d4c-9aca-a778ad9fc953 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:12.135474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea13ecf15d94a76a56ff0cc5cd31c1b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:12.136691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea13ecf15d94a76a56ff0cc5cd31c1b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:12.148192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:12.149699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:12.149996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:12.150456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:12.156612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:12.159077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea13ecf15d94a76a56ff0cc5cd31c1b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:12.163051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea13ecf15d94a76a56ff0cc5cd31c1b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:12.181763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-587c0fc2-539f-4e11-80be-5950467aaffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea13ecf15d94a76a56ff0cc5cd31c1b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:12.194642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:12.196113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:12.206836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3131/6290] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:11 2022] DELETE /identity/v3/users/eea13ecf15d94a76a56ff0cc5cd31c1b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:12.234077 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3160/6291] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:12.342095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:12.342741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:12.343714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:12.372002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:12.373540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:12.418448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:12.479743 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3132/6292] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:12.494805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:12.496361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:12.509058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:12.640794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848347a-2381-468e-92ea-48ce639a4f00 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:12.729800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:12.730473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:12.730761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:12.731042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:12.741038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:12.742665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:12.752460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3161/6293] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:13:13.195025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:13.196517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:13.305047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56988c-57e1-4c7f-92c5-b140c9906766 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:13.309756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:13.310737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:13.311089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:13.311437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] PATH_INFO: `/v3/projects/6a109de609c04d8cbaacb65f33390eb7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:13.312772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a109de609c04d8cbaacb65f33390eb7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:13.315036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:13.378107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a109de609c04d8cbaacb65f33390eb7', 'request_id': 'req-668fc2f9-8ae8-4e79-992c-2749f15d0f83'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.385359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a109de609c04d8cbaacb65f33390eb7', 'request_id': 'req-668fc2f9-8ae8-4e79-992c-2749f15d0f83'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.391959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a109de609c04d8cbaacb65f33390eb7', 'request_id': 'req-668fc2f9-8ae8-4e79-992c-2749f15d0f83'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.407967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] The token cache is being invalidate because project 6a109de609c04d8cbaacb65f33390eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:13.408174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.408842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.411364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3133/6294] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:13 2022] DELETE /identity/v3/projects/6a109de609c04d8cbaacb65f33390eb7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:13.415713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:13.427806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dec7f-937d-4f3d-b92d-858de36289ec service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:13.493931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:13.494860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:13.495145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:13.495428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] PATH_INFO: `/v3/users/665e22b683f84e07b32b384f651e335f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:13.496806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665e22b683f84e07b32b384f651e335f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:13.498789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:13.550257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:13.553498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665e22b683f84e07b32b384f651e335f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.562941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665e22b683f84e07b32b384f651e335f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.563738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665e22b683f84e07b32b384f651e335f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.564353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665e22b683f84e07b32b384f651e335f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.577758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665e22b683f84e07b32b384f651e335f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:13.593163 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3162/6295] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:13 2022] DELETE /identity/v3/users/665e22b683f84e07b32b384f651e335f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:13.805876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:13.807778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:13.829925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc2f9-8ae8-4e79-992c-2749f15d0f83 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:13.918853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:13.920855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:13.930971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:13.932610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:13.932910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:13.933192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] PATH_INFO: `/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:13.934548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11b2dbb5c9d48e3a516a60dd60d6ad1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:13.938915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:13.947837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:14.007731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11b2dbb5c9d48e3a516a60dd60d6ad1', 'request_id': 'req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.014752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11b2dbb5c9d48e3a516a60dd60d6ad1', 'request_id': 'req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.017550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b868f-e763-4a4d-8725-7984aa51b1c9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.021909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11b2dbb5c9d48e3a516a60dd60d6ad1', 'request_id': 'req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.046272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] The token cache is being invalidate because project f11b2dbb5c9d48e3a516a60dd60d6ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:14.046386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.047113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d10033-1f03-4af6-a5f6-ecfddb6b4543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.053861 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3134/6296] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:13 2022] DELETE /identity/v3/projects/f11b2dbb5c9d48e3a516a60dd60d6ad1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:14.073015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f319d-fd66-4ede-9078-f340fd55e56a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.075763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f319d-fd66-4ede-9078-f340fd55e56a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.076279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f319d-fd66-4ede-9078-f340fd55e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.131551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fd9f319d-fd66-4ede-9078-f340fd55e56a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:14.133189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd9f319d-fd66-4ede-9078-f340fd55e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:14.167824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.168725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.169011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.169300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] PATH_INFO: `/v3/projects/8a6d8a47a056483684135e79abcbeeed` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.177618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6d8a47a056483684135e79abcbeeed)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.182784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.281250 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3135/6297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:14.289319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.291806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.292259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.304572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6d8a47a056483684135e79abcbeeed', 'request_id': 'req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.311962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6d8a47a056483684135e79abcbeeed', 'request_id': 'req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.323914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:14.324513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6d8a47a056483684135e79abcbeeed', 'request_id': 'req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.326471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:14.337261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:14.343693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] The token cache is being invalidate because project 8a6d8a47a056483684135e79abcbeeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:14.344423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.345411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71c3d5e3-29f9-4fc0-a5c5-1caf9f330825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:14.347794 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3163/6298] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:13 2022] DELETE /identity/v3/projects/8a6d8a47a056483684135e79abcbeeed => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:14.354942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50a7a-3d63-4e56-bfc0-80e79e1b668b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.355839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50a7a-3d63-4e56-bfc0-80e79e1b668b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.356729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e50a7a-3d63-4e56-bfc0-80e79e1b668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.399789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-17e50a7a-3d63-4e56-bfc0-80e79e1b668b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:14.403026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-17e50a7a-3d63-4e56-bfc0-80e79e1b668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:14.471423 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3136/6299] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:14.475827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.493721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcca2db-dda5-45a4-b81e-ca1551055e5b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.510634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.511449 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3164/6300] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:14.517564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.517955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.518139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.518918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:14.519760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.520226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.520718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.520996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.526043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.559074 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3137/6301] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:14.567000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.573554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:14.575422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:14.580906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145f58-a6c5-4b2f-b149-0858c91ae740 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.585999 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3165/6302] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:14.591374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.592026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.592715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.593001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.593281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.594191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.596164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.603238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a0861-75c1-430e-a4b2-8e4e659142b4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.611613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.612846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.612846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.613363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.614243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:14.614744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.617042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.632401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:14.632669 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3166/6303] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:14.636799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.647164 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3138/6304] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/projects => generated 409 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:14.651599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.660405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5c978-a64f-4816-9841-4733d3148465 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.774464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef065a-988c-42e3-8b3b-77e3a1dbd5e8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.783188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.784945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.785381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.786444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.787348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.790035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.790720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.791005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.791281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.792661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.796381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.796751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:14.861707 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3139/6305] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/users => generated 305 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:14.864092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.880052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3167/6306] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/projects => generated 399 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:14.881385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:14.899085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab77e-ccfa-41a8-a253-676953b83076 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.990861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:14.992299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:14.992593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:14.992872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:14.993571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b614-ec5c-4519-b15a-c6cb8e6fb476 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:14.993689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:14.995336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.000290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.001488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.001983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.002445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.003500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.007364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.016552 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3140/6307] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.021423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.024893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.032578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcc99b-65b7-41d3-998f-4d5ca98bd0de admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.038437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.040071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.040444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.040701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.041690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.044230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.057099 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3168/6308] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:14 2022] POST /identity/v3/users => generated 306 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:15.061052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.064286 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3141/6309] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.069687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.082100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46e218-cdf8-4e10-9ddc-962c966995da admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.087592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.088597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.088691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7363b4-2ffe-42aa-bdc6-09479bc7bb73 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.088803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.089121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] PATH_INFO: `/v3/projects/e4308ccec58d4b9cb14c106d7ceb5c46/users/9d0faa838a4e4aa9bc003ece07247ad4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.101609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.102419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.102883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.103312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.104414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.107618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.112476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4308ccec58d4b9cb14c106d7ceb5c46, user_id=9d0faa838a4e4aa9bc003ece07247ad4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.115872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dd7a8-7e6b-494d-b48a-decb762ca9d4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.138794 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3169/6310] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.140425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.149384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3142/6311] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:15 2022] PUT /identity/v3/projects/e4308ccec58d4b9cb14c106d7ceb5c46/users/9d0faa838a4e4aa9bc003ece07247ad4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:15.151673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.152473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.152473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.160638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ce9a-5ee1-457d-b9ab-c44dfd04ca95 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.222952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] MFA Rules not processed for user `9d0faa838a4e4aa9bc003ece07247ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:15.224315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:15.293247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.306968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.308378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.308914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.309369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] PATH_INFO: `/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2/users/6ad99c620bac4b66a5ff83a3850ce2b4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.353033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a526423be8b41ad8d37e43b8aa9feb2, user_id=6ad99c620bac4b66a5ff83a3850ce2b4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.358469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3143/6312] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:15.359902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.364373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.382928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6f79-e460-4b82-826c-98d8946b9d50 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.390201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.391120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.391430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.391771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.392455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.395265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.401493 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3170/6313] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:15 2022] PUT /identity/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2/users/6ad99c620bac4b66a5ff83a3850ce2b4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:15.407745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.434111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3144/6314] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:15 2022] POST /identity/v3/projects => generated 409 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:15.434945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.496005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fc83-1b5e-4f3a-b16c-2c7ff9cb7853 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.520216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d80211-1d9b-4b87-a41f-379fddf62a29 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.536033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.536992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.537464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.538171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.539056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.543569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.575787 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3145/6315] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:15 2022] POST /identity/v3/users => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:15.581541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.591848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.592659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.593117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.593292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.594140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.598042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.606455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4b4f-dcfb-4e07-924b-4e45ca7df3b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.611000 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3171/6316] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.613236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.614751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.615389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.615555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.616721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.617684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.619971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.627338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb82cdb-7142-425f-a5d7-a6f1521d1ec3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.634419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.635344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.635672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.635947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] PATH_INFO: `/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2/users/6ad99c620bac4b66a5ff83a3850ce2b4/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.638649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a526423be8b41ad8d37e43b8aa9feb2, user_id=6ad99c620bac4b66a5ff83a3850ce2b4, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.642406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55361-72af-4172-8a58-85fa7a3ec3b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.643146 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3146/6317] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.645594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.652923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.660899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cca27e-6aad-4a1c-9801-29babfa1748d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.665046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3172/6318] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:15 2022] PUT /identity/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2/users/6ad99c620bac4b66a5ff83a3850ce2b4/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:15.677522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.678135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.678360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.732505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] MFA Rules not processed for user `6ad99c620bac4b66a5ff83a3850ce2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:15.734134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:15.786591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.789278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.789567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.789847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] PATH_INFO: `/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f/users/6b8e4ad3fa4541e081569ae4abc9263d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.810029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb43b83ffcca40078a83384b3c7bfa5f, user_id=6b8e4ad3fa4541e081569ae4abc9263d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.814293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.834117 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3147/6319] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:15 2022] PUT /identity/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f/users/6b8e4ad3fa4541e081569ae4abc9263d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:15.839993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.852616 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3173/6320] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:15.854164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.863371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.870508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a69872-e5c1-4fe7-80ed-b8b643de3feb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.953652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1c2e-1832-44fc-8725-39abcab0d194 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:15.960788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.961638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.962164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.962537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.963366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.965116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.976851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:15.977965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:15.978325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3148/6321] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:15.978752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:15.979037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:15.980428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:15.982935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:15.987169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:15.999766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae3b9-3c61-4f7c-a949-6bb189742351 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.006509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.008642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.009267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.010050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] PATH_INFO: `/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f/users/6b8e4ad3fa4541e081569ae4abc9263d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.013329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb43b83ffcca40078a83384b3c7bfa5f, user_id=6b8e4ad3fa4541e081569ae4abc9263d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.016571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f381a7-cb36-4b4e-95d5-9b586c3ec71c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.039586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3149/6322] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:15 2022] PUT /identity/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f/users/6b8e4ad3fa4541e081569ae4abc9263d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:16.045776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.046072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.046557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.048965 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3174/6323] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:15 2022] POST /identity/v3/projects => generated 397 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:16.052200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.095033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] MFA Rules not processed for user `6b8e4ad3fa4541e081569ae4abc9263d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:16.096776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.139978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a323-e221-47b3-8645-be97dd956d02 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.147103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.150630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.151109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.151709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.155791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.164395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.182825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:16.210289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3175/6324] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:16 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:16.214137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.233288 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3150/6325] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:16.243476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5d499-392b-4f03-94a3-669dc161834f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.243476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.243889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.244182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.244466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.245267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.246915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.253229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.255196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.264706 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3176/6326] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:16.268766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.283558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350efc-6b2e-449f-999c-2e0151f9aaca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.291890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.292705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.293068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.293687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.294954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.297586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.314506 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3177/6327] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:16.318614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.331971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e734a4-74ba-4d51-a516-98709bc91515 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.341963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.343074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.343435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.344264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] PATH_INFO: `/v3/projects/41b541a190c149bab05fa5ca59bff71f/users/76ad2fc5524d41e1a6151430b9bf2753/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.365131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b541a190c149bab05fa5ca59bff71f, user_id=76ad2fc5524d41e1a6151430b9bf2753, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.367994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.368621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc5be5-59eb-477d-aacf-82ddd2247e8e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.375667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.376623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.377161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.377271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.385930 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3178/6328] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:16 2022] PUT /identity/v3/projects/41b541a190c149bab05fa5ca59bff71f/users/76ad2fc5524d41e1a6151430b9bf2753/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:16.386923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.397143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.397979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.399556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974862c9-f3b6-4aa8-be5e-c9f7c32b9c9c service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.411661 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3151/6329] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:16.413058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.413357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.413646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.464253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] MFA Rules not processed for user `76ad2fc5524d41e1a6151430b9bf2753`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:16.465842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.511825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:16.514120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673824de-5432-4c13-abd1-00e7329ec48c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.520401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.521307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.532796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.533143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] PATH_INFO: `/v3/users/99094a55fffa4edc8377630f3229cc02` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.534580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99094a55fffa4edc8377630f3229cc02)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.540410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.567416 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3152/6330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:16.591420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.593059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.643287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99094a55fffa4edc8377630f3229cc02'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:16.656809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99094a55fffa4edc8377630f3229cc02'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:16.657777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99094a55fffa4edc8377630f3229cc02'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:16.658385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99094a55fffa4edc8377630f3229cc02'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:16.691095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99094a55fffa4edc8377630f3229cc02'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:16.701993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28e0e6-9285-4c49-bf4b-5a0629924ec2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.708646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.709357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.709716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.710474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.712997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.720046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3179/6331] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:16 2022] DELETE /identity/v3/users/99094a55fffa4edc8377630f3229cc02 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:16.720046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.720046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.759860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:16.793531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf4f8-59d6-4a88-847e-5f53e9b07719 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:16.796685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.797705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:16.798354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f6756-c037-4963-a6c1-f31a4d7ad111 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.798479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.798632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.798912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.801772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.823574 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3153/6332] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:16.825354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:16.825654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:16.826333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:16.852287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:16.853952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:16.967422 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3154/6333] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:16.979544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:16.981990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:16.986759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:16.989227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:17.007875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:17.016608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3180/6334] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:17.079966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee1863-20b6-40ac-8136-529c0480d61a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:17.086185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:17.087329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.087831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.088300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:17.107532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:17.109337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c437a-8879-42b8-8e2f-06238f8d1bcf service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:17.133391 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3155/6335] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:17.409546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:17.412711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:17.443244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301cca-3014-46b2-a78f-cd9c68890d97 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:17.472589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:17.474796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.474796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.475020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] PATH_INFO: `/v3/users/6ad99c620bac4b66a5ff83a3850ce2b4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:17.477942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad99c620bac4b66a5ff83a3850ce2b4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:17.481981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:17.583281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad99c620bac4b66a5ff83a3850ce2b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.593104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad99c620bac4b66a5ff83a3850ce2b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.594380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad99c620bac4b66a5ff83a3850ce2b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.595019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad99c620bac4b66a5ff83a3850ce2b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.612736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad99c620bac4b66a5ff83a3850ce2b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.635470 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3181/6336] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:17 2022] DELETE /identity/v3/users/6ad99c620bac4b66a5ff83a3850ce2b4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:17.637397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.637853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.638056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:17.676787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:17.679331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:17.775502 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3156/6337] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:17.790809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:17.794610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:17.836173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:17.838427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:17.869222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53497d7f-2507-4441-9c90-edfcbe1e7d79 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:17.875718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:17.882626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.882915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.883198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] PATH_INFO: `/v3/projects/5351e3b9509e462b8e004a6cd6e138be` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:17.885920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5351e3b9509e462b8e004a6cd6e138be)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:17.887790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:17.929556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4caf1f-3222-40ab-b6e6-225e97804293 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:17.936396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:17.937580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.938220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.938683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:17.950882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5351e3b9509e462b8e004a6cd6e138be', 'request_id': 'req-98342f07-0c27-4669-9ab8-e19ec44acd79'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.951372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:17.953314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174d38-f484-4cb5-bc3b-b8fc0a1658fa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:17.957369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:17.958426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5351e3b9509e462b8e004a6cd6e138be', 'request_id': 'req-98342f07-0c27-4669-9ab8-e19ec44acd79'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.966405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5351e3b9509e462b8e004a6cd6e138be', 'request_id': 'req-98342f07-0c27-4669-9ab8-e19ec44acd79'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.971633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3182/6338] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:17.983196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] The token cache is being invalidate because project 5351e3b9509e462b8e004a6cd6e138be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:17.983640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.984701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-98342f07-0c27-4669-9ab8-e19ec44acd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:17.987556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3157/6339] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:17 2022] DELETE /identity/v3/projects/5351e3b9509e462b8e004a6cd6e138be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:17.991659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:17.992028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:17.992381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.014373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:18.015713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.085656 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3183/6340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:18.093469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.093792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.094142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.113095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:18.114335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.125003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3158/6341] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:18.129384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.141129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1ce0d-a960-41de-bb2f-e7b4875b57ce None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.146988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.147834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.148117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.148392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.149133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:18.149439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.151305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.169983 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3184/6342] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:18.171660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.184670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ca5d2-4f76-4358-a303-132713859a5c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.190939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.191159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.192836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.192836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.192836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.194621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.229011 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3159/6343] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:18 2022] POST /identity/v3/projects => generated 359 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:18.233242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.244919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ee10a-9068-42ca-849a-7b5da6927c74 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.331622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.332523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.333762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.333762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.338653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.341025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.341155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.343935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.375808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df2270-4b15-46d5-bd2d-15fb21061fe4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.377884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3185/6344] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:18 2022] POST /identity/v3/users => generated 280 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:18.382116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.382880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.382990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.383257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.383881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] PATH_INFO: `/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.384839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a526423be8b41ad8d37e43b8aa9feb2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.386744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.389465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:18.394391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d388-d281-4858-bbdc-d34af7d60898 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.400515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.401217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.402723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.402723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.402723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.404261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.415400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3186/6345] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:18.419357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.431270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb39c7-6908-406e-93ac-94bf136a44b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.437819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.438542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.438968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.439129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.440010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.442084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.457569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a526423be8b41ad8d37e43b8aa9feb2', 'request_id': 'req-07f1042d-d3ce-4ca8-82a8-3423823ba592'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.463562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3187/6346] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:18.467360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a526423be8b41ad8d37e43b8aa9feb2', 'request_id': 'req-07f1042d-d3ce-4ca8-82a8-3423823ba592'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.467700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.473932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a526423be8b41ad8d37e43b8aa9feb2', 'request_id': 'req-07f1042d-d3ce-4ca8-82a8-3423823ba592'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.479617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f072-1a5d-4756-ba80-e4ab06969397 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.491149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] The token cache is being invalidate because project 7a526423be8b41ad8d37e43b8aa9feb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:18.491465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.492978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.494661 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3160/6347] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:18 2022] DELETE /identity/v3/projects/7a526423be8b41ad8d37e43b8aa9feb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:18.498530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.500108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.560836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:18.586576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.587760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.587984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.588367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] PATH_INFO: `/v3/projects/9cac001ab3b84f51a2501826c68648d2/users/fa3fa6f1e59044ddaa5329ba4091c72c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.604049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1042d-d3ce-4ca8-82a8-3423823ba592 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:18.613789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:18.615448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.616077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.616531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] PATH_INFO: `/v3/users/76ad2fc5524d41e1a6151430b9bf2753` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.618873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ad2fc5524d41e1a6151430b9bf2753)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.622066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.630343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cac001ab3b84f51a2501826c68648d2, user_id=fa3fa6f1e59044ddaa5329ba4091c72c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:18.635089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fea1f-43b6-444d-b362-68edebd40fa9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:18.669371 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3188/6348] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:18 2022] PUT /identity/v3/projects/9cac001ab3b84f51a2501826c68648d2/users/fa3fa6f1e59044ddaa5329ba4091c72c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:18.688932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:18.689216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:18.689495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:18.722816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] MFA Rules not processed for user `fa3fa6f1e59044ddaa5329ba4091c72c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:18.724547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.746020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ad2fc5524d41e1a6151430b9bf2753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.749590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ad2fc5524d41e1a6151430b9bf2753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.775145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ad2fc5524d41e1a6151430b9bf2753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.776057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ad2fc5524d41e1a6151430b9bf2753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.794700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ad2fc5524d41e1a6151430b9bf2753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:18.829748 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3161/6349] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:18 2022] DELETE /identity/v3/users/76ad2fc5524d41e1a6151430b9bf2753 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:18.858326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3189/6350] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:18.870752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:18.872481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:18.908745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:19.018063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748864f-ed6c-4205-bcec-5deb374bf325 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:19.023437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:19.024186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.024476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.024759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.160980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:19.162476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da61bb7-7fb0-4ac5-baf0-b5a0eb3cdce2 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:19.182976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3162/6351] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:19.244141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:19.246395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:19.351739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0017aa-0fec-4e8a-b85a-fb5de38ea22a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:19.421725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:19.422657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.422936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.423216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] PATH_INFO: `/v3/projects/41b541a190c149bab05fa5ca59bff71f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.424947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b541a190c149bab05fa5ca59bff71f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:19.427139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:19.444795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:19.501388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b541a190c149bab05fa5ca59bff71f', 'request_id': 'req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:19.511499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b541a190c149bab05fa5ca59bff71f', 'request_id': 'req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:19.522193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b541a190c149bab05fa5ca59bff71f', 'request_id': 'req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:19.542721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] The token cache is being invalidate because project 41b541a190c149bab05fa5ca59bff71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:19.543270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:19.544009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-932a6e7f-01bb-46c4-85a3-2d45dde5cb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:19.550811 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3190/6352] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:19 2022] DELETE /identity/v3/projects/41b541a190c149bab05fa5ca59bff71f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:19.553054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.553395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.553679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.574486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:19.575861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:19.667557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3163/6353] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:19.674641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.674923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.675206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.714382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:19.715742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:19.752876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3191/6354] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:19.757390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:19.780135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ced71f-5997-4223-b5e1-c3413b2149e1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:19.796614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:19.797524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.798017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.798505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.799756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:19.800209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:19.802739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:19.827228 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3164/6355] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:13:19.832183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:19.868303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54deb61-8515-4136-9aba-057a4b0af311 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:19.876396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:19.877485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.878451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.878451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.879893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:19.884367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f228db8-1b34-4cb1-9924-3c23e91b933e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:19.929600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3192/6356] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:19.933998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:19.945228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057073e-15d6-4b5f-9272-de3b29606063 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:19.972827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:19.973393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:19.973865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:19.991992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:19.993595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:20.003016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:20.017830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.018823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.020148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.020148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.021313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.023720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.056304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3165/6357] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:19 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:20.058357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.065234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3193/6358] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:13:20.077840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009a20-c946-488d-bcc7-25d612164399 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.083866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.084670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.084958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.085238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.086406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.087777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.105042 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3166/6359] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:20.106633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.120680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9808-7c9f-4ab1-abdb-37dbd3291517 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.126780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.127463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.127904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.128181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.128993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.130952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24709fe-e0db-4b22-bf05-0db1bcd37e67 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.145125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3194/6360] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:20.149373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.164507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8b46a-5d83-49d6-815d-4ddb8abbbd22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.189960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.190884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.193750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.193975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] PATH_INFO: `/v3/projects/7255de3fa4ca4b739e8c25db2875a572/users/4df5265798e049d58639e43a5b0edc3a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.247149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7255de3fa4ca4b739e8c25db2875a572, user_id=4df5265798e049d58639e43a5b0edc3a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.253186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.283951 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3167/6361] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:20 2022] PUT /identity/v3/projects/7255de3fa4ca4b739e8c25db2875a572/users/4df5265798e049d58639e43a5b0edc3a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:20.295259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.295613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.295894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.347378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] MFA Rules not processed for user `4df5265798e049d58639e43a5b0edc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:20.349233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:20.458976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:20.468792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3195/6362] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:20.473641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.560813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5f103-edb5-4f67-b953-89684980ba99 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.566105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.566745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.567042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.567328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.568041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.578744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.636094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3168/6363] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:20.639823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.655269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de833-2a02-4f48-8296-c1e848580e3d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.798893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.799851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.800363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.800749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.801568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.803789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.841052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3196/6364] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:20 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:20.842893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.858954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a39cf-cb0e-4a93-a3a9-a77cc98df73c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.868974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.869998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.871141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.871677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.872616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.875266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.891579 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3169/6365] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:20.896566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.910821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5ba83-b812-45c5-ac01-086abcacd9dc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.917704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.918465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.918975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.919445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:20.920326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:20.922235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2691a5-f940-40d0-a71f-009659db3be3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:20.940363 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3197/6366] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:20.942315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:20.959145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbcfd-d118-4a20-a442-d6c32a8dd88e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:20.971480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:20.972647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:20.974456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:20.975406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] PATH_INFO: `/v3/projects/49026842a2f84a45bfa9a2108dee8580/users/3a4505c5aaed4bc5a73c54d7d4099f88/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:21.009825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49026842a2f84a45bfa9a2108dee8580, user_id=3a4505c5aaed4bc5a73c54d7d4099f88, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:21.013002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:21.035550 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3170/6367] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:20 2022] PUT /identity/v3/projects/49026842a2f84a45bfa9a2108dee8580/users/3a4505c5aaed4bc5a73c54d7d4099f88/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:21.047168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:21.047697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:21.048212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:21.106227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] MFA Rules not processed for user `3a4505c5aaed4bc5a73c54d7d4099f88`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:21.109301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:21.227323 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3198/6368] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:21.240280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:21.242144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:21.263855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:21.267155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:21.371034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f005a43-5c19-4216-af0e-6fff80517f11 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:21.375961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:21.376865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:21.377307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:21.377776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:21.379375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b7715-77e9-447b-b784-fd67f6fbdaf5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:21.386299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:21.387313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:21.388254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:21.388717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] PATH_INFO: `/v3/users/b7385bf9cbff4b30b6f75566ee78d92a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:21.389912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:21.391816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7385bf9cbff4b30b6f75566ee78d92a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:21.394443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:21.407641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:21.456947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:21.458841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:21.478799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7385bf9cbff4b30b6f75566ee78d92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:21.484298 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3171/6369] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:21.488227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7385bf9cbff4b30b6f75566ee78d92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:21.489231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7385bf9cbff4b30b6f75566ee78d92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:21.489960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7385bf9cbff4b30b6f75566ee78d92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:21.521847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7385bf9cbff4b30b6f75566ee78d92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:21.547672 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3199/6370] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:21 2022] DELETE /identity/v3/users/b7385bf9cbff4b30b6f75566ee78d92a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:21.640024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:21.660375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ded47f-10bc-440e-8731-f251d851e342 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:21.766844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:21.773396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:21.773841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:21.779938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:21.785655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:21.888685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:21.891131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:21.927129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:21.929010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:21.950650 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3172/6371] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:22.085911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee224d-4ef8-4148-9eeb-18d6a3088ec2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:22.094194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:22.095250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.095681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.096067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] PATH_INFO: `/v3/projects/4fd1ca1698d14742981eb94fc11d64d8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.102990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd1ca1698d14742981eb94fc11d64d8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:22.110286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:22.177973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd1ca1698d14742981eb94fc11d64d8', 'request_id': 'req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.184814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd1ca1698d14742981eb94fc11d64d8', 'request_id': 'req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.197056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd1ca1698d14742981eb94fc11d64d8', 'request_id': 'req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.227417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] The token cache is being invalidate because project 4fd1ca1698d14742981eb94fc11d64d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:22.227834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.229170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.231756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3200/6372] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:21 2022] DELETE /identity/v3/projects/4fd1ca1698d14742981eb94fc11d64d8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:22.239066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:22.268043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb981216-4955-41e0-9eb5-0e07b70e9e3f service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:22.409533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:22.411746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.412252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.412689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] PATH_INFO: `/v3/users/7654c81064024179985cb210c3bd7b9d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.414279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7654c81064024179985cb210c3bd7b9d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:22.423792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:22.434990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:22.483062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:22.485793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:22.504840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900d73-ee1c-4939-bb3c-7d581c32d4b4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:22.510453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:22.511299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7654c81064024179985cb210c3bd7b9d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.511429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.511724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.512057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] PATH_INFO: `/v3/users/4df5265798e049d58639e43a5b0edc3a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.513030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7654c81064024179985cb210c3bd7b9d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.513267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df5265798e049d58639e43a5b0edc3a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:22.515388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:22.530363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:22.534813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7654c81064024179985cb210c3bd7b9d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.535876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7654c81064024179985cb210c3bd7b9d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.574886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9ec3f5fe-ed3d-44bd-ba04-7ba109ae4594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7654c81064024179985cb210c3bd7b9d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.591776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df5265798e049d58639e43a5b0edc3a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.601534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3173/6373] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:22 2022] DELETE /identity/v3/users/7654c81064024179985cb210c3bd7b9d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:22.609954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df5265798e049d58639e43a5b0edc3a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.610776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df5265798e049d58639e43a5b0edc3a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.611787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df5265798e049d58639e43a5b0edc3a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.632430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df5265798e049d58639e43a5b0edc3a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:22.671938 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3201/6374] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:22 2022] DELETE /identity/v3/users/4df5265798e049d58639e43a5b0edc3a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:22.676335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.677004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.677491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.702962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:22.704320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:22.794517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3174/6375] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:22.809373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:22.812715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:22.885307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:22.887427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:22.917099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4ea7b-8d6b-4293-b39b-2127d18b0fa7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:22.936249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:22.938473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.941353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5e57-043d-4c37-a7a7-09f086c64372 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:22.943739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.944013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] PATH_INFO: `/v3/projects/1a6e988944a545519706b148cf3b45a4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.946938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6e988944a545519706b148cf3b45a4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:22.948951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:22.951069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:22.951593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:22.952077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:22.953516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:22.986612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:22.988905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e07b1-d33d-4e05-ab0f-e19e512529a4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.022599 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3202/6376] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:23.079967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6e988944a545519706b148cf3b45a4', 'request_id': 'req-97de5b3b-8bba-4130-8eb7-0fbef7421d05'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.090993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6e988944a545519706b148cf3b45a4', 'request_id': 'req-97de5b3b-8bba-4130-8eb7-0fbef7421d05'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.105791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6e988944a545519706b148cf3b45a4', 'request_id': 'req-97de5b3b-8bba-4130-8eb7-0fbef7421d05'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.141525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] The token cache is being invalidate because project 1a6e988944a545519706b148cf3b45a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:23.142005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.142884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-97de5b3b-8bba-4130-8eb7-0fbef7421d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.146122 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3175/6377] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:22 2022] DELETE /identity/v3/projects/1a6e988944a545519706b148cf3b45a4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:23.151352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.152387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.152678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.175764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:23.177907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.292876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3203/6378] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:23.295550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.295832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.296173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.324216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:23.326860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.340752 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3176/6379] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:23.345770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.357984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fb29f-a2b5-4b0a-aeef-7671e2d2440e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.366330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.367033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.367321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.367634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.369201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:23.369553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.374010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.408576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.413521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:23.419818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1213-3e21-4638-8216-d9471be7ca01 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.420374 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3204/6380] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:23.428793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.430149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.430687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.431077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.432292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.435119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.447877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.449959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.465975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81936a4-f7de-4ae9-aa13-9609bf2849f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.473145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.474382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.474687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.474990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] PATH_INFO: `/v3/projects/7255de3fa4ca4b739e8c25db2875a572` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.476687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7255de3fa4ca4b739e8c25db2875a572)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.480040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.520390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:23.524332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3177/6381] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:23 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:23.525434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.589513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7255de3fa4ca4b739e8c25db2875a572', 'request_id': 'req-721724b9-671b-4af3-bf4b-7a1df5b916d1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.601437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7255de3fa4ca4b739e8c25db2875a572', 'request_id': 'req-721724b9-671b-4af3-bf4b-7a1df5b916d1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.608500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7255de3fa4ca4b739e8c25db2875a572', 'request_id': 'req-721724b9-671b-4af3-bf4b-7a1df5b916d1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.641215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] The token cache is being invalidate because project 7255de3fa4ca4b739e8c25db2875a572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:23.641571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.643052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.647327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3205/6382] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:23 2022] DELETE /identity/v3/projects/7255de3fa4ca4b739e8c25db2875a572 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:23.657869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.659423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.671648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161b56-bbf5-47d4-9462-9ca476347e3b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.779848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721724b9-671b-4af3-bf4b-7a1df5b916d1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.786158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.788129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.788428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.788749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] PATH_INFO: `/v3/users/3a4505c5aaed4bc5a73c54d7d4099f88` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.790146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4505c5aaed4bc5a73c54d7d4099f88)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.792357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.814723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.815751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.816084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.816366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.817067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.820341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.851922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3178/6383] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:23 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:23.856177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.860785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.880016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4505c5aaed4bc5a73c54d7d4099f88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.885893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932399f7-f416-4c62-8b6b-f71bb04b0953 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:23.895717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4505c5aaed4bc5a73c54d7d4099f88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.896445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4505c5aaed4bc5a73c54d7d4099f88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.897176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4505c5aaed4bc5a73c54d7d4099f88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.901585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:23.903826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:23.904117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:23.904399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:23.905442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:23.907244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:23.919903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4505c5aaed4bc5a73c54d7d4099f88'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:23.922730 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3179/6384] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:23.927122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:23.929113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:23.942313 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3206/6385] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:23 2022] DELETE /identity/v3/users/3a4505c5aaed4bc5a73c54d7d4099f88 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:23.943885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36f4d-16c9-47fe-87d4-0f25651f8e34 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:24.007787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:24.008413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.008694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.008996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.009717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:24.011320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48fa38-1bf5-47be-a27e-59297a6fa3ba admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:24.025670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3180/6386] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:24.026824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:24.037973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249aae7-afc1-47fd-b86c-1e532e7d774b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:24.045419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:24.046749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.047187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.047465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] PATH_INFO: `/v3/projects/a6f7eafafd554647ad42646ebdc1aa1b/users/2ed5143e191a43cc892a9428a2a8376c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.104484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f7eafafd554647ad42646ebdc1aa1b, user_id=2ed5143e191a43cc892a9428a2a8376c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:24.129148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:24.138549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:24.166538 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3207/6387] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:24 2022] PUT /identity/v3/projects/a6f7eafafd554647ad42646ebdc1aa1b/users/2ed5143e191a43cc892a9428a2a8376c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:24.171546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.172073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.172670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.182494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:24.210296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:24.212880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.334963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3181/6388] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:24.344357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:24.347735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.380002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:24.381567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.504482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59369f1-d4a2-4389-ab77-a6ab3e65e3b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:24.520370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:24.520370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.520370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.522557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.543764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:24.545367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:24.558705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf7107-e267-44fa-a4e6-b375dd98c2a1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:24.560165 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3208/6389] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:24.561114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:24.562675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.564572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:24.565238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.565519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.565794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.567960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.588572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:24.590810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcea0a-99c0-4d0d-bf71-9c2e3f8cfc67 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:24.594575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205ebbf-e7f7-4001-8b1d-80ed24b127e7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:24.600076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:24.601259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.601658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.602634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] PATH_INFO: `/v3/users/9d0faa838a4e4aa9bc003ece07247ad4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.604312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0faa838a4e4aa9bc003ece07247ad4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:24.606761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:24.607943 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3182/6390] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:24.697413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0faa838a4e4aa9bc003ece07247ad4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:24.706305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0faa838a4e4aa9bc003ece07247ad4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:24.707295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0faa838a4e4aa9bc003ece07247ad4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:24.708110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0faa838a4e4aa9bc003ece07247ad4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:24.727766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0faa838a4e4aa9bc003ece07247ad4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:24.753175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3209/6391] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:24 2022] DELETE /identity/v3/users/9d0faa838a4e4aa9bc003ece07247ad4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:24.758424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:24.758803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:24.759150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:24.781970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:24.783766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:24.853324 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3183/6392] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:24.906655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:24.909862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:25.008716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3004b-feec-470b-b4da-0d7853e45080 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:25.012431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:25.013089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.013420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.013700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.024921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:25.026471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f70f-c38f-4dec-adca-a0ec5d7ca7be service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:25.037651 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3210/6393] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:25.254240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:25.257062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:25.335309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e53b6-f678-445a-b750-a235338aefd9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:25.348752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:25.350854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.353322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.353867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] PATH_INFO: `/v3/projects/49026842a2f84a45bfa9a2108dee8580` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.355661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49026842a2f84a45bfa9a2108dee8580)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:25.368994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:25.401988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:25.488232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49026842a2f84a45bfa9a2108dee8580', 'request_id': 'req-a8882130-4c54-46ff-807e-08d87939ab61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:25.504335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49026842a2f84a45bfa9a2108dee8580', 'request_id': 'req-a8882130-4c54-46ff-807e-08d87939ab61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:25.515637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49026842a2f84a45bfa9a2108dee8580', 'request_id': 'req-a8882130-4c54-46ff-807e-08d87939ab61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:25.564670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] The token cache is being invalidate because project 49026842a2f84a45bfa9a2108dee8580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:25.564982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:25.568967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a8882130-4c54-46ff-807e-08d87939ab61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:25.578097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3184/6394] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:25 2022] DELETE /identity/v3/projects/49026842a2f84a45bfa9a2108dee8580 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:25.582192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.582679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.582777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.616439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:25.618357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:25.635672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:25.772647 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3211/6395] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:25.783813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.784113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.793761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.838963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:25.840234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:25.868981 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3185/6396] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:25.873783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:25.912830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef98a8-02cb-49dd-b1a5-a2f31819c234 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:25.918410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:25.919089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.919747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.920212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.921128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:25.923058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:25.925429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:25.946948 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3212/6397] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:25.951416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:25.962490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d916-fa49-45e4-b114-9c01d67380f2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:25.967624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:25.968318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:25.968602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:25.968880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:25.969595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:25.971583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.007281 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3186/6398] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:25 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:26.011619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.025638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5246e-9c57-4a2c-b27d-3ac6b0799b5c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.116349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.117363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.118110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.118495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.121140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.124347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.165457 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3213/6399] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:26 2022] POST /identity/v3/users => generated 305 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:26.169470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.185088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6c912-1ea0-46ea-ba69-2580d17d57d1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.200259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.201582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.202019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.202462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.204891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.209953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.239690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.239894 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3187/6400] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:26.256983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab10d-1654-4058-9af2-e321c854288b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.265018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.265732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.266026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.266298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.268377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.270628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.291161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3214/6401] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:13:26.292596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.293118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.296100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:26.329066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470ca6-79df-4644-a76b-da4428d53122 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.346394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.348603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.348894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.349178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] PATH_INFO: `/v3/projects/7ab234cf6a724171b7682d2db585c4eb/users/d04c6e256cdf421697a9afd9dceb209b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.384331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d19bf-cee2-49ab-b246-87d614c16153 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.394966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab234cf6a724171b7682d2db585c4eb, user_id=d04c6e256cdf421697a9afd9dceb209b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.395104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.396053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.396542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.396978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] PATH_INFO: `/v3/projects/e4308ccec58d4b9cb14c106d7ceb5c46` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.398502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4308ccec58d4b9cb14c106d7ceb5c46)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.398758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3261-e695-49cc-9538-19a1f4715952 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.401590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.428064 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3215/6402] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:26 2022] PUT /identity/v3/projects/7ab234cf6a724171b7682d2db585c4eb/users/d04c6e256cdf421697a9afd9dceb209b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:26.439641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.439933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.440209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.496382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] MFA Rules not processed for user `d04c6e256cdf421697a9afd9dceb209b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:26.498169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:26.522976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4308ccec58d4b9cb14c106d7ceb5c46', 'request_id': 'req-f92508ef-22e9-4a4b-861c-472214555881'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.536132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4308ccec58d4b9cb14c106d7ceb5c46', 'request_id': 'req-f92508ef-22e9-4a4b-861c-472214555881'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.550398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4308ccec58d4b9cb14c106d7ceb5c46', 'request_id': 'req-f92508ef-22e9-4a4b-861c-472214555881'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.578705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] The token cache is being invalidate because project e4308ccec58d4b9cb14c106d7ceb5c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:26.579242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.580478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.591684 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3188/6403] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:26 2022] DELETE /identity/v3/projects/e4308ccec58d4b9cb14c106d7ceb5c46 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:26.595952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.599026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:26.610930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:26.656960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3216/6404] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:26.665102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.666624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:26.739769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:26.778307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92508ef-22e9-4a4b-861c-472214555881 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.792688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.793409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.793788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.794136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] PATH_INFO: `/v3/users/6b8e4ad3fa4541e081569ae4abc9263d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.795778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8e4ad3fa4541e081569ae4abc9263d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.799602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.842745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37f05-678e-4bd2-ab23-b0ea3086f7e3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:26.855030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:26.856065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:26.856424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:26.857637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:26.858582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:26.861642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:26.892116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8e4ad3fa4541e081569ae4abc9263d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.895049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8e4ad3fa4541e081569ae4abc9263d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.928228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8e4ad3fa4541e081569ae4abc9263d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.928228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8e4ad3fa4541e081569ae4abc9263d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.936388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8e4ad3fa4541e081569ae4abc9263d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:26.941664 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3217/6405] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:26 2022] POST /identity/v3/projects => generated 411 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:26.945845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:26.947792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:26.960447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3189/6406] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:26 2022] DELETE /identity/v3/users/6b8e4ad3fa4541e081569ae4abc9263d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:27.065252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefe21-d675-4904-977c-a795391cf859 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.198801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.199350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.199690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.199971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.200686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.204724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.248346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3218/6407] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:26 2022] POST /identity/v3/users => generated 312 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:27.252481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.264791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07ab0-ea86-4543-9687-56bc7b070168 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.271014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.271743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.272207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.272339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.273369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.274805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.292078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.297587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3190/6408] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:27.303944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb28e2-707b-4e0f-b7cc-f5b2ff66112d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.310933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.311650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.311992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.312274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] PATH_INFO: `/v3/projects/c4491079370e43559ed7fe2d848ffc96/users/c9e0c3a803774881bedb4aed98c02fe8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.316362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:27.381566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4491079370e43559ed7fe2d848ffc96, user_id=c9e0c3a803774881bedb4aed98c02fe8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.386600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.422514 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3219/6409] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:27 2022] PUT /identity/v3/projects/c4491079370e43559ed7fe2d848ffc96/users/c9e0c3a803774881bedb4aed98c02fe8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:27.429044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.445625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9885a-d001-456a-a4ec-ad3cbad1a6f4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.550424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.554439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.556489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.556989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.557993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.559902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca21b0b-48b1-4186-acf1-16fe99621448 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.583082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.590279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3191/6410] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:27.596092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad199ac-bbf0-49da-b0a7-47dbc83360bd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.604609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.606781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.607577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.609480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] PATH_INFO: `/v3/projects/c4491079370e43559ed7fe2d848ffc96/users/c9e0c3a803774881bedb4aed98c02fe8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.612533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4491079370e43559ed7fe2d848ffc96, user_id=c9e0c3a803774881bedb4aed98c02fe8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.616049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.629652 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3220/6411] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:27 2022] PUT /identity/v3/projects/c4491079370e43559ed7fe2d848ffc96/users/c9e0c3a803774881bedb4aed98c02fe8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:27.646075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.646374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.646587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.711582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] MFA Rules not processed for user `c9e0c3a803774881bedb4aed98c02fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:27.713152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:27.760509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:27.843910 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3192/6412] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:27.881971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.883759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:27.966852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb627d7-f771-458d-81df-4f45a8125672 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:27.974352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:27.975294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:27.975760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:27.976171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:27.986989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:27.988618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5348e-bbcf-47c1-9908-7e09594221ff service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:27.998630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:27.999927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:28.015293 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3221/6413] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:28.076282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404f160-a354-44c8-9341-3b223165ae26 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.081848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.082820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.083175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.083545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] PATH_INFO: `/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.085046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb43b83ffcca40078a83384b3c7bfa5f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.087082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:28.174154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb43b83ffcca40078a83384b3c7bfa5f', 'request_id': 'req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:28.182712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb43b83ffcca40078a83384b3c7bfa5f', 'request_id': 'req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:28.190432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb43b83ffcca40078a83384b3c7bfa5f', 'request_id': 'req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:28.215698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] The token cache is being invalidate because project cb43b83ffcca40078a83384b3c7bfa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:28.216002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:28.216952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c03e63d-0cd6-4c81-8e58-0d60ab5f6aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:28.218794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3193/6414] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:27 2022] DELETE /identity/v3/projects/cb43b83ffcca40078a83384b3c7bfa5f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:28.225354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.225642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.225923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.281398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:28.282837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:28.380485 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3222/6415] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:28.387822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.388292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.388558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.412633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:28.414045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:28.428091 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3194/6416] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:28.429670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:28.444158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c62fe7-23b7-4437-a4c8-6b32868c0c0b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.458370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.460326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.462070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.462070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.464080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:28.464544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.466145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:28.506246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3223/6417] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:28.508226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:28.524697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e35c4f-bce1-4523-9f7b-7335e205d666 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.540205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.540904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.541190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.541467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.542172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.549227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:28.615735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3195/6418] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:28 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:28.620208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:28.648297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440258d3-916c-40ee-b3d2-8780aa61e5e9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.828968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.829663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.829944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.830224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.830921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.833576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:28.843465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:28.875232 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3224/6419] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:28 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:28.880011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:28.898147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9d2d3-bdb9-4899-9538-36d72a6d288e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.902893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.903605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.903897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.904179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.904908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.906543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:28.947888 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3196/6420] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:28.948714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:28.981510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdbb70-a0e0-4b1a-b8c5-c0c18ce25850 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:28.990851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:28.992982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:28.993580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:28.994010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:28.996327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:28.998246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dad2f9-7a96-4b79-bff6-e6f8e34bad40 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:29.015483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3225/6421] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:13:29.017056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:29.032485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9ec06-0caa-4797-896f-a5b2278a2e1f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:29.038061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:29.038986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:29.039274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:29.040639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] PATH_INFO: `/v3/projects/4f970c3882e940f98bab811c9fdd078a/users/4eccde33e4f44565b9e7ed25ba378948/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:29.067722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f970c3882e940f98bab811c9fdd078a, user_id=4eccde33e4f44565b9e7ed25ba378948, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:29.071361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:29.086271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:29.097344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3197/6422] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:29 2022] PUT /identity/v3/projects/4f970c3882e940f98bab811c9fdd078a/users/4eccde33e4f44565b9e7ed25ba378948/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:29.103931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a846a9-7722-4ca9-beae-0e1095846e6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:29.115451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a846a9-7722-4ca9-beae-0e1095846e6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:29.121836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a846a9-7722-4ca9-beae-0e1095846e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:29.184859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b1a846a9-7722-4ca9-beae-0e1095846e6b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:29.186878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b1a846a9-7722-4ca9-beae-0e1095846e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:29.345919 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3226/6423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:29.405397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:29.407805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:29.560839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969315b9-35f9-456f-a647-b50546023afb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:29.571569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:29.572229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:29.572593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:29.572881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:29.591754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:29.593507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:29.626025 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3198/6424] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:32.728743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:32.729273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:32.729374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:32.784036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] MFA Rules not processed for user `4eccde33e4f44565b9e7ed25ba378948`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:32.785667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:32.933763 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3227/6425] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:32.938460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:32.956831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e95b83-b93f-4137-9dfb-fd119eb6229d service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:32.970538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:32.971235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:32.971558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:32.971899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:32.972677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:32.974633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b2606-9156-4037-9a35-041180bd275b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.033474 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3199/6426] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:32 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:33.038328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.058085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d231b2-fbff-4a5e-9573-ccdd1b282614 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.125968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.126547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.126987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.197773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.198465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.198754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.199030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.199762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.201918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.211921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] MFA Rules not processed for user `2ed5143e191a43cc892a9428a2a8376c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:33.213176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:33.233444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:33.247694 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3228/6427] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:33 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:33.252277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.276887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0dd86-50af-4ccb-8906-c0baee04f491 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.288755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.289719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.290108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.290626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.293403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.295183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.311145 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3229/6428] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:13:33.314258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.326422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a74b-9757-4ade-9801-b9c8ce158669 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.334366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.335438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.335866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.336282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] PATH_INFO: `/v3/projects/0edd1e39bfca4722b80781460bc0d06f/users/4dde8cf2e9ee47239a8a5974c9aad25d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.363634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edd1e39bfca4722b80781460bc0d06f, user_id=4dde8cf2e9ee47239a8a5974c9aad25d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.363634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.405206 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3230/6429] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:33 2022] PUT /identity/v3/projects/0edd1e39bfca4722b80781460bc0d06f/users/4dde8cf2e9ee47239a8a5974c9aad25d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:33.411204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.411889 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3200/6430] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:13:33.413021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.414554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:33.432502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9226-fb25-4008-a83b-b88a83fbc89c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.514772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ff637-447b-4b18-8f89-ba84eaad4f62 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.521068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.522160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.522601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.523129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.524133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.526069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.536776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.537615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.538174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.538525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.539596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.544687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.550316 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3231/6431] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:33.551737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.553633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:33.569127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:33.629870 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3201/6432] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:33 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:33.629870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.717635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d215f4d-e1f2-4963-9db6-d2477687cd53 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.783845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd282fac-55de-4348-ba4d-facc3d256eff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:33.799898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.812408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.812557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.813755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] PATH_INFO: `/v3/projects/0edd1e39bfca4722b80781460bc0d06f/users/4dde8cf2e9ee47239a8a5974c9aad25d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.825425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edd1e39bfca4722b80781460bc0d06f, user_id=4dde8cf2e9ee47239a8a5974c9aad25d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.827018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:33.838140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.854719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:33.855407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:33.857176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:33.857433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:33.860918 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3202/6433] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:33 2022] PUT /identity/v3/projects/0edd1e39bfca4722b80781460bc0d06f/users/4dde8cf2e9ee47239a8a5974c9aad25d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:33.862840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:33.864511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:33.892505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:33.894979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:33.931162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3232/6434] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:34.021597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c9451-b833-44c5-8dfb-247b96b7ae01 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.029800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.030751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.031321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.031850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.033003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.036188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.063802 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3203/6435] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:33 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:34.067828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:34.087374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7cd7-f76b-401a-8d58-4d2323141661 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.096359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.097200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.097789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.098114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.099067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.101024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.128917 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3233/6436] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:13:34.133683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:34.154530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6235804-fe49-4094-a935-213bd09538b3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.162702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.164105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.168910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.169578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] PATH_INFO: `/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a/users/6b6e79bc390747dc8034d38a767d9f94/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.222433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbabf9a1b7e04263be1e81f35ad1082a, user_id=6b6e79bc390747dc8034d38a767d9f94, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.230292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.256935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3204/6437] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:34 2022] PUT /identity/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a/users/6b6e79bc390747dc8034d38a767d9f94/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:34.258047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:34.273030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025ef77-f122-4672-b010-91ad5f52b7c1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.439979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.440810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.441195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.441589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.442479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.444627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.495955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:34.508298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3234/6438] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:34.512448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a5aa1-6e62-48d5-8a15-a17b23e8da63 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.521341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.522341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.523926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.524227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] PATH_INFO: `/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a/users/6b6e79bc390747dc8034d38a767d9f94/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.529940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbabf9a1b7e04263be1e81f35ad1082a, user_id=6b6e79bc390747dc8034d38a767d9f94, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.535374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358accb-401d-4944-bde1-a708f73c9f46 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.539322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:34.541234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:34.560393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df11d-cf45-426e-8e8e-02e78d4d6b68 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:34.574987 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3205/6439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:34 2022] PUT /identity/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a/users/6b6e79bc390747dc8034d38a767d9f94/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:34.665184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:34.669491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.669491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.669491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] PATH_INFO: `/v3/users/d04c6e256cdf421697a9afd9dceb209b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.679208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04c6e256cdf421697a9afd9dceb209b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:34.682952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:34.795271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04c6e256cdf421697a9afd9dceb209b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:34.805723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04c6e256cdf421697a9afd9dceb209b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:34.806848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04c6e256cdf421697a9afd9dceb209b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:34.807906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04c6e256cdf421697a9afd9dceb209b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:34.830926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:34.834970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04c6e256cdf421697a9afd9dceb209b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:34.880791 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3235/6440] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:34 2022] DELETE /identity/v3/users/d04c6e256cdf421697a9afd9dceb209b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:34.884351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8444-76a3-4ae4-bbfb-12bda5bf0dfa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:34.884644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8444-76a3-4ae4-bbfb-12bda5bf0dfa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:34.886062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8444-76a3-4ae4-bbfb-12bda5bf0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:34.912006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b2cf8444-76a3-4ae4-bbfb-12bda5bf0dfa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:34.913933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b2cf8444-76a3-4ae4-bbfb-12bda5bf0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:34.984508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:35.021320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3206/6441] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:35.041846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:35.043406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:35.202694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d499b-815b-425f-9fad-46967b646783 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:35.207024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:35.207944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:35.208389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:35.208822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:35.236684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:35.238488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6726ef-25c9-4558-8c1a-c7e51ff4821c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:35.254801 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3236/6442] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:35.454984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741de3-389e-41d8-b251-8446300b0e77 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:35.455895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741de3-389e-41d8-b251-8446300b0e77 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:35.456372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741de3-389e-41d8-b251-8446300b0e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:35.479670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-59741de3-389e-41d8-b251-8446300b0e77 None None] MFA Rules not processed for user `c3a7b7c72a80455381b2b9b4ee14eed3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:35.481058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-59741de3-389e-41d8-b251-8446300b0e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:35.543042 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3207/6443] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:35.717251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:35.717555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:35.717865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:35.758850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] MFA Rules not processed for user `4dde8cf2e9ee47239a8a5974c9aad25d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:35.760293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:35.870393 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3237/6444] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:35.875773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:35.876659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:35.881385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:35.918173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] MFA Rules not processed for user `4eccde33e4f44565b9e7ed25ba378948`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:35.920818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:36.028353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3208/6445] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:36.036444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:36.041786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:36.218841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc0a4d-33dd-4c1c-8554-7ccd4783e46c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:36.231109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:36.231838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:36.232123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:36.232404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:36.241684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:36.260519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:36.262388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:36.264438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:36.265974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:36.271899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:36.285200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3238/6446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:36.292818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29f54d-714f-42e6-ac01-7ca745212b51 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:36.305597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:36.305936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:36.306227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:36.307743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] PATH_INFO: `/v3/projects/7ab234cf6a724171b7682d2db585c4eb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:36.310308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab234cf6a724171b7682d2db585c4eb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:36.315943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:36.418243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab234cf6a724171b7682d2db585c4eb', 'request_id': 'req-22028008-b125-439b-96bf-e14fda2c8ee0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.428603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab234cf6a724171b7682d2db585c4eb', 'request_id': 'req-22028008-b125-439b-96bf-e14fda2c8ee0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.437139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab234cf6a724171b7682d2db585c4eb', 'request_id': 'req-22028008-b125-439b-96bf-e14fda2c8ee0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.461368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] The token cache is being invalidate because project 7ab234cf6a724171b7682d2db585c4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:36.461952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.462556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.467306 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3209/6447] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:36 2022] DELETE /identity/v3/projects/7ab234cf6a724171b7682d2db585c4eb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:36.468735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:36.496672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6dc211-8053-40aa-903b-507bade0aa7d service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:36.674902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:36.677563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:36.678491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:36.679179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] PATH_INFO: `/v3/users/c9e0c3a803774881bedb4aed98c02fe8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:36.682873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e0c3a803774881bedb4aed98c02fe8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:36.685351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:36.806164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e0c3a803774881bedb4aed98c02fe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.816235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e0c3a803774881bedb4aed98c02fe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.817429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e0c3a803774881bedb4aed98c02fe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.818251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e0c3a803774881bedb4aed98c02fe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.841814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7bdf3cda-8044-471a-b0de-3b47f46af893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e0c3a803774881bedb4aed98c02fe8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:36.875196 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3239/6448] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:36 2022] DELETE /identity/v3/users/c9e0c3a803774881bedb4aed98c02fe8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:37.727300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:37.728807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:37.754646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028008-b125-439b-96bf-e14fda2c8ee0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:37.784558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:37.906700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:37.907839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:37.908305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:37.908739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] PATH_INFO: `/v3/projects/c4491079370e43559ed7fe2d848ffc96` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:37.912342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4491079370e43559ed7fe2d848ffc96)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:37.916141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:38.053111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4491079370e43559ed7fe2d848ffc96', 'request_id': 'req-03b4195f-d06f-472f-b44b-d47e599104fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:38.076725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4491079370e43559ed7fe2d848ffc96', 'request_id': 'req-03b4195f-d06f-472f-b44b-d47e599104fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:38.094452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4491079370e43559ed7fe2d848ffc96', 'request_id': 'req-03b4195f-d06f-472f-b44b-d47e599104fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:38.124598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] The token cache is being invalidate because project c4491079370e43559ed7fe2d848ffc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:38.125481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:38.127937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03b4195f-d06f-472f-b44b-d47e599104fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:38.130073 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3210/6449] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:37 2022] DELETE /identity/v3/projects/c4491079370e43559ed7fe2d848ffc96 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:38.135476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.137352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.138416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.187693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:38.189158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:38.327881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3240/6450] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:38.336597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.337056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.337860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.372407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:38.372407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:38.401186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:38.411536 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3211/6451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:38.413291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe46ed-3cd2-4853-ab9b-20c59833928c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:38.420181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:38.422125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.422596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.423048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.424514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:38.425121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:38.427938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:38.451821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:38.452360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3241/6452] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:38.466581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fde43-b58a-437c-aadd-1241353ee659 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:38.479423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:38.480155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.480444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.480801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.481725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:38.483720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:38.614085 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3212/6453] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:38 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:38.616269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:38.634768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392dcfc-d1fd-42cf-afd4-585cb604386b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:38.641996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:38.801447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:38.802167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.802454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.802731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.803443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:38.806276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:38.856927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3242/6454] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:38 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:38.858952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:38.881441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4177d0-33ee-416e-983b-541eef1db523 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:38.913311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:38.914088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.914379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.914658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.916910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:38.923492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:38.943235 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3213/6455] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:38.946324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:38.968858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f71f-3056-4088-aa3f-ca27039b4fe8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:38.983204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:38.983971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:38.985424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:38.986695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:38.987579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:38.994511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9517b8-30f6-4957-a7b9-d8ce6cddde6f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.040036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.046893 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3243/6456] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:39.093126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fab0f-6a4f-4f78-be9d-eb2bbaa0a44e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.105411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.107933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.108398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.108833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] PATH_INFO: `/v3/projects/830d8729b0944f6280c1f76a32ac9ba6/users/e2cdf255bfd54b7d94f2db55b37eb57d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.138017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830d8729b0944f6280c1f76a32ac9ba6, user_id=e2cdf255bfd54b7d94f2db55b37eb57d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.141349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.168219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3214/6457] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:39 2022] PUT /identity/v3/projects/830d8729b0944f6280c1f76a32ac9ba6/users/e2cdf255bfd54b7d94f2db55b37eb57d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:39.182314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.182912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.183022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.247980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] MFA Rules not processed for user `e2cdf255bfd54b7d94f2db55b37eb57d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:39.249958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:39.407460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.410282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3244/6458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:39.472866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:39.494068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559930-3d49-4e57-bc2b-875b1fff5c91 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.498834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.499637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.499952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.500290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.500964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.505313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.545863 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3215/6459] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:39 2022] POST /identity/v3/projects => generated 397 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:39.547824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.565923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469c3a-35ef-476d-aeaf-43d6b90704cf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.638293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.640064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:39.654433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.655400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.655706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.655983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.656679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.659978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.727579 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3245/6460] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:39 2022] POST /identity/v3/users => generated 305 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:39.730805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.740019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:39.746387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b20c4-140b-4653-9efa-8ab952e8d768 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.760212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.762080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.762638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.763144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.764903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.770155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.801780 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3246/6461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:39.805049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:39.831942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9fd58-53ae-4d20-8ee7-c5c745fbd696 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.835411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48440-8c51-4452-8b0e-2eb2bb396fab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:39.846032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.847303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.848074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.850037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:39.851241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] PATH_INFO: `/v3/projects/4f7ed951ec01451486bc85f982ea1504/users/3d24e0e3284440969e512b81db5e47f6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.852276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:39.852662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:39.853216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] PATH_INFO: `/v3/users/fa3fa6f1e59044ddaa5329ba4091c72c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:39.857503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3fa6f1e59044ddaa5329ba4091c72c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.863171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.889619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7ed951ec01451486bc85f982ea1504, user_id=3d24e0e3284440969e512b81db5e47f6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:39.897489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:39.944484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3247/6462] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:39 2022] PUT /identity/v3/projects/4f7ed951ec01451486bc85f982ea1504/users/3d24e0e3284440969e512b81db5e47f6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:39.960280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:40.009974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3fa6f1e59044ddaa5329ba4091c72c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:40.011631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3fa6f1e59044ddaa5329ba4091c72c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:40.030294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3fa6f1e59044ddaa5329ba4091c72c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:40.031534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3fa6f1e59044ddaa5329ba4091c72c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:40.067663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9752466b-9d0f-42f1-b4f7-df5785e74597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3fa6f1e59044ddaa5329ba4091c72c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:40.121063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f1fb0-24a9-4be8-9973-ee46eb486670 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:40.127619 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3216/6463] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:39 2022] DELETE /identity/v3/users/fa3fa6f1e59044ddaa5329ba4091c72c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:40.134739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:40.135740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.136035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.136324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.137239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:40.137999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a25-6cfd-4727-86f4-17b43c125b0c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.139402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:40.139954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a25-6cfd-4727-86f4-17b43c125b0c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.141978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164a25-6cfd-4727-86f4-17b43c125b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.158771 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3248/6464] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:40.168189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:40.170539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.192934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46796-2c84-44bd-886f-1c79fb027a3b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:40.200922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1d164a25-6cfd-4727-86f4-17b43c125b0c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:40.203007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1d164a25-6cfd-4727-86f4-17b43c125b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.305754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:40.349321 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3217/6465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:40.378238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:40.382824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.382824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.382992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] PATH_INFO: `/v3/projects/4f7ed951ec01451486bc85f982ea1504/users/3d24e0e3284440969e512b81db5e47f6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.385499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7ed951ec01451486bc85f982ea1504, user_id=3d24e0e3284440969e512b81db5e47f6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:40.388365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:40.406934 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3249/6466] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:40 2022] PUT /identity/v3/projects/4f7ed951ec01451486bc85f982ea1504/users/3d24e0e3284440969e512b81db5e47f6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:40.515542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.515868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.516186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.532512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:40.536753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.594147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] MFA Rules not processed for user `3d24e0e3284440969e512b81db5e47f6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:40.595639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.695878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b537a83-11ec-4219-8d5c-352bb8d42951 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:40.707063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:40.710232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.710523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.710810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.755902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:40.788378 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3218/6467] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:40.819118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:40.820981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.845738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4492c-d9c0-45a7-a394-b4b3e898e7cf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:40.852647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:40.853611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:40.854314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:40.855551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:40.858490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:40.883338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:40.884789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:40.907769 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3250/6468] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:40.973970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:40.976780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba15bfc-5685-4f88-afd7-53ed48e261ef service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:40.993989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3219/6469] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:13:42.133415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:42.135377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:42.155691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbf3f3-12e5-4128-8799-038d125e95fa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:42.163420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:42.164755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.165225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.165716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] PATH_INFO: `/v3/projects/9cac001ab3b84f51a2501826c68648d2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.167677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cac001ab3b84f51a2501826c68648d2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:42.169996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:42.251700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cac001ab3b84f51a2501826c68648d2', 'request_id': 'req-2b03a190-ec59-4c0c-a415-23f844a1b4bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:42.261511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cac001ab3b84f51a2501826c68648d2', 'request_id': 'req-2b03a190-ec59-4c0c-a415-23f844a1b4bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:42.272016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cac001ab3b84f51a2501826c68648d2', 'request_id': 'req-2b03a190-ec59-4c0c-a415-23f844a1b4bd'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:42.294246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] The token cache is being invalidate because project 9cac001ab3b84f51a2501826c68648d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:42.294985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:42.296126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:42.299317 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3251/6470] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:42 2022] DELETE /identity/v3/projects/9cac001ab3b84f51a2501826c68648d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:42.305238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0383f9-3d42-4e53-8587-06eabb0917e0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.305889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0383f9-3d42-4e53-8587-06eabb0917e0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.306256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0383f9-3d42-4e53-8587-06eabb0917e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.321010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:42.323113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:42.345122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2b0383f9-3d42-4e53-8587-06eabb0917e0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:42.349208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b0383f9-3d42-4e53-8587-06eabb0917e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:42.477348 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3220/6471] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:42.563934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a190-ec59-4c0c-a415-23f844a1b4bd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:42.576077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:42.577941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.579444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.580333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.596480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:42.600738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.601339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.602421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.634368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:42.636296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:42.648850 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3221/6472] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:13:42.654675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:42.663163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:42.671304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:42.686533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313938-c423-47df-906a-850203c3a8f0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:42.697303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:42.698409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.698711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.699341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.700356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:42.700798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:42.703066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:42.767181 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3222/6473] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:42.772641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:42.776220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:42.778796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:42.794784 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3252/6474] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:42.804937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceadeb0-894b-4f64-be82-85b1e445de2d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:42.832411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:42.833203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:42.833872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:42.835047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:42.835922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:42.838444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:42.907821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:42.923971 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3223/6475] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:42 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:42.942322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c32c9-f9db-4724-abc7-d17a3107def3 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:43.071105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:43.072163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.072557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.073396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.074100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:43.077970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:43.134002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:43.134181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3253/6476] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:42 2022] POST /identity/v3/users => generated 279 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:13:43.152070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16470cb-2d9c-477b-9905-44e9dc94cd35 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:43.162826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:43.163753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.164152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.164586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.166665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:43.170321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:43.194660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:43.195882 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3224/6477] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:43.219406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efb446-6edd-4b2c-a2d7-0743f1321452 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:43.238797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:43.240614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.241910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.245375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.246531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:43.249098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb324-9b3a-4e2a-b482-a2716cee0c99 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:43.265480 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3254/6478] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:43.270512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:43.287646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee813ed-3c57-4b0f-afee-ecf1e4ad5ca2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:43.294613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:43.295951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.297746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.297746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] PATH_INFO: `/v3/projects/8d31a348e6ac4739ab418bf66d4f0b9e/users/a642a75e5daf4d628ff83cf189f7fd4a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.326532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d31a348e6ac4739ab418bf66d4f0b9e, user_id=a642a75e5daf4d628ff83cf189f7fd4a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:43.338863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:43.392794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3225/6479] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:43 2022] PUT /identity/v3/projects/8d31a348e6ac4739ab418bf66d4f0b9e/users/a642a75e5daf4d628ff83cf189f7fd4a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:43.403968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47beb-133f-4d12-ae70-6c89b719f64a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.404687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47beb-133f-4d12-ae70-6c89b719f64a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.405596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d47beb-133f-4d12-ae70-6c89b719f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.448408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c0d47beb-133f-4d12-ae70-6c89b719f64a None None] MFA Rules not processed for user `a642a75e5daf4d628ff83cf189f7fd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:43.450340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c0d47beb-133f-4d12-ae70-6c89b719f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:43.629912 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3255/6480] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:43.657381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:43.659574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:43.811123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777cdab-66f7-41ab-81dc-06bd493bb4d5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:43.816228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:43.818381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:43.818732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:43.819137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:43.833166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:43.835092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:43.851493 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3226/6481] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:45.188045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:45.188599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:45.188599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:45.240260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] MFA Rules not processed for user `6b6e79bc390747dc8034d38a767d9f94`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:45.241765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:45.271563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:45.372638 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3256/6482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:45.397824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:45.400491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:45.580264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a328b-c206-49dc-a4b2-3ed7793668dc service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:45.585060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:45.585983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:45.586414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:45.586856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:45.588976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:45.691152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:45.717627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:45.719882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:45.743321 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3227/6483] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:46.753333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:46.755233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:47.028782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d671f7-0aa3-48d9-9bb2-b2fa64980273 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:47.044596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:47.045891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:47.046338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:47.046825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:47.050565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:47.089189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:47.094572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf326f-9e70-4d97-bd55-53c0e9e0b51e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:47.158220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3257/6484] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:55.728396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:56.538486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:56.540168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:56.735534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2adb-6b09-4f1e-8997-1e61ce17b00f service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:56.741005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:56.742178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:56.742507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:56.742748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] PATH_INFO: `/v3/users/e2cdf255bfd54b7d94f2db55b37eb57d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:56.744324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cdf255bfd54b7d94f2db55b37eb57d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:56.746809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:56.836755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cdf255bfd54b7d94f2db55b37eb57d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:56.837453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cdf255bfd54b7d94f2db55b37eb57d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:56.846888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cdf255bfd54b7d94f2db55b37eb57d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:56.847808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cdf255bfd54b7d94f2db55b37eb57d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:56.868867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cdf255bfd54b7d94f2db55b37eb57d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:56.894469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3228/6485] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:56 2022] DELETE /identity/v3/users/e2cdf255bfd54b7d94f2db55b37eb57d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:56.900804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:56.901438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:56.901541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:56.930101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:56.931382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:57.028943 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3258/6486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:57.039120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:57.041258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:57.110190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf64d3-1288-4102-9433-7bbd951cee89 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:57.114245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:57.114931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:57.115183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:57.115490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:57.126077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:57.128224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:57.155060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3229/6487] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:13:57.398799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:57.400947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:57.419570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438308be-a4ee-47bf-8f0d-bfd286e8fde4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:57.425032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:57.426033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:57.426248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:57.427086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] PATH_INFO: `/v3/projects/830d8729b0944f6280c1f76a32ac9ba6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:57.428742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830d8729b0944f6280c1f76a32ac9ba6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:57.431858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:57.503210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:57.523072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830d8729b0944f6280c1f76a32ac9ba6', 'request_id': 'req-40863bea-4172-4503-9ab0-e51e778d34d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.532119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830d8729b0944f6280c1f76a32ac9ba6', 'request_id': 'req-40863bea-4172-4503-9ab0-e51e778d34d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.546492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830d8729b0944f6280c1f76a32ac9ba6', 'request_id': 'req-40863bea-4172-4503-9ab0-e51e778d34d2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.571933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] The token cache is being invalidate because project 830d8729b0944f6280c1f76a32ac9ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:57.572241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.572902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.579224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3259/6488] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:57 2022] DELETE /identity/v3/projects/830d8729b0944f6280c1f76a32ac9ba6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:57.579485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:57.598605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc23a4-0a44-4e90-a854-388ea9ffbaaa service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:57.645265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:57.703958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:57.706067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:57.706330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:57.706751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] PATH_INFO: `/v3/users/3d24e0e3284440969e512b81db5e47f6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:57.708411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d24e0e3284440969e512b81db5e47f6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:57.710792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:57.782568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d24e0e3284440969e512b81db5e47f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.783761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d24e0e3284440969e512b81db5e47f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.792966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d24e0e3284440969e512b81db5e47f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.796841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d24e0e3284440969e512b81db5e47f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.822428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-794896d8-1f68-4dc4-8e07-2c9f46cf7ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d24e0e3284440969e512b81db5e47f6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:57.850257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3230/6489] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:13:57 2022] DELETE /identity/v3/users/3d24e0e3284440969e512b81db5e47f6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:58.156775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:58.158444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:58.185967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863bea-4172-4503-9ab0-e51e778d34d2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:58.300669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:58.302023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.303109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.303678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] PATH_INFO: `/v3/projects/4f7ed951ec01451486bc85f982ea1504` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.305457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7ed951ec01451486bc85f982ea1504)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:58.307720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:58.449527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7ed951ec01451486bc85f982ea1504', 'request_id': 'req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:58.465541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7ed951ec01451486bc85f982ea1504', 'request_id': 'req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:58.475077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7ed951ec01451486bc85f982ea1504', 'request_id': 'req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:58.506710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] The token cache is being invalidate because project 4f7ed951ec01451486bc85f982ea1504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:13:58.506987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:58.508786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9a7f2bd2-4957-4c70-b4f3-899bd45cf92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:13:58.511121 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3260/6490] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:13:58 2022] DELETE /identity/v3/projects/4f7ed951ec01451486bc85f982ea1504 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:13:58.516829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.517111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.517383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.561864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:58.563252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:58.671941 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3231/6491] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:58.680660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.680938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.681339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.712685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:58.715302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:58.735964 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3261/6492] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:13:58.740954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:58.755092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc54fc-fe81-451c-b14d-8d3c1337bfb5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:58.764807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:58.765752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.766200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.766708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.767683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:13:58.768453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:58.771098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:58.787471 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3232/6493] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:13:58.791935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:58.802421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8a61-2ec9-437e-b457-2deca77788a9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:58.808031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:58.808713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.808997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.809270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.809982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:58.812125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:58.869074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3262/6494] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:13:58 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:58.873127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:58.886785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a1f6-fabd-4856-9dc2-aa9555259aaa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:58.923185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:58.970421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:58.971489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:58.971489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:58.971761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:58.972866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:58.974769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:59.006385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3233/6495] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:13:58 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:13:59.007680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:59.019651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34abd-2e5a-4e6c-92d6-47384706e46e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:59.025159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:59.025843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:59.026137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:59.026448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:59.027195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:59.028909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:59.045901 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3263/6496] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:59.050143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:59.061172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103958b5-6793-45c0-9c71-d8ea3c1c1a36 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:59.070190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:59.070891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:59.071244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:59.071631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:59.072434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:59.074143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fef50a-567e-4166-a8a6-c3f9cc79b0af admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:59.086926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3234/6497] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:13:59.091309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:59.108616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342673-86c6-4ccf-b834-22d44c6ba8bf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:59.116905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:59.118195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:59.118647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:59.118991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] PATH_INFO: `/v3/projects/675ec8e1ddda4f52980c530a8bec436e/users/571f69e052a74d5d9ab7641add106010/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:59.139783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675ec8e1ddda4f52980c530a8bec436e, user_id=571f69e052a74d5d9ab7641add106010, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:59.143536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:59.147480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:59.171912 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3264/6498] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:13:59 2022] PUT /identity/v3/projects/675ec8e1ddda4f52980c530a8bec436e/users/571f69e052a74d5d9ab7641add106010/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:13:59.184667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944140-21ea-4641-b343-27021879d708 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:59.185198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944140-21ea-4641-b343-27021879d708 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:59.185475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944140-21ea-4641-b343-27021879d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:59.236952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-80944140-21ea-4641-b343-27021879d708 None None] MFA Rules not processed for user `571f69e052a74d5d9ab7641add106010`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:13:59.238747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80944140-21ea-4641-b343-27021879d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:59.317903 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3235/6499] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:13:59.328253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:13:59.331686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:13:59.419721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ec75-71ae-4286-8d6e-1015315bda94 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:13:59.424544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:13:59.425595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:13:59.426501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:13:59.427375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:13:59.438978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:13:59.440447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:13:59.468141 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3265/6500] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:00.185056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944140-21ea-4641-b343-27021879d708 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:00.186473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80944140-21ea-4641-b343-27021879d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:00.221912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:00.224190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:00.261400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944140-21ea-4641-b343-27021879d708 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:00.266075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:00.266904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:00.267405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:00.267731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:00.270381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:00.302116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30d6c4-3a6e-4d32-bcdf-0c6a937263f0 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:00.314357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:00.314357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:00.316001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:00.316605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] PATH_INFO: `/v3/users/a642a75e5daf4d628ff83cf189f7fd4a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:00.318818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a642a75e5daf4d628ff83cf189f7fd4a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:00.323139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:00.351907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:00.386524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:00.388684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5646169-0459-4de3-bb46-9c06ff9d3e06 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:00.403200 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3236/6501] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:00.407841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a642a75e5daf4d628ff83cf189f7fd4a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:00.422387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a642a75e5daf4d628ff83cf189f7fd4a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:00.423390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a642a75e5daf4d628ff83cf189f7fd4a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:00.424524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a642a75e5daf4d628ff83cf189f7fd4a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:00.441992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a642a75e5daf4d628ff83cf189f7fd4a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:00.473867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3266/6502] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:00 2022] DELETE /identity/v3/users/a642a75e5daf4d628ff83cf189f7fd4a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:00.480363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:00.480695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:00.481033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:00.530087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:00.532842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:00.681482 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3237/6503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:00.692759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:00.694333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:00.723364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:00.788426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cdab1-06a8-425b-bd49-6a0addbd5397 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:00.792301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:00.793480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:00.793480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:00.793693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:00.808708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:00.810706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed041-c0c3-45b3-a0c2-464ec8e785e5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:00.838104 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3267/6504] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:01.075733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.077158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:01.109663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec1956-19ea-4cbb-b8b2-8d648142664f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.122348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.124309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.125591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.129142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] PATH_INFO: `/v3/projects/8d31a348e6ac4739ab418bf66d4f0b9e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.130772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d31a348e6ac4739ab418bf66d4f0b9e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.133591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.205283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d31a348e6ac4739ab418bf66d4f0b9e', 'request_id': 'req-be2df227-749e-4691-b514-2bd6c2885391'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:01.214225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d31a348e6ac4739ab418bf66d4f0b9e', 'request_id': 'req-be2df227-749e-4691-b514-2bd6c2885391'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:01.222984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d31a348e6ac4739ab418bf66d4f0b9e', 'request_id': 'req-be2df227-749e-4691-b514-2bd6c2885391'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:01.250113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] The token cache is being invalidate because project 8d31a348e6ac4739ab418bf66d4f0b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:01.250493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:01.251260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-be2df227-749e-4691-b514-2bd6c2885391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:01.258711 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3238/6505] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:01 2022] DELETE /identity/v3/projects/8d31a348e6ac4739ab418bf66d4f0b9e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:01.264010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.264495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.266162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.302004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:01.303711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:01.396600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3268/6506] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:01.404581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.405392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.405841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.440940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:01.442356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:01.465963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3239/6507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:01.470361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.487007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f490c1a-d1f7-461d-9edb-2914fdf5f47e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.495150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.495866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.496154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.496434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.497180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:01.497490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.499124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.523756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.529253 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3269/6508] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:01.535925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557d23-e897-4803-8db3-eba4ad00db49 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.542053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.542771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.543229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.543502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.544218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.546257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.585666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3240/6509] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:01 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:01.589803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.602064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c67d1-ff34-4ff3-9fd4-3ef969870e22 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.693886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.694747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.695168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.695493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.696407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.699030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.722792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3270/6510] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:01 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:01.727133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.740374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68edba-fa6a-45ff-bf89-5aae869d3a07 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.745666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.746868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.747227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.747629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.748445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.750166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.762530 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3241/6511] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:01.766900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.780223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4454dd1-1ee2-42a0-9cba-0c290f0c2385 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.785979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.786670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.787095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.787378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.788300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.790757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9617e-a7bc-4d5e-a20a-c076653bf9ef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.803697 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3271/6512] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:01.808451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:01.838608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65af7-c0b0-452f-800b-c591e7c2c4fb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:01.857069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:01.857991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.858277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.858556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] PATH_INFO: `/v3/projects/efcecb299cb445358f445a4510adef15/users/dbf21f3160cf485f94b65d5cc6190eaf/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.875654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcecb299cb445358f445a4510adef15, user_id=dbf21f3160cf485f94b65d5cc6190eaf, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:01.878313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:01.896356 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3242/6513] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:01 2022] PUT /identity/v3/projects/efcecb299cb445358f445a4510adef15/users/dbf21f3160cf485f94b65d5cc6190eaf/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:01.909060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:01.910073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:01.910487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:01.943935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] MFA Rules not processed for user `dbf21f3160cf485f94b65d5cc6190eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:01.945813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:01.960644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:02.025639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3272/6514] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:02.047489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:02.050584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:02.063491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:02.118791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e998d-3597-4303-bc20-550d5b4d063a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:02.122477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:02.123237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:02.123551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:02.123837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:02.133663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:02.135034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08205-cd76-41f4-80b8-940343336c59 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:02.160843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3243/6515] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:02.174126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:02.254834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7351a-c98c-4caa-ae2d-b755cb0a1c86 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:02.259606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:02.260493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:02.260775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:02.261065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] PATH_INFO: `/v3/users/dbf21f3160cf485f94b65d5cc6190eaf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:02.262303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf21f3160cf485f94b65d5cc6190eaf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:02.264296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:02.322458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf21f3160cf485f94b65d5cc6190eaf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:02.330430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf21f3160cf485f94b65d5cc6190eaf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:02.331949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf21f3160cf485f94b65d5cc6190eaf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:02.332824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf21f3160cf485f94b65d5cc6190eaf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:02.346722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf21f3160cf485f94b65d5cc6190eaf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:02.363575 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3273/6516] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:02 2022] DELETE /identity/v3/users/dbf21f3160cf485f94b65d5cc6190eaf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:02.368683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b62f-b6de-4ada-9271-4676101f7874 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:02.369216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b62f-b6de-4ada-9271-4676101f7874 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:02.369397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b62f-b6de-4ada-9271-4676101f7874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:02.395406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a135b62f-b6de-4ada-9271-4676101f7874 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:02.396590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a135b62f-b6de-4ada-9271-4676101f7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:02.531095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3244/6517] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:02.547022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:02.548484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:02.597883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:02.629054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5776-da5d-4156-85e3-b97c861fcc11 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:02.633083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:02.633889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:02.634192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:02.634536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:02.646467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:02.648065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:02.661294 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3274/6518] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:02.849573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507df3-6a49-4cf7-b562-cf6494901f2a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:02.849961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507df3-6a49-4cf7-b562-cf6494901f2a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:02.850287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507df3-6a49-4cf7-b562-cf6494901f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:02.870240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a2507df3-6a49-4cf7-b562-cf6494901f2a None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:02.872889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2507df3-6a49-4cf7-b562-cf6494901f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:02.945439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3245/6519] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:03.742944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:03.746769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:03.765067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b6844-6d7d-41a7-b9f4-e5823eda8dfe service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:03.778215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:03.779355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:03.779728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:03.780188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] PATH_INFO: `/v3/projects/efcecb299cb445358f445a4510adef15` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:03.782804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcecb299cb445358f445a4510adef15)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:03.784925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:03.870374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcecb299cb445358f445a4510adef15', 'request_id': 'req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:03.882332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcecb299cb445358f445a4510adef15', 'request_id': 'req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:03.896945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcecb299cb445358f445a4510adef15', 'request_id': 'req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:03.917107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] The token cache is being invalidate because project efcecb299cb445358f445a4510adef15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:03.917447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:03.918801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b1040dce-1e8d-4e64-b8c0-92d0065c5cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:03.921721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3275/6520] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:03 2022] DELETE /identity/v3/projects/efcecb299cb445358f445a4510adef15 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:03.927164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:03.928751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:03.929213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:03.968790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:03.970457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:04.089745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:04.121107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3246/6521] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:04.122567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.122868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.123157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.166002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:04.169531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:04.205517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.205801 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3276/6522] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:04.221863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f8cf7-f192-4c04-8d3a-27c77d50fbb7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.228448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.230508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.230992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.231284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.232072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:04.232390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.234124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.265240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.273202 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3247/6523] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:04.278205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0baf1-d3bc-494b-85b7-c7f8e66a0775 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.284349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.285552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.285842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.286151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.286991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.291159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.402368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3277/6524] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:04 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:04.406432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.419653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5393-0399-4894-968e-d30026fa8e63 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.574009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.582027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.582027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.582236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.585368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.590244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.692010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3248/6525] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:04 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:04.696777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.714258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5bfa-afa5-43b0-a309-e71ceb87b5e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.764735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.764735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.765707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.765707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.794818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.797957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.828875 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3278/6526] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:04.831685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.848868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfba6eb-8bd7-4644-8231-10ba8137e018 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.855828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.856520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.856814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.857094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.857833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.859659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c7a3e-673c-4b48-9d22-574a77fb66c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.877029 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3249/6527] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:04.881136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:04.896941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee011f-acf8-4d5a-8bb7-1b79f6919721 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:04.906635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:04.907760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:04.908032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:04.908362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] PATH_INFO: `/v3/projects/7dc6c8eed25247a78b72a6ba008aa956/users/3246c2926dc9463898f703235f970a76/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:04.942501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc6c8eed25247a78b72a6ba008aa956, user_id=3246c2926dc9463898f703235f970a76, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:04.945913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:04.984145 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3279/6528] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:04 2022] PUT /identity/v3/projects/7dc6c8eed25247a78b72a6ba008aa956/users/3246c2926dc9463898f703235f970a76/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:04.999143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:05.000325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:05.001178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:05.044896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] MFA Rules not processed for user `3246c2926dc9463898f703235f970a76`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:05.046175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:05.183285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3250/6529] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:05.184613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:05.467321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1838-5f3f-4bd9-93ef-25350626c129 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:05.468755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:05.488747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:05.503454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:05.503863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:05.504177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:05.504965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:05.507204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:05.591649 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3280/6530] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:05 2022] POST /identity/v3/projects => generated 371 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:05.599143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:05.614881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84444d18-91fa-412e-877d-ea57878f30d0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:05.762623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:05.804632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:05.810897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:05.812978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:05.812978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:05.814791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:05.820332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:05.894787 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3251/6531] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:05 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:05.899115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:05.919202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c4ba-b021-4fe4-81de-e364714ded13 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:05.926678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:05.927893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:05.928361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:05.928798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:05.929867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:05.932058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:05.964588 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3281/6532] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:05.974318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:05.987236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da43d0-1d0f-42a5-9b1f-c028e67d53e7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:05.999958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:06.001779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:06.002520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:06.002866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] PATH_INFO: `/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee/users/b02fcee3f05944c1a6df5c1b833d1d3e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:06.039703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de9e180b7df4562b06e833ba5d2a1ee, user_id=b02fcee3f05944c1a6df5c1b833d1d3e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:06.043666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:06.065969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3252/6533] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:05 2022] PUT /identity/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee/users/b02fcee3f05944c1a6df5c1b833d1d3e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:06.071403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:06.094924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c042a1e-759a-4c9c-ad2f-6a0b2d0845e8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:06.202411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:06.203288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:06.203764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:06.204198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:06.205287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:06.207677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5055cd1-05a0-4708-929e-1093dd55e9ed admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:06.221828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3282/6534] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:06.226455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:06.250058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3926-4045-4030-8d4e-657c2a6796c0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:06.260661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:06.262250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:06.262770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:06.263290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] PATH_INFO: `/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee/users/b02fcee3f05944c1a6df5c1b833d1d3e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:06.266249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de9e180b7df4562b06e833ba5d2a1ee, user_id=b02fcee3f05944c1a6df5c1b833d1d3e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:06.269911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:06.298547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3253/6535] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:06 2022] PUT /identity/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee/users/b02fcee3f05944c1a6df5c1b833d1d3e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:06.311408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:06.312270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:06.312575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:06.382001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] MFA Rules not processed for user `b02fcee3f05944c1a6df5c1b833d1d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:06.383679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:06.639851 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3283/6536] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:06.650022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:06.652746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:06.793119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8183b7-b2e3-438e-a26f-212c46cf9c4c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:06.798085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:06.798928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:06.799260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:06.799714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:06.812201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:06.833920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0ac60-46e0-45e9-ba83-0f8bbf08254c service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:06.874617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3254/6537] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:07.645377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:07.775969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:07.798177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae8da2-84c1-4514-9266-1abf7e0eb3c9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:07.811785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:07.812715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:07.812998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:07.813418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] PATH_INFO: `/v3/users/3246c2926dc9463898f703235f970a76` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:07.816755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3246c2926dc9463898f703235f970a76)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:07.819385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:07.914455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3246c2926dc9463898f703235f970a76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:07.933907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3246c2926dc9463898f703235f970a76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:07.937649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3246c2926dc9463898f703235f970a76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:07.942843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3246c2926dc9463898f703235f970a76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:07.985276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3246c2926dc9463898f703235f970a76'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:08.025803 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3284/6538] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:07 2022] DELETE /identity/v3/users/3246c2926dc9463898f703235f970a76 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:08.031987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:08.032573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:08.032573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:08.071024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:08.072717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:08.259316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3255/6539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:08.311174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:08.316097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:08.428124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de6da-e242-45cd-ae77-9ccc955efa2c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:08.433747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:08.434669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:08.434669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:08.434669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:08.450475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:08.453108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:08.513982 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3285/6540] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:09.144130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:09.145849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:09.160489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e4720-9cb6-4703-bdeb-97f44c65599e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:09.165980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:09.167099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:09.167452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:09.167832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] PATH_INFO: `/v3/projects/7dc6c8eed25247a78b72a6ba008aa956` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:09.169141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc6c8eed25247a78b72a6ba008aa956)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:09.171502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:09.226937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:09.240405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc6c8eed25247a78b72a6ba008aa956', 'request_id': 'req-e776bd52-dea7-4272-9d3e-15516723746c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.247925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc6c8eed25247a78b72a6ba008aa956', 'request_id': 'req-e776bd52-dea7-4272-9d3e-15516723746c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.254871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc6c8eed25247a78b72a6ba008aa956', 'request_id': 'req-e776bd52-dea7-4272-9d3e-15516723746c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.279362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] The token cache is being invalidate because project 7dc6c8eed25247a78b72a6ba008aa956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:09.280090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.280934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.283379 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3256/6541] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:09 2022] DELETE /identity/v3/projects/7dc6c8eed25247a78b72a6ba008aa956 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:09.287156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:09.303462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534bce-8c81-490f-bec8-76c43fbbb233 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:09.453663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:09.454782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:09.455301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:09.455838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] PATH_INFO: `/v3/users/b02fcee3f05944c1a6df5c1b833d1d3e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:09.457761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02fcee3f05944c1a6df5c1b833d1d3e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:09.460114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:09.489397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:09.546044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02fcee3f05944c1a6df5c1b833d1d3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.555190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02fcee3f05944c1a6df5c1b833d1d3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.556339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02fcee3f05944c1a6df5c1b833d1d3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.557415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02fcee3f05944c1a6df5c1b833d1d3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.587422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-72f8fe5e-97a1-4602-9105-5afb47a3c389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02fcee3f05944c1a6df5c1b833d1d3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:09.616574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3286/6542] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:09 2022] DELETE /identity/v3/users/b02fcee3f05944c1a6df5c1b833d1d3e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:10.005373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.007300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:10.024406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776bd52-dea7-4272-9d3e-15516723746c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.104536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.106103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.106626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.106902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] PATH_INFO: `/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.108282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de9e180b7df4562b06e833ba5d2a1ee)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.110320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.172467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de9e180b7df4562b06e833ba5d2a1ee', 'request_id': 'req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:10.182042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de9e180b7df4562b06e833ba5d2a1ee', 'request_id': 'req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:10.189009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de9e180b7df4562b06e833ba5d2a1ee', 'request_id': 'req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:10.215843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] The token cache is being invalidate because project 1de9e180b7df4562b06e833ba5d2a1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:10.216396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:10.217310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-eb585f7b-a55d-474e-b45e-4309bf3d4ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:10.219234 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3257/6543] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:10 2022] DELETE /identity/v3/projects/1de9e180b7df4562b06e833ba5d2a1ee => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:10.225317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.225549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.226514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.251492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:10.253018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:10.327050 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3287/6544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:10.339597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.340144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.340602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.363483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:10.366095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:10.383706 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3258/6545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:10.388001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.399047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374e143-7621-4b19-aef6-b9e428186803 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.405049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.406028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.406532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.407001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.407981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:10.408764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.410968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.431925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3288/6546] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:10.433395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.444151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2952b-d9f6-4798-9256-26998bee5607 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.448969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.449649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.449937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.450368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.451225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.454550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.484277 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3259/6547] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:10 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:10.490083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.501811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6c5e6-aaeb-45e6-82a7-a463b074477b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.605560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.607116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.607116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.607116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.607881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.610149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.638628 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3289/6548] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:10 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:10.642462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.681286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5a907-7216-4167-a227-5ef8b76b3496 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.694183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.695728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.696394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.696772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.697976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.700849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.719922 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3260/6549] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:10.724925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.752668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a723af-d526-4e9e-86b2-69f7ec6b3919 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.780209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.780924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.781342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.781510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.782277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.784081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eddd5-59d7-49ac-a2d1-84842e0a40f5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.797594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:10.808519 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3290/6550] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:10.811319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:10.833205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa192d4e-9332-4d49-852f-65440613fd36 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:10.844788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:10.846192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.846978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.846978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] PATH_INFO: `/v3/projects/f1ece27e748544b38433cf664aca212b/users/19a821cb38e94517a154ef61fe994f3c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.871310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ece27e748544b38433cf664aca212b, user_id=19a821cb38e94517a154ef61fe994f3c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:10.874280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:10.881908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:10.921060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:10.921406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:10.921660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:10.935201 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3261/6551] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:10 2022] PUT /identity/v3/projects/f1ece27e748544b38433cf664aca212b/users/19a821cb38e94517a154ef61fe994f3c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:10.961675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] MFA Rules not processed for user `19a821cb38e94517a154ef61fe994f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:10.963291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:11.066303 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3291/6552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:11.077729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.197252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002aecb-0e7f-40c9-9d03-396d1c0010e4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.203241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.204161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.204515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.204866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.205764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.207732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.253086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.257131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3262/6553] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:11 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:11.285085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42742320-a7ac-4f8b-a51e-30dc585d14ce None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.376166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.376916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.377326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.378106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.380197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.382444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.419597 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3292/6554] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:11 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:11.421609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.436019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e564ad-071b-465f-a6a6-d086f1de9084 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.444154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.447189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.448808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.449984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.451414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.456287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.476702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3263/6555] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:11.483756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.501618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2d48c-32bc-4f5f-a4fa-5694df15e47d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.510633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.512169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.512769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.513357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] PATH_INFO: `/v3/projects/74139bf362d048ab9b82503e07619f22/users/aca2d4bb1ecd4ec5b9616f0e761c56c8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.535229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74139bf362d048ab9b82503e07619f22, user_id=aca2d4bb1ecd4ec5b9616f0e761c56c8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.538947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.557036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3293/6556] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:11 2022] PUT /identity/v3/projects/74139bf362d048ab9b82503e07619f22/users/aca2d4bb1ecd4ec5b9616f0e761c56c8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:11.561173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.575085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc15a3-54c8-4c92-a471-618688636059 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.730125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.731157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.731427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.731746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.732804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.734333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ca416-ec3c-4244-bcdc-7bb54fd00a07 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.747597 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3264/6557] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:11.755087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:11.771356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbd31-f018-46bd-8e7d-5ed3a4787832 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:11.778882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:11.781083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.781470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.782023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] PATH_INFO: `/v3/projects/74139bf362d048ab9b82503e07619f22/users/aca2d4bb1ecd4ec5b9616f0e761c56c8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.785963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74139bf362d048ab9b82503e07619f22, user_id=aca2d4bb1ecd4ec5b9616f0e761c56c8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:11.790143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:11.815987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3294/6558] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:11 2022] PUT /identity/v3/projects/74139bf362d048ab9b82503e07619f22/users/aca2d4bb1ecd4ec5b9616f0e761c56c8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:11.819832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:11.820253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:11.820683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:11.870256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] MFA Rules not processed for user `aca2d4bb1ecd4ec5b9616f0e761c56c8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:11.871677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:11.963827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:11.987566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3265/6559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:12.000743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:12.003467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:12.062402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:12.095872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a758b-a1a5-42b7-a87e-f3d46dd7e19c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:12.100588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:12.101267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:12.101550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:12.101830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:12.117582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:12.119600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea488f4-42b9-4a4c-a524-d52885f80f86 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:12.137668 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3295/6560] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:12.244178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:12.244178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:12.255401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235e97-ccd1-4fb0-89e4-d1511193b54d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:12.259956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:12.260717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:12.261110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:12.261455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:12.335933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:12.337900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:12.353132 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3266/6561] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:12.822173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:12.822803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:12.823174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:12.847905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] MFA Rules not processed for user `2ed5143e191a43cc892a9428a2a8376c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:12.849156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:12.916890 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3296/6562] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:13.340244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:13.342615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:13.431548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94941fc-15c9-4d56-aef4-8999e7ad3370 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:13.435282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:13.435974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:13.436395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:13.436567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:13.438716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:13.452502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:13.453951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba26b03-b8a7-4f5e-9a03-25cb4fdd8160 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:13.465684 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3267/6563] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:22.560629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:22.670508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfc212-ba53-43b8-888e-b5b6c35ecda3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:22.676195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:22.677336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:22.677772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:22.678363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] PATH_INFO: `/v3/users/19a821cb38e94517a154ef61fe994f3c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:22.679959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a821cb38e94517a154ef61fe994f3c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:22.681909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:22.760314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a821cb38e94517a154ef61fe994f3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:22.772371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a821cb38e94517a154ef61fe994f3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:22.773314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a821cb38e94517a154ef61fe994f3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:22.774047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a821cb38e94517a154ef61fe994f3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:22.791316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a821cb38e94517a154ef61fe994f3c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:22.805875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:22.820038 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3297/6564] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:22 2022] DELETE /identity/v3/users/19a821cb38e94517a154ef61fe994f3c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:22.821901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:22.822381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:22.822645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:22.858767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:22.860243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:22.972357 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3268/6565] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:22.985807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:22.988274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:23.090587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6f9cf-9f13-44d3-ac03-4621ca64e33b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:23.095034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:23.097454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:23.097747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:23.098034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:23.110299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:23.112691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:23.126510 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3298/6566] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:23.688458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:23.690084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:23.702133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bd830-245e-4c89-9e4c-e05cb5fdcea1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:23.708245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:23.709145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:23.709430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:23.709712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] PATH_INFO: `/v3/projects/f1ece27e748544b38433cf664aca212b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:23.710966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ece27e748544b38433cf664aca212b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:23.712928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:23.751678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:23.769678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ece27e748544b38433cf664aca212b', 'request_id': 'req-86dbaa91-12ea-4b1c-831f-dc0d05061562'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.776501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ece27e748544b38433cf664aca212b', 'request_id': 'req-86dbaa91-12ea-4b1c-831f-dc0d05061562'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.782156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ece27e748544b38433cf664aca212b', 'request_id': 'req-86dbaa91-12ea-4b1c-831f-dc0d05061562'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.796418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] The token cache is being invalidate because project f1ece27e748544b38433cf664aca212b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:23.796791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.797529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.799406 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3269/6567] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:23 2022] DELETE /identity/v3/projects/f1ece27e748544b38433cf664aca212b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:23.803356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:23.813786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401c0b-17c4-475f-aefa-150dd902f38e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:23.881244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:23.882297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:23.882693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:23.883096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] PATH_INFO: `/v3/users/aca2d4bb1ecd4ec5b9616f0e761c56c8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:23.884461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca2d4bb1ecd4ec5b9616f0e761c56c8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:23.886681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:23.950641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca2d4bb1ecd4ec5b9616f0e761c56c8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.958688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca2d4bb1ecd4ec5b9616f0e761c56c8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.960154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca2d4bb1ecd4ec5b9616f0e761c56c8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.960809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca2d4bb1ecd4ec5b9616f0e761c56c8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:23.985008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba55f5e7-3b38-4f66-955a-01e005261cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca2d4bb1ecd4ec5b9616f0e761c56c8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:24.008665 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3299/6568] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:23 2022] DELETE /identity/v3/users/aca2d4bb1ecd4ec5b9616f0e761c56c8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:25.310937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:25.312905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:25.327461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbaa91-12ea-4b1c-831f-dc0d05061562 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:25.400850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:25.401750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.402737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.402737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] PATH_INFO: `/v3/projects/74139bf362d048ab9b82503e07619f22` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.403552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=74139bf362d048ab9b82503e07619f22)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:25.405511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:25.464594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74139bf362d048ab9b82503e07619f22', 'request_id': 'req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.471161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74139bf362d048ab9b82503e07619f22', 'request_id': 'req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.476963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74139bf362d048ab9b82503e07619f22', 'request_id': 'req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.491649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] The token cache is being invalidate because project 74139bf362d048ab9b82503e07619f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:25.492383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.492650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.499696 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3270/6569] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:25 2022] DELETE /identity/v3/projects/74139bf362d048ab9b82503e07619f22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:25.501142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725737ed-665f-47e0-a53f-53d86d435123 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.502011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725737ed-665f-47e0-a53f-53d86d435123 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.502011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725737ed-665f-47e0-a53f-53d86d435123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.523850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-725737ed-665f-47e0-a53f-53d86d435123 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:25.524501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-725737ed-665f-47e0-a53f-53d86d435123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:25.539689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:25.582233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:25.584861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:25.619176 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3300/6570] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:25.627460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.627850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.628140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.647683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:25.649433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:25.662060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3301/6571] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:25.662938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:25.673193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5909f-ab60-4e26-9a4f-ba9d92694160 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:25.676282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:25.683282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:25.684763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.685124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.685513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.686389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:25.686736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:25.688700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:25.703853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9a3c6-0d52-4c5a-bc42-ee7ac14edbdf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:25.704534 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3302/6572] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:25.709852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:25.714826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:25.717098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.717392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.717669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] PATH_INFO: `/v3/users/4eccde33e4f44565b9e7ed25ba378948` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.719285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eccde33e4f44565b9e7ed25ba378948)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:25.722533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:25.723477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a29363-74ca-4e9a-8111-4cc495c52bde admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:25.729965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:25.730675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.731025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.732021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.732900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:25.734864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:25.791933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eccde33e4f44565b9e7ed25ba378948'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.793522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eccde33e4f44565b9e7ed25ba378948'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.795210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3303/6573] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:25 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:25.799538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:25.801351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:25.806748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eccde33e4f44565b9e7ed25ba378948'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.807704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eccde33e4f44565b9e7ed25ba378948'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.827278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eccde33e4f44565b9e7ed25ba378948'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:25.847829 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3271/6574] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:25 2022] DELETE /identity/v3/users/4eccde33e4f44565b9e7ed25ba378948 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:25.891876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431833f9-0ab1-4036-bd19-820af6f60c3b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:25.993983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:25.995160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:25.996567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:25.996916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:25.998092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.004675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.042818 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3304/6575] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:25 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:26.046769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.059255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692c52a-3386-4221-8af8-63fdba090a3b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.065147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.066086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.066209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.066534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.067281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.068987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.081424 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3272/6576] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:26.085457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.103567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68d660-4a88-4c70-bc8c-b550605e53a5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.122060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.122880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.125385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.126651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.129144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.139386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.142736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.145273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.147957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:26.164045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc105-0186-49a9-b43e-5fde800b4910 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.179318 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3305/6577] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:26.180384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.193998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779ff57-ebf3-4809-a227-95a81331b858 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.200360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.200860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.201249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.201627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.202626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.202743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] PATH_INFO: `/v3/projects/4f970c3882e940f98bab811c9fdd078a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.202980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.203429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] PATH_INFO: `/v3/projects/5d4fd6942c7b4ea299013645e172ea82/users/d7b6f0debb5542378f785148e1b259cf/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.204491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f970c3882e940f98bab811c9fdd078a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.211764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.234378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4fd6942c7b4ea299013645e172ea82, user_id=d7b6f0debb5542378f785148e1b259cf, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.238678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea388800-89b3-4996-952b-5a080930ca18 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.262462 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3306/6578] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:26 2022] PUT /identity/v3/projects/5d4fd6942c7b4ea299013645e172ea82/users/d7b6f0debb5542378f785148e1b259cf/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:26.276991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.277714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.278200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.334897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] MFA Rules not processed for user `d7b6f0debb5542378f785148e1b259cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:26.336954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.353209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f970c3882e940f98bab811c9fdd078a', 'request_id': 'req-cb464b8f-868b-487c-a7e5-f6762e64e92c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.381857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f970c3882e940f98bab811c9fdd078a', 'request_id': 'req-cb464b8f-868b-487c-a7e5-f6762e64e92c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.396074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f970c3882e940f98bab811c9fdd078a', 'request_id': 'req-cb464b8f-868b-487c-a7e5-f6762e64e92c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.416064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] The token cache is being invalidate because project 4f970c3882e940f98bab811c9fdd078a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:26.416435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.417713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.418751 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3273/6579] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:26 2022] DELETE /identity/v3/projects/4f970c3882e940f98bab811c9fdd078a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:26.422823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.427564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.471384 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3307/6580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:26.476162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.477920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.506718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:26.537489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb464b8f-868b-487c-a7e5-f6762e64e92c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.545595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.546783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.547091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.547457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] PATH_INFO: `/v3/users/4dde8cf2e9ee47239a8a5974c9aad25d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.549492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dde8cf2e9ee47239a8a5974c9aad25d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.551543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.574537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8e456-309c-462b-aee5-403bcbde3c83 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.589169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.590132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.593012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.593635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.594556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.600731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.643909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dde8cf2e9ee47239a8a5974c9aad25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.646198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dde8cf2e9ee47239a8a5974c9aad25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.651561 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3308/6581] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:26 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:26.658454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.662600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.677103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dde8cf2e9ee47239a8a5974c9aad25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.678154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dde8cf2e9ee47239a8a5974c9aad25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.715724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dde8cf2e9ee47239a8a5974c9aad25d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:26.739402 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3274/6582] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:26 2022] DELETE /identity/v3/users/4dde8cf2e9ee47239a8a5974c9aad25d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:26.745491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:26.778350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700ce14-25b4-4b44-8656-68a36c306aad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.799851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.801672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.888429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.889569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.890168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.890717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.891748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.897167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:26.922819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab584-4360-43a5-8409-52b042567198 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.927005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.927929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.928311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.928686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.930827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:26.950951 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3309/6583] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:26 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:26.952405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:26.975204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e17ae-9af4-4614-9aa7-bf03b4ed944d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:26.983785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:26.984514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:26.985032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:26.985188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:26.985828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:26.987869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.007443 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3310/6584] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:27.008615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.020858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f7a-20af-4b33-b686-943987fbdc74 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.025859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.026837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.027182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.027763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] PATH_INFO: `/v3/projects/3573c274294147bda53c20598fb0419d/users/f3e288b3ec744990afad64f23dbf26ac/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.034166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.035716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.046740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3573c274294147bda53c20598fb0419d, user_id=f3e288b3ec744990afad64f23dbf26ac, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.051019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.067146 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3275/6585] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:27.068317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.071863 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3311/6586] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:27 2022] PUT /identity/v3/projects/3573c274294147bda53c20598fb0419d/users/f3e288b3ec744990afad64f23dbf26ac/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:27.076451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.079989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.096239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96481629-1e2a-4e4b-a7b4-226447219d4b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.100306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:27.173801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fb7ce-d54a-4665-b1fd-6162edfa3b9e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.178075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.179250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.179983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.180271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.180507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.180723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.181464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.181747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.182123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] PATH_INFO: `/v3/projects/0edd1e39bfca4722b80781460bc0d06f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.183277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.183876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edd1e39bfca4722b80781460bc0d06f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.186576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.199147 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3312/6587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:27.203576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.216516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1774087-978a-4dbd-a91a-3fff4718176d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.223233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.228202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.232595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.233062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] PATH_INFO: `/v3/projects/3573c274294147bda53c20598fb0419d/users/f3e288b3ec744990afad64f23dbf26ac/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.236969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3573c274294147bda53c20598fb0419d, user_id=f3e288b3ec744990afad64f23dbf26ac, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.241089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a875374-9d45-4957-bcfe-8280a459d465 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.251604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edd1e39bfca4722b80781460bc0d06f', 'request_id': 'req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.259367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3313/6588] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:27 2022] PUT /identity/v3/projects/3573c274294147bda53c20598fb0419d/users/f3e288b3ec744990afad64f23dbf26ac/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:27.260453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edd1e39bfca4722b80781460bc0d06f', 'request_id': 'req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.267024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edd1e39bfca4722b80781460bc0d06f', 'request_id': 'req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.270959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.271157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.271460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.287921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] The token cache is being invalidate because project 0edd1e39bfca4722b80781460bc0d06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:27.288396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.289213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8a4eaf6d-9fe1-4e97-94a6-c09d8c7fd13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.294895 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3276/6589] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:27 2022] DELETE /identity/v3/projects/0edd1e39bfca4722b80781460bc0d06f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:27.298221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78a6f-9ed7-419b-b766-d6e67684d0cc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.298658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78a6f-9ed7-419b-b766-d6e67684d0cc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.299038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a78a6f-9ed7-419b-b766-d6e67684d0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.308227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] MFA Rules not processed for user `f3e288b3ec744990afad64f23dbf26ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:27.309650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.322850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a0a78a6f-9ed7-419b-b766-d6e67684d0cc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:27.324491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0a78a6f-9ed7-419b-b766-d6e67684d0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.335720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:27.399540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3277/6590] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:27.408408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.408703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.408975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.429323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:27.430998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.439369 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3314/6591] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:27.443997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3278/6592] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:27.455673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.456785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.458093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.478287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb3f5a-9f5c-4cfd-8dbd-8f8ca448ad19 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.490065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.491127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.491687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.492187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.493161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:27.493678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.495913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.513685 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3315/6593] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:27.517924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.518904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:27.541897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e76e8e-94c9-41fb-83ed-60dc11c0fc8d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.547907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.549163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.549723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.550207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.551612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.553775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.559486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389b20-afe6-4fb3-a61d-b11316069a28 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.564985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.565896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.566479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.567135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.592005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.597201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.601284 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3316/6594] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:27.605831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.612742 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3279/6595] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:27.696538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762815-fb43-4357-804c-ba5996dc326f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.719658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.721438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.721930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.722220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.722930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.725306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.772055 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3317/6596] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:27.773144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.788572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ad8d4-bc0d-4d10-8f9d-57a4bfe841d3 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.793698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.794494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.794845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.795186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.796349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.798609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.813507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.816155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:27.819361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3280/6597] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:27.820289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.832856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdc1e2-3e68-43e3-a54e-dd8bb6b8c743 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.837965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.838947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.839162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd2a8-c29f-4b81-994b-4a0d57d4ebed admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.839773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.840134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] PATH_INFO: `/v3/users/d7b6f0debb5542378f785148e1b259cf` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.841874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b6f0debb5542378f785148e1b259cf)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.844795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.849462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.850601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.853992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.854285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.855085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.857790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.879425 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3281/6598] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:27.890829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:27.907349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857d4d-be90-4c4a-978a-2fa7a5e82301 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:27.922003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b6f0debb5542378f785148e1b259cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.922679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:27.924044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.924329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.924629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] PATH_INFO: `/v3/projects/ae5b4422e97e438596c8bc7267044fcc/users/2aeb7a48fd324a90a2eb1ecdd5ea8884/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:27.938045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b6f0debb5542378f785148e1b259cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.938993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b6f0debb5542378f785148e1b259cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.939809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b6f0debb5542378f785148e1b259cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.950218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:27.958707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d0f1c68-b512-4938-887b-c427e2844a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b6f0debb5542378f785148e1b259cf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:27.974162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5b4422e97e438596c8bc7267044fcc, user_id=2aeb7a48fd324a90a2eb1ecdd5ea8884, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:27.984695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298a74-9c16-4104-a104-37e1109e0a3f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:27.989969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3318/6599] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:27 2022] DELETE /identity/v3/users/d7b6f0debb5542378f785148e1b259cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:27.994906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:27.995481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:27.995866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.014358 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3282/6600] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:27 2022] PUT /identity/v3/projects/ae5b4422e97e438596c8bc7267044fcc/users/2aeb7a48fd324a90a2eb1ecdd5ea8884/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:28.025334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.025678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.025954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.053443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:28.055229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:28.072258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] MFA Rules not processed for user `2aeb7a48fd324a90a2eb1ecdd5ea8884`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:28.073578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:28.150436 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3319/6601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:28.167062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3283/6602] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:28.168154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.169679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:28.171154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.172716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:28.204490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7d01e-dada-4d53-8b74-2a18f24f2334 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.215944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.218849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.219319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.219802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.223218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.225284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.261524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893cfa2-797f-4471-bc88-69c1ee02477f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.269788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.270510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.270874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.271500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.280979 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3284/6603] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:28.292716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.314653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.320490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.340299 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3320/6604] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:28.414328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:28.422210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bab3a-a791-489f-9b99-aac8c52761f2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.431434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.432554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.433615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.433967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.435468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.438472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.475607 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3285/6605] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:28.480166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.492039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4069-6087-4b4c-8052-411a744de0ab service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.496972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.497648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.497931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.498206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.499087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.500785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.515555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3321/6606] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:28.519467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.536844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c24f9-eded-4338-8005-be8f781a97f4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.542635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.543351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.543923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.544203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.544937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.547200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69921f1-7d88-4aa1-8b7c-2c9ffbaf604e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.560452 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3286/6607] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:28.566782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.579031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e81ca2-d9b6-45f6-81e3-a7d81b3731a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.584874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.585787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.586070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.586347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] PATH_INFO: `/v3/projects/7b9a1357d3e64d88b9ec972af04ac8da/users/5915fde77c304bc6aaab401e993e200a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.606374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9a1357d3e64d88b9ec972af04ac8da, user_id=5915fde77c304bc6aaab401e993e200a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.610265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.629546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3322/6608] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:28 2022] PUT /identity/v3/projects/7b9a1357d3e64d88b9ec972af04ac8da/users/5915fde77c304bc6aaab401e993e200a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:28.640220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.640220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.640220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.687347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] MFA Rules not processed for user `5915fde77c304bc6aaab401e993e200a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:28.688650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:28.781665 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3287/6609] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:28.784965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.851883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:28.869637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ab6d-d908-44e5-b453-d3ab3dc55fb5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:28.876314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:28.877373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:28.878099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:28.879726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:28.881156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:28.884586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:28.940076 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3323/6610] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:28.942617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:28.961560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907389df-29cf-48a8-872d-213c96d14a40 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.028383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.029082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.029409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.029694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.030540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.033102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.062964 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3288/6611] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:28 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:29.066400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.085080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07960-478e-40fb-8893-100d3d9dfa31 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.093432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.094343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.094703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.095551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.097014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.104752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.122622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3324/6612] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:29.126975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.138273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33740-996a-4589-b6ff-7630f31e13ad admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.146544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.147829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.148027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.148402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] PATH_INFO: `/v3/projects/2c93e71453f84297b8287810730ed88f/users/79065e78ccac480694e195dcb50dc306/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.168597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c93e71453f84297b8287810730ed88f, user_id=79065e78ccac480694e195dcb50dc306, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.171430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.190834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3289/6613] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:29 2022] PUT /identity/v3/projects/2c93e71453f84297b8287810730ed88f/users/79065e78ccac480694e195dcb50dc306/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:29.195315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.219691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8f61-e131-474d-9ef6-fa40cad6cb02 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.276868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.279277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:29.297476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.299108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.299108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.299784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.301041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.302699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.317827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3325/6614] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:29.321643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.337673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:29.340092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6f8e6-b6c2-4900-953a-aa89b3149158 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.356698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.358248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.358700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.360031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] PATH_INFO: `/v3/projects/2c93e71453f84297b8287810730ed88f/users/79065e78ccac480694e195dcb50dc306/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.363240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c93e71453f84297b8287810730ed88f, user_id=79065e78ccac480694e195dcb50dc306, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.366532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653a2d7-a6b5-49ab-9cf7-ec549ad6e583 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.382876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1c5a-3eb7-4845-a243-e8132d8b5354 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.418181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3326/6615] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:29 2022] PUT /identity/v3/projects/2c93e71453f84297b8287810730ed88f/users/79065e78ccac480694e195dcb50dc306/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:29.528378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.529437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.529928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.530303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] PATH_INFO: `/v3/projects/5d4fd6942c7b4ea299013645e172ea82` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.531739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4fd6942c7b4ea299013645e172ea82)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.534865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.545473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.546076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.546508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.605717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] MFA Rules not processed for user `79065e78ccac480694e195dcb50dc306`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:29.607087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:29.610229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4fd6942c7b4ea299013645e172ea82', 'request_id': 'req-2b07aca7-e20d-412a-ac2f-c96f3180642a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.618496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4fd6942c7b4ea299013645e172ea82', 'request_id': 'req-2b07aca7-e20d-412a-ac2f-c96f3180642a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.626671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4fd6942c7b4ea299013645e172ea82', 'request_id': 'req-2b07aca7-e20d-412a-ac2f-c96f3180642a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.657487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] The token cache is being invalidate because project 5d4fd6942c7b4ea299013645e172ea82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:29.657835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.658991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.661573 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3290/6616] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:29 2022] DELETE /identity/v3/projects/5d4fd6942c7b4ea299013645e172ea82 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:29.665774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.667632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:29.703317 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3327/6617] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:29.719168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:29.722520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:29.765907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07aca7-e20d-412a-ac2f-c96f3180642a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.775341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.777334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.777708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.778131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] PATH_INFO: `/v3/users/f3e288b3ec744990afad64f23dbf26ac` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.781003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e288b3ec744990afad64f23dbf26ac)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.784457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.786224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:29.804850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:29.828505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c88e-18f6-4d3b-9801-a3137d789d14 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:29.834635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:29.835731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:29.836196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:29.836643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:29.839703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:29.865269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e288b3ec744990afad64f23dbf26ac'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.870070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e288b3ec744990afad64f23dbf26ac'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.883924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e288b3ec744990afad64f23dbf26ac'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.889138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e288b3ec744990afad64f23dbf26ac'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.911009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e288b3ec744990afad64f23dbf26ac'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:29.916760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:29.919003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:29.931179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3328/6618] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:29.940647 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3291/6619] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:29 2022] DELETE /identity/v3/users/f3e288b3ec744990afad64f23dbf26ac => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:31.173199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.193199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0293-97be-43a0-8fda-cbbaec272bda service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:31.276293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:31.277342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.277717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.278086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] PATH_INFO: `/v3/projects/3573c274294147bda53c20598fb0419d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.279960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3573c274294147bda53c20598fb0419d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:31.282359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:31.364572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3573c274294147bda53c20598fb0419d', 'request_id': 'req-f777a0e2-9315-4475-96b5-3383fb44d6ae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:31.374705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3573c274294147bda53c20598fb0419d', 'request_id': 'req-f777a0e2-9315-4475-96b5-3383fb44d6ae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:31.385742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3573c274294147bda53c20598fb0419d', 'request_id': 'req-f777a0e2-9315-4475-96b5-3383fb44d6ae'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:31.408074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] The token cache is being invalidate because project 3573c274294147bda53c20598fb0419d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:31.408444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:31.409132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f777a0e2-9315-4475-96b5-3383fb44d6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:31.411113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.414806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3329/6620] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:31 2022] DELETE /identity/v3/projects/3573c274294147bda53c20598fb0419d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:31.416386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391dcd-d314-4a6a-94b0-918c0db21ae9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.416677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391dcd-d314-4a6a-94b0-918c0db21ae9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.417163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:31.417347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f391dcd-d314-4a6a-94b0-918c0db21ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.442702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8f391dcd-d314-4a6a-94b0-918c0db21ae9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:31.444289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8f391dcd-d314-4a6a-94b0-918c0db21ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:31.462653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:31.590380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd1db-1af2-4729-b2b0-0557bb4830c9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:31.605476 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3330/6621] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:31.616417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.616716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.616998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.661342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:31.667175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:31.687308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:31.689040 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3331/6622] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:31.689486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.689785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.690065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.693011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.697229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:31.717313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050160b3-7091-4c08-a315-9274a8f5fbf1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:31.724933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:31.725812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.726090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.726520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.727274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:31.727583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:31.729383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:31.744926 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3332/6623] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:31.752425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.765785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:31.772706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dae605-8896-4139-9c2c-9a026a4c6ba6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:31.780656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:31.782367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:31.783103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:31.783644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:31.786956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:31.790785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:31.864195 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3333/6624] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:31 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:31.865400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.924658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:31.929969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:31.977090 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3292/6625] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:31.978754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:31.982488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:32.039826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455a9c-5cee-42f4-97d0-06251fbf8cfd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.064396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.065111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.065398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.065680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.066409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.068401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.124029 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3334/6626] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:31 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:32.133103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:32.134679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca55dd-d8c8-4e41-958d-bc12fac9174b service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.155191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b671be-a283-41f2-8531-d3cbe05a0bc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.167666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.169723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.170233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.170830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.172938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.176294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.202470 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3335/6627] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:32.204352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:32.245748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93e0d-f875-40c2-8504-550c5b171068 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.263089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.263829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.264117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.264396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.265141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.266783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.283774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.284696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.287687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.288222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.292235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:32.304793 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3336/6628] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:32.306925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:32.363178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734b6f-32a2-4f5f-964c-ea478d286adc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.392359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.393297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.393982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.394271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] PATH_INFO: `/v3/projects/b6589dfa7d7a45bfb5a7b185671fb6de/users/710c370801e54337b7b84a31f7bdfcca/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.447834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6589dfa7d7a45bfb5a7b185671fb6de, user_id=710c370801e54337b7b84a31f7bdfcca, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.452370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1e2dc-cb0c-4ecf-b614-33f6e9123ba5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.495378 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3337/6629] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:32 2022] PUT /identity/v3/projects/b6589dfa7d7a45bfb5a7b185671fb6de/users/710c370801e54337b7b84a31f7bdfcca/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:32.508166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.508464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.508876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.513229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.514712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.553038 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3293/6630] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:32.577816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] MFA Rules not processed for user `710c370801e54337b7b84a31f7bdfcca`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:32.578780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:32.602525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:32.754219 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3338/6631] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:32.759348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:32.785561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e353-ab29-4cd8-8961-480e744f5ceb service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:32.884421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:32.926913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:32.926913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:32.927415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:32.927820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:32.928893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:32.931286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:32.969145 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3294/6632] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:32 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:32.969740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:32.983365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206306c0-47bb-448e-aa55-b2413a605124 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.097750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.098861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.099212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.099605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.100628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.102881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.143820 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3339/6633] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:32 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:33.145684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.161871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff8a6-94eb-4d9d-b7f6-34151832d051 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.168412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.168819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.169133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.170018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.171159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.172821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.207451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.215862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3295/6634] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:33.222675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56ea5-d16d-4b27-9700-1c94b02a74b3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.229224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.231552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.231960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.232336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] PATH_INFO: `/v3/projects/d7a40889230b480296156430e03dfecd/users/7d1b4b46eb974214a9c0eb6bf1415d81/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.256997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a40889230b480296156430e03dfecd, user_id=7d1b4b46eb974214a9c0eb6bf1415d81, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.268306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.315560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3340/6635] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:33 2022] PUT /identity/v3/projects/d7a40889230b480296156430e03dfecd/users/7d1b4b46eb974214a9c0eb6bf1415d81/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:33.319883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.339580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842b626-9701-4c9a-bd09-02e356eb5c06 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.482370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.483092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.483376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.483701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.484807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.486644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fe9c2-8d51-493d-bc58-36b18274e89b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.506200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.508195 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3296/6636] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:33.529080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eee887-f55e-4932-8383-a7eda3154e1e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.543224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.545510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.545809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.546093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] PATH_INFO: `/v3/projects/d7a40889230b480296156430e03dfecd/users/7d1b4b46eb974214a9c0eb6bf1415d81/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.555682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a40889230b480296156430e03dfecd, user_id=7d1b4b46eb974214a9c0eb6bf1415d81, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.558450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.584356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3341/6637] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:33 2022] PUT /identity/v3/projects/d7a40889230b480296156430e03dfecd/users/7d1b4b46eb974214a9c0eb6bf1415d81/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:33.594939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.595575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.595825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.649431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] MFA Rules not processed for user `7d1b4b46eb974214a9c0eb6bf1415d81`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:33.651198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:33.804797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3297/6638] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:33.810108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.889915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db528251-886d-4f5a-969a-dbd20003a9d4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.893765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.894896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.895324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.895801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.911660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:33.911660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:33.926880 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3342/6639] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:33.964930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:33.966671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:33.983118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94f34-bde3-4c29-8ee6-2a85ef554e94 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:33.988305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:33.989047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:33.989399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:33.989765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:33.992730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:34.031988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:34.097517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:34.106580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:34.113981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3498d7c-d520-4cbd-8cb3-7b324293ba5b service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:34.121467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:34.125492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:34.126170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:34.127037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:34.128248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:34.129869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:34.143813 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3298/6640] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:34.211108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:34.213467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc953153-c5cc-42fa-8779-8ee8eab4dd3d service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:34.224751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3343/6641] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:34.641657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:34.763786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671aba8-773f-46cd-b8eb-dc7899a45f77 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:34.771727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:34.772765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:34.773141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:34.773456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] PATH_INFO: `/v3/users/710c370801e54337b7b84a31f7bdfcca` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:34.774801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710c370801e54337b7b84a31f7bdfcca)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:34.778990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:34.853161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710c370801e54337b7b84a31f7bdfcca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:34.854105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710c370801e54337b7b84a31f7bdfcca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:34.871384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710c370801e54337b7b84a31f7bdfcca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:34.872282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710c370801e54337b7b84a31f7bdfcca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:34.900209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710c370801e54337b7b84a31f7bdfcca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:34.933024 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3299/6642] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:34 2022] DELETE /identity/v3/users/710c370801e54337b7b84a31f7bdfcca => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:34.934881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:34.934881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:34.934881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:34.962760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:34.964049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:35.116160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3344/6643] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:35.128051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:35.130016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:35.194461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:35.217929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a626a-048d-4af2-bece-0ecaf25e0ba2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:35.222123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:35.222779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:35.223057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:35.223335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:35.234280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:35.235792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:35.247130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3300/6644] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:35.603801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:35.605845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:35.627265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023b410-db64-4cb6-a362-f6760f250974 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:35.636093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:35.637206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:35.637626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:35.638118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] PATH_INFO: `/v3/projects/b6589dfa7d7a45bfb5a7b185671fb6de` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:35.640762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6589dfa7d7a45bfb5a7b185671fb6de)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:35.644667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:35.720005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6589dfa7d7a45bfb5a7b185671fb6de', 'request_id': 'req-ce3cd9e0-419e-4278-b371-671b7d96563b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.730227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6589dfa7d7a45bfb5a7b185671fb6de', 'request_id': 'req-ce3cd9e0-419e-4278-b371-671b7d96563b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.748593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6589dfa7d7a45bfb5a7b185671fb6de', 'request_id': 'req-ce3cd9e0-419e-4278-b371-671b7d96563b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.774143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] The token cache is being invalidate because project b6589dfa7d7a45bfb5a7b185671fb6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:35.774644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.775726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.777678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3345/6645] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:35 2022] DELETE /identity/v3/projects/b6589dfa7d7a45bfb5a7b185671fb6de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:35.782176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:35.793639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89353b-5546-4d23-9c3f-06fb79fbbb38 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:35.859969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:35.861189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:35.862247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:35.862388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] PATH_INFO: `/v3/users/7d1b4b46eb974214a9c0eb6bf1415d81` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:35.863667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1b4b46eb974214a9c0eb6bf1415d81)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:35.865621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:35.927492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1b4b46eb974214a9c0eb6bf1415d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.928734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1b4b46eb974214a9c0eb6bf1415d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.943892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1b4b46eb974214a9c0eb6bf1415d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.944717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1b4b46eb974214a9c0eb6bf1415d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.968036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1abc177b-456a-403c-a0ac-cacfb3d14c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1b4b46eb974214a9c0eb6bf1415d81'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:35.984282 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3301/6646] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:35 2022] DELETE /identity/v3/users/7d1b4b46eb974214a9c0eb6bf1415d81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:36.497927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:36.499688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:36.519367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cd9e0-419e-4278-b371-671b7d96563b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:36.552489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:36.607027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:36.613096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:36.613387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:36.613978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] PATH_INFO: `/v3/projects/d7a40889230b480296156430e03dfecd` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:36.615414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a40889230b480296156430e03dfecd)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:36.617464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:36.705066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a40889230b480296156430e03dfecd', 'request_id': 'req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:36.713105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a40889230b480296156430e03dfecd', 'request_id': 'req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:36.720696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a40889230b480296156430e03dfecd', 'request_id': 'req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:36.757623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] The token cache is being invalidate because project d7a40889230b480296156430e03dfecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:36.758473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:36.759620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fad7a8e8-0716-45b6-82f2-9d02bdf8189c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:36.762045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3346/6647] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:36 2022] DELETE /identity/v3/projects/d7a40889230b480296156430e03dfecd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:36.767046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:36.769050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:36.769050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:36.795719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:36.797897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:36.903734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3302/6648] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:36.906912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:36.907208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:36.907559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:36.938792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:36.942031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:36.970359 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3347/6649] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:36.972290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:36.979612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:37.002526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add11557-f2a3-4fb8-b9c2-11c788e1e633 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.009001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.009979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.010475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.011036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.012295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:37.012811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.014866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.047583 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3303/6650] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:37.050361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.062963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ff5a-c4ac-4f46-9696-deb278a04bbb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.069154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.070002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.070289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.070568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.071265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.073514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.118043 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3348/6651] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:37 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:37.122633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.157627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48599a-29d9-46e4-bc6c-c69ea6285b19 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.280073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.281275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.281660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.282158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.284141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.287071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.338056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3304/6652] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:37 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:37.339477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.355789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741daba-79b2-4167-8cd1-3045a0ef1a07 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.383230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.385857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.386243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.386507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.387280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.396945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.411431 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3349/6653] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:37.424713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.428968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83b62-f5ed-4a96-aaa0-ad8036b29be0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.449142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.449142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.449142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.449389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.452072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.462664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef9822-e609-4b1d-a624-846911ca589a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.476574 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3305/6654] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:37.481779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.498167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94b94-2e07-4b0c-992b-cb3c360f4978 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:37.505376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:37.508426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.508724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.509008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] PATH_INFO: `/v3/projects/cc587e92487b47e8ae3b1659e8a295f4/users/da4086f97d674f4b949827fc47be7acd/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.553714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc587e92487b47e8ae3b1659e8a295f4, user_id=da4086f97d674f4b949827fc47be7acd, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:37.556752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:37.610518 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3350/6655] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:37 2022] PUT /identity/v3/projects/cc587e92487b47e8ae3b1659e8a295f4/users/da4086f97d674f4b949827fc47be7acd/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:37.618385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:37.618705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:37.619213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:37.694425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] MFA Rules not processed for user `da4086f97d674f4b949827fc47be7acd`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:37.695706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:37.824408 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3306/6656] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:37.836468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:37.840122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:38.001812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd23-8462-4012-aebc-d69b50ad93c1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:38.012500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:38.013671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.013962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.014354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.035994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:38.039546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:38.043196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55a21f-e3ad-40c3-8fc6-dbb29daf763c service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:38.076756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3351/6657] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:38.104882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:38.234130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:38.244015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ee774-5309-4ed0-9942-84e04ed9460a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:38.257706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:38.258627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.260715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.261013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] PATH_INFO: `/v3/users/da4086f97d674f4b949827fc47be7acd` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.262533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4086f97d674f4b949827fc47be7acd)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:38.273304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:38.358358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4086f97d674f4b949827fc47be7acd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.369249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4086f97d674f4b949827fc47be7acd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.390152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4086f97d674f4b949827fc47be7acd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.390152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4086f97d674f4b949827fc47be7acd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.428081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4086f97d674f4b949827fc47be7acd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.450224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3307/6658] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:38 2022] DELETE /identity/v3/users/da4086f97d674f4b949827fc47be7acd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:38.455279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.455826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.456215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.491956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:38.493649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:38.554031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:38.556608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:38.650698 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3352/6659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:38.673485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:38.675341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:38.693517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6bd78-35bd-4108-b656-975a8010ecb5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:38.707070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:38.708053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.708338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.708670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] PATH_INFO: `/v3/users/2aeb7a48fd324a90a2eb1ecdd5ea8884` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.709962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aeb7a48fd324a90a2eb1ecdd5ea8884)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:38.712704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:38.789840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac1c9-6eaa-426b-bcde-2fe25f0bd5cd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:38.795723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aeb7a48fd324a90a2eb1ecdd5ea8884'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.798705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aeb7a48fd324a90a2eb1ecdd5ea8884'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.799931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:38.800250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.800606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.800842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.811011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:38.829063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aeb7a48fd324a90a2eb1ecdd5ea8884'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.829819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:38.830906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741aaa-43ff-450f-8177-0af652bc64e9 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:38.831225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aeb7a48fd324a90a2eb1ecdd5ea8884'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.844022 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3353/6660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:38.854445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aeb7a48fd324a90a2eb1ecdd5ea8884'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:38.859892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:38.879133 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3308/6661] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:38 2022] DELETE /identity/v3/users/2aeb7a48fd324a90a2eb1ecdd5ea8884 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:38.880714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:38.884588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:38.884988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:38.928237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:38.933733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:39.045885 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3354/6662] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:39.063041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:39.065487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:39.212463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3bf6e-8a07-4b47-882b-285480984b82 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:39.217403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:39.218207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:39.218523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:39.218646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:39.248519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:39.250160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:39.265905 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3309/6663] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:40.143228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.145955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.165440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb30396-7ea9-4cf0-8caa-c8228f4a7baf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:40.176106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:40.177753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.178434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.179762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] PATH_INFO: `/v3/projects/ae5b4422e97e438596c8bc7267044fcc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.182867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5b4422e97e438596c8bc7267044fcc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:40.190445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:40.240313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.243129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.268795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc1ac-6164-4662-ba89-3a118ce31c20 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:40.284096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:40.285007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.287598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.287860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] PATH_INFO: `/v3/projects/cc587e92487b47e8ae3b1659e8a295f4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.289194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc587e92487b47e8ae3b1659e8a295f4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:40.293491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:40.297440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:40.335550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5b4422e97e438596c8bc7267044fcc', 'request_id': 'req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.353943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5b4422e97e438596c8bc7267044fcc', 'request_id': 'req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.364470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5b4422e97e438596c8bc7267044fcc', 'request_id': 'req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.399827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] The token cache is being invalidate because project ae5b4422e97e438596c8bc7267044fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:40.400172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.401150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.407716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3355/6664] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:40 2022] DELETE /identity/v3/projects/ae5b4422e97e438596c8bc7267044fcc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:40.408953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.410620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.435524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc587e92487b47e8ae3b1659e8a295f4', 'request_id': 'req-92840c28-bf0e-4d5b-9909-8c1a2529b72d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.445718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc587e92487b47e8ae3b1659e8a295f4', 'request_id': 'req-92840c28-bf0e-4d5b-9909-8c1a2529b72d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.455868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc587e92487b47e8ae3b1659e8a295f4', 'request_id': 'req-92840c28-bf0e-4d5b-9909-8c1a2529b72d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.492818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] The token cache is being invalidate because project cc587e92487b47e8ae3b1659e8a295f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:40.493321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.494168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-92840c28-bf0e-4d5b-9909-8c1a2529b72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.503547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3310/6665] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:40 2022] DELETE /identity/v3/projects/cc587e92487b47e8ae3b1659e8a295f4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:40.511330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512f86-5f63-4825-9e77-65b96be535f3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.511655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512f86-5f63-4825-9e77-65b96be535f3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.512096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512f86-5f63-4825-9e77-65b96be535f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.521999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bc5b6-e0b3-47ae-916e-c9e34bd81546 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:40.555785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-19512f86-5f63-4825-9e77-65b96be535f3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:40.558289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19512f86-5f63-4825-9e77-65b96be535f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.627868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:40.629124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.629544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.630444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] PATH_INFO: `/v3/users/5915fde77c304bc6aaab401e993e200a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.632460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5915fde77c304bc6aaab401e993e200a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:40.635160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:40.641524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3311/6666] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:40.651056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.651349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.651672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.702867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:40.704650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.737074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5915fde77c304bc6aaab401e993e200a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.738704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3312/6667] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:40.742937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.755937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5915fde77c304bc6aaab401e993e200a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.756786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5915fde77c304bc6aaab401e993e200a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.757417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5915fde77c304bc6aaab401e993e200a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.762509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afade7b-1564-4f5e-ad18-353b977376bf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:40.772004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:40.773128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:40.774866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.775114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5915fde77c304bc6aaab401e993e200a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:40.775764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.776389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.777955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:40.779022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:40.782272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:40.803705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3313/6668] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:14:40.806835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.813795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3356/6669] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:40 2022] DELETE /identity/v3/users/5915fde77c304bc6aaab401e993e200a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:40.815751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:40.827998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:40.835956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b7fe-2f87-48ad-b562-d90a6cd91c64 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:40.926775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:40.927495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:40.927816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:40.928219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:40.928926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:40.930867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:40.971581 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3314/6670] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:40.975838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:40.989874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7a20-9e33-4d1d-8315-83e0600cc611 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.090402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.093411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.094179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.094607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.096001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.098133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.125205 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3357/6671] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:40 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:41.129394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.146051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a78a1-7739-4c0c-8b3a-f1e0acc7dc27 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.154026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.154760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.155001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.155274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.156251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.159576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.190769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3315/6672] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:41.195794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.207186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859991-78c1-4261-9d2b-df8efbbc3bfe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.212977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.213959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.214321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.214670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.215870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.217934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6b44-5d5e-475e-bb71-ab5c0f11ddaa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.240211 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3358/6673] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:41.244403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.256716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ed43-b840-4a09-b54b-aad3d2112bd0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.266484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.268247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.271931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.272364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] PATH_INFO: `/v3/projects/5659e9dc2b6c4801bb25d9b326a19849/users/8d640908c4a243ab941f3edb154ccf31/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.293872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5659e9dc2b6c4801bb25d9b326a19849, user_id=8d640908c4a243ab941f3edb154ccf31, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.298194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.347891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3316/6674] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:41 2022] PUT /identity/v3/projects/5659e9dc2b6c4801bb25d9b326a19849/users/8d640908c4a243ab941f3edb154ccf31/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:41.360098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.360712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.361192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.406797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] MFA Rules not processed for user `8d640908c4a243ab941f3edb154ccf31`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:41.408678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:41.487952 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3359/6675] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:41.492832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.630883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465a2a-f098-4a65-b034-cc55c171aacd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.636773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.637686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.638210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.638676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.639152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.641553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.690847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3317/6676] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:41 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:41.692119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.710301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acbf02-4f5c-45fd-8327-6c7662271c52 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.795087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:41.802840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.803850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.804294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.804730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.806322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.809192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.849161 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3360/6677] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:41 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:41.853781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.882056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598de9-5326-4770-989c-20c8c2203e9c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.894125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.895172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.895670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.896114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.901523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.903431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3cfe46-68a2-4961-88e4-8b49fb177122 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:41.920385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3318/6678] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:41.921389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:41.940537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f52df-56b3-4e58-9ca0-05e541f55e71 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:41.946184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:41.947278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:41.947768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:41.948355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] PATH_INFO: `/v3/projects/fa6fbc30639f4c09bcde041cd30eb87e/users/7bcf574cfd3248b886925ed54753c17d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:41.973320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6fbc30639f4c09bcde041cd30eb87e, user_id=7bcf574cfd3248b886925ed54753c17d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:41.977266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:42.004722 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3361/6679] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:41 2022] PUT /identity/v3/projects/fa6fbc30639f4c09bcde041cd30eb87e/users/7bcf574cfd3248b886925ed54753c17d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:42.015419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:42.019198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:42.019198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:42.055879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] MFA Rules not processed for user `7bcf574cfd3248b886925ed54753c17d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:42.058919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:42.094196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:42.208517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3319/6680] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3257 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:42.276842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:42.284474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:42.303493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:42.305173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:42.411995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33f06a-d1fa-44d9-a0b1-c5556ee1be0d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:42.420634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:42.421766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:42.422091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:42.422373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] PATH_INFO: `/v3/projects/7b9a1357d3e64d88b9ec972af04ac8da` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:42.424547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9a1357d3e64d88b9ec972af04ac8da)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:42.427224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:42.451166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84ee87-86ef-43c3-a8af-1d49429be565 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:42.458534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:42.459145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:42.459431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:42.475001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:42.498076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:42.499780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:42.520075 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3362/6681] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 676 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:42.521142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9a1357d3e64d88b9ec972af04ac8da', 'request_id': 'req-9d158473-7e2b-4f0d-9295-9dc6532d4cda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.528908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9a1357d3e64d88b9ec972af04ac8da', 'request_id': 'req-9d158473-7e2b-4f0d-9295-9dc6532d4cda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.540334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9a1357d3e64d88b9ec972af04ac8da', 'request_id': 'req-9d158473-7e2b-4f0d-9295-9dc6532d4cda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.575085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] The token cache is being invalidate because project 7b9a1357d3e64d88b9ec972af04ac8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:42.575578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.583854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.586070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3320/6682] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:42 2022] DELETE /identity/v3/projects/7b9a1357d3e64d88b9ec972af04ac8da => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:42.591059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:42.605660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86554fb-58ae-4114-810c-52bd323ad13a service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:42.705636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:42.706747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:42.707037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:42.707316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] PATH_INFO: `/v3/users/79065e78ccac480694e195dcb50dc306` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:42.708619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79065e78ccac480694e195dcb50dc306)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:42.710919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:42.773019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:42.787336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79065e78ccac480694e195dcb50dc306'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.807071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79065e78ccac480694e195dcb50dc306'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.807976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79065e78ccac480694e195dcb50dc306'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.808638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79065e78ccac480694e195dcb50dc306'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.835779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79065e78ccac480694e195dcb50dc306'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:42.860991 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3363/6683] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:42 2022] DELETE /identity/v3/users/79065e78ccac480694e195dcb50dc306 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:43.660366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:43.661847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:43.710673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158473-7e2b-4f0d-9295-9dc6532d4cda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:43.721187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:43.723026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:43.887273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:43.917247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:43.918269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:43.918569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:43.918849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] PATH_INFO: `/v3/users/8d640908c4a243ab941f3edb154ccf31` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:43.921747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d640908c4a243ab941f3edb154ccf31)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:43.923844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:43.926748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179066e0-f9d7-4c9e-9f82-10b90c4e3378 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:43.933765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:43.935250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:43.938653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:43.939127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] PATH_INFO: `/v3/projects/2c93e71453f84297b8287810730ed88f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:43.941082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c93e71453f84297b8287810730ed88f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:43.943569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:44.059351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d640908c4a243ab941f3edb154ccf31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.059351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d640908c4a243ab941f3edb154ccf31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.062665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c93e71453f84297b8287810730ed88f', 'request_id': 'req-cf1f4d90-a828-41e6-b130-58d6010ee01a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.072142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d640908c4a243ab941f3edb154ccf31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.072353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c93e71453f84297b8287810730ed88f', 'request_id': 'req-cf1f4d90-a828-41e6-b130-58d6010ee01a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.072833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d640908c4a243ab941f3edb154ccf31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.088968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c93e71453f84297b8287810730ed88f', 'request_id': 'req-cf1f4d90-a828-41e6-b130-58d6010ee01a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.095569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-11b2d4c4-ff2a-4f5b-8cd8-ed32a258589f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d640908c4a243ab941f3edb154ccf31'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.111827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] The token cache is being invalidate because project 2c93e71453f84297b8287810730ed88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:44.112515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.113312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cf1f4d90-a828-41e6-b130-58d6010ee01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.123143 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3364/6684] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:43 2022] DELETE /identity/v3/projects/2c93e71453f84297b8287810730ed88f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:44.127591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.127591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.127591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.140232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3321/6685] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:43 2022] DELETE /identity/v3/users/8d640908c4a243ab941f3edb154ccf31 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:44.142367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aedb1-4ba6-415a-9ea1-777b202e2a4b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.142759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aedb1-4ba6-415a-9ea1-777b202e2a4b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.144971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aedb1-4ba6-415a-9ea1-777b202e2a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.168862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:44.170789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.182682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d52aedb1-4ba6-415a-9ea1-777b202e2a4b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:44.185921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d52aedb1-4ba6-415a-9ea1-777b202e2a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.243079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:44.312605 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3322/6686] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:44.319946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3365/6687] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:44.327948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.328381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.328754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.332143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:44.334021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.406480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:44.416145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.446622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3323/6688] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:44.448920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:44.452176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.476354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395bb98-4713-4b67-8c40-7adbf9765de5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:44.478287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e88a8-ff41-47ca-8a7f-8b87eaf07968 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:44.482625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:44.483889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.484375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.485269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.505294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:44.506963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:44.507537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:44.508687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.511449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.511994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] PATH_INFO: `/v3/users/c3a7b7c72a80455381b2b9b4ee14eed3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.514779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a7b7c72a80455381b2b9b4ee14eed3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:44.517475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:44.524780 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3366/6689] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:44.525955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:44.575781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4ea5c-4471-4abd-a0d2-b402b139a4e0 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:44.591960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:44.592775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.593449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.600980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.604715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:44.605461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:44.610644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:44.633251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a7b7c72a80455381b2b9b4ee14eed3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.634956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a7b7c72a80455381b2b9b4ee14eed3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.639970 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3367/6690] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:44.645724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:44.648504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:44.662246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:44.665750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484ead6-0205-4870-a000-260f822f0fd4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:44.667593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a7b7c72a80455381b2b9b4ee14eed3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.670246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:44.670689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a7b7c72a80455381b2b9b4ee14eed3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.672923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:44.673884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:44.675011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:44.677222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:44.682936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:44.699845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a7b7c72a80455381b2b9b4ee14eed3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:44.756676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3324/6691] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:44 2022] DELETE /identity/v3/users/c3a7b7c72a80455381b2b9b4ee14eed3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:44.769750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3368/6692] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:44 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:44.773643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:44.929975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329c599-4c93-4371-9cd0-8bde35f9cf4a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.058894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.060050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.060396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.060796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.061691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.064131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.090418 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3325/6693] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:44 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:45.094161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.109805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37b9e-7519-47e1-8f2a-08e449cf2100 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.126832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.129067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.129376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.130840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.131714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.138344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.160268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3369/6694] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:45.164542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.195562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71edc70-14f5-4e11-892b-e873bb6a8fe9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.203912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.204813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.205184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.205464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.206278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.209006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed799170-4f63-4d7d-a2dd-d9fce328a1d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.220766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3326/6695] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:45.225187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.237013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34109975-522d-4972-b904-d0ea0f6f8d0a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.243006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.244279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.244584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.244931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] PATH_INFO: `/v3/projects/c7a8c28e867e4f068eda630b49aa76f1/users/e3dd0290b6e94050919656b761898ffb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.268845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a8c28e867e4f068eda630b49aa76f1, user_id=e3dd0290b6e94050919656b761898ffb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.271859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.289594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3370/6696] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:45 2022] PUT /identity/v3/projects/c7a8c28e867e4f068eda630b49aa76f1/users/e3dd0290b6e94050919656b761898ffb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:45.298219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.298548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.299070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.344062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:45.346045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.368151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.370328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.484747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:45.512479 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3327/6697] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:45.513563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.516096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.535558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae3ab5-90c4-4156-a029-781521b8c6b4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.543180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.545053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.545349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.545628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] PATH_INFO: `/v3/projects/5659e9dc2b6c4801bb25d9b326a19849` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.550717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5659e9dc2b6c4801bb25d9b326a19849)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.552465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b23ba-44cf-4a16-95e8-1d8bc963c104 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.552700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.562302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.564515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.565280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.565781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] PATH_INFO: `/v3/projects/e173e952f35b465898956477d2facf0e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.567562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e173e952f35b465898956477d2facf0e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.570539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.595591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:45.636675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5659e9dc2b6c4801bb25d9b326a19849', 'request_id': 'req-4294b7c0-ce43-4390-90f6-e19f382f2563'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.645915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5659e9dc2b6c4801bb25d9b326a19849', 'request_id': 'req-4294b7c0-ce43-4390-90f6-e19f382f2563'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.654207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5659e9dc2b6c4801bb25d9b326a19849', 'request_id': 'req-4294b7c0-ce43-4390-90f6-e19f382f2563'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.665326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e173e952f35b465898956477d2facf0e', 'request_id': 'req-77d4acc2-6721-444f-9844-0a8d92b63866'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.675609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] The token cache is being invalidate because project 5659e9dc2b6c4801bb25d9b326a19849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:45.676561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.677587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.680327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3328/6698] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:45 2022] DELETE /identity/v3/projects/5659e9dc2b6c4801bb25d9b326a19849 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:45.681649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.683734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.684066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e173e952f35b465898956477d2facf0e', 'request_id': 'req-77d4acc2-6721-444f-9844-0a8d92b63866'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.695210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e173e952f35b465898956477d2facf0e', 'request_id': 'req-77d4acc2-6721-444f-9844-0a8d92b63866'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.724997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] The token cache is being invalidate because project e173e952f35b465898956477d2facf0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:45.725511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.725978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.731335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3371/6699] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:45 2022] DELETE /identity/v3/projects/e173e952f35b465898956477d2facf0e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:45.732337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:45.737982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.783301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b7c0-ce43-4390-90f6-e19f382f2563 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.855816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.856502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.856789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.857073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.867266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4acc2-6721-444f-9844-0a8d92b63866 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:45.870510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.878194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:45.879429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.879758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.880045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] PATH_INFO: `/v3/users/7bcf574cfd3248b886925ed54753c17d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.881377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcf574cfd3248b886925ed54753c17d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.884083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.890970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:45.892173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6396fc-c876-47bc-918b-c63c04a5d45c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:45.904682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3329/6700] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:45.905864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8869c-ab90-4a9c-ac6a-06477053394d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.906851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8869c-ab90-4a9c-ac6a-06477053394d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.906851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8869c-ab90-4a9c-ac6a-06477053394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.932676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-25d8869c-ab90-4a9c-ac6a-06477053394d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:45.934068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25d8869c-ab90-4a9c-ac6a-06477053394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.953891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3330/6701] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:45.956114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:45.956581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:45.957045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:45.958097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcf574cfd3248b886925ed54753c17d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.967259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcf574cfd3248b886925ed54753c17d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.968040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcf574cfd3248b886925ed54753c17d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.968679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcf574cfd3248b886925ed54753c17d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.977920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:45.979427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:45.984139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcf574cfd3248b886925ed54753c17d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:45.989514 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3331/6702] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:45.994662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.005936 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3372/6703] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:14:45 2022] DELETE /identity/v3/users/7bcf574cfd3248b886925ed54753c17d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:46.008294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d3f94-2539-443f-8e5b-4edabb87dc10 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.038378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:46.084442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.085126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.085411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.085688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.086460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:46.086796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.088581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.102057 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3332/6704] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:14:46.107389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.119643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced992c-c304-48ed-8668-341003bebbab admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.124585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.125489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.125842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.126219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.126999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.129113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.158354 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3373/6705] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:46 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:46.163076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.175480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56376-3ade-4f99-9d63-4f5a035b3b4c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.237977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.238926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.239410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.239860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.240562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.242515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.266085 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3333/6706] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:46 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:46.269311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.274780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:46.290806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b8299-4957-490a-929f-43aaca99a96a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.299192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.300196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.300561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.302459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.302459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.304204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.327583 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3374/6707] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:46.330996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.342809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f397c6-2974-4de4-b650-aed1bd812a56 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.349612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.350438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.350841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.351226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.352175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.356094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0488-8b1f-41e8-ae2a-02cc6af397fc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.371864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3334/6708] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:46.374073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.389336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd30c-e9d9-4fd3-9ac7-9cb4f67ae9c6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.397080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.399870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.400163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.400632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] PATH_INFO: `/v3/projects/9be828d223874d6cbb4e57118acabfa4/users/c8800a39664542548c4118863e1db800/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.425384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be828d223874d6cbb4e57118acabfa4, user_id=c8800a39664542548c4118863e1db800, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.428392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.450321 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3375/6709] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:46 2022] PUT /identity/v3/projects/9be828d223874d6cbb4e57118acabfa4/users/c8800a39664542548c4118863e1db800/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:46.455796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.456126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.456362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.483824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:46.485066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:46.576023 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3335/6710] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:46.608231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:46.611627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:46.705176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d379e-c60c-4d22-bd61-1b2a630dac1f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:46.711733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:46.712415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:46.712697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:46.712970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:46.725419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:46.726908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a82761-e4aa-46a1-9a8c-edbdc66e9af0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:46.739309 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3376/6711] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:47.299111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:47.300954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:47.321780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6be03f-b0ca-4550-a028-3a46e1ba6436 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:47.332203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:47.333453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.334055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.335405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] PATH_INFO: `/v3/projects/fa6fbc30639f4c09bcde041cd30eb87e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.337102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6fbc30639f4c09bcde041cd30eb87e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:47.339034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:47.452066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:47.484971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6fbc30639f4c09bcde041cd30eb87e', 'request_id': 'req-9c5e459b-6521-40af-97c7-44d893df1b4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:47.496538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6fbc30639f4c09bcde041cd30eb87e', 'request_id': 'req-9c5e459b-6521-40af-97c7-44d893df1b4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:47.517231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6fbc30639f4c09bcde041cd30eb87e', 'request_id': 'req-9c5e459b-6521-40af-97c7-44d893df1b4e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:47.544735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] The token cache is being invalidate because project fa6fbc30639f4c09bcde041cd30eb87e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:14:47.545081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:47.546697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9c5e459b-6521-40af-97c7-44d893df1b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:14:47.549699 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3336/6712] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:14:47 2022] DELETE /identity/v3/projects/fa6fbc30639f4c09bcde041cd30eb87e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:47.555005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d499b-0537-45f0-8944-30cc1e3dd0d3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.555545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d499b-0537-45f0-8944-30cc1e3dd0d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.555735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d499b-0537-45f0-8944-30cc1e3dd0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.609148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fe1d499b-0537-45f0-8944-30cc1e3dd0d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:47.616112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fe1d499b-0537-45f0-8944-30cc1e3dd0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:47.763710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3377/6713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:47.765024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.765419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.765842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.773322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.773894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.774356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.817153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:47.820150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:47.828921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] MFA Rules not processed for user `e3dd0290b6e94050919656b761898ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:47.831776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:47.840557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3378/6714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:47.846819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:47.859465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06805-7af8-4f58-a876-c690d09c8005 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:47.870856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:47.873324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.880734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.881517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.882712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:14:47.883816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:47.885353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:47.906079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3379/6715] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:14:47.910732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:47.936123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b64df-9acd-40e0-b492-c22417f9e411 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:47.952179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:47.953366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:47.954003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:47.955313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:47.956359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:47.962265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:47.971694 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3337/6716] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:47.973079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:47.977687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:48.037507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3380/6717] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:47 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:48.041656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:48.098080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:48.104469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45176a17-3b45-4fb2-9b84-6a00076b8ace None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:48.140921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301ddc-89cc-4dbc-90bb-367ecb469318 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:48.148546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:48.149689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.149860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.150197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.151387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:48.154254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:48.174380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:48.176195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.176833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.177339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.188704 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3381/6718] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:48 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:48.191218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:48.220543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0af69-48cf-442d-a75c-aeab74ac1e86 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:48.229955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:48.233122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:48.233827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.234135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.234413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.235613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:48.238341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:48.256618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3382/6719] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:48.260862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:48.280172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70d671-5623-41a9-9acc-5f69e0abf7b3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:48.286434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:48.287198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.287616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.288201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.288938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:48.290902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:48.295449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:48.300740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307844b-d623-4f69-87a9-c266544d472c service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:48.304188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3383/6720] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:14:48.308399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:48.316649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3338/6721] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:48.324972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a9c15-6bbe-440b-a84e-4303611468ef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:48.332766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:48.334884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.335132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.335462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] PATH_INFO: `/v3/projects/d32a0b2ad71d466ab29c1b0bc97b1e28/users/31eadb5a85164126a7c838a093527ac4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.358967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32a0b2ad71d466ab29c1b0bc97b1e28, user_id=31eadb5a85164126a7c838a093527ac4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:48.362552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:48.407636 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3384/6722] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:48 2022] PUT /identity/v3/projects/d32a0b2ad71d466ab29c1b0bc97b1e28/users/31eadb5a85164126a7c838a093527ac4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:14:48.412977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc656-a1a4-4ee7-aaf9-d6234a32e1a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:48.413285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc656-a1a4-4ee7-aaf9-d6234a32e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:48.413646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bc656-a1a4-4ee7-aaf9-d6234a32e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:48.434303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-432bc656-a1a4-4ee7-aaf9-d6234a32e1a6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:48.435770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-432bc656-a1a4-4ee7-aaf9-d6234a32e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:48.513856 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3339/6723] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:48.902047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:48.904720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:49.005234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014f4-2fc6-4b6b-a87a-14f900e55970 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:49.009257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:49.010242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:49.010591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:49.010985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:49.024842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:49.026559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:49.043690 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3385/6724] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:14:49.658268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:49.658782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:49.659034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:49.691839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] MFA Rules not processed for user `c8800a39664542548c4118863e1db800`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:49.693576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:49.788378 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3340/6725] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:49.792568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:49.794306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:49.812855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604da9-55c0-4892-a223-7dfdeac917a6 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:49.818754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:49.819896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:49.820544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:49.821981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:49.822981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:49.825344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ac60-f232-45fb-9c0f-08e9a31789a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:49.876125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3386/6726] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:14:49 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:14:49.880527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:49.899708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c515-9a9b-4d01-8471-c1fba7c7c157 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:49.992606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:49.994779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:49.995263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:49.995384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:50.008076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:50.008890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:50.009247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:50.009594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:50.010709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:50.014019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:50.043329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] MFA Rules not processed for user `e3dd0290b6e94050919656b761898ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:50.047218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:50.052141 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3341/6727] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:14:49 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:14:50.056023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:50.080736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737bdf3-5d90-4429-970a-fdf47dbebe94 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:50.096711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:50.101567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:50.102054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:50.102494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:50.103432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:50.105732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:50.132209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3342/6728] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:50.136831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:50.138429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:50.152932 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3387/6729] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:14:50.162865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b0153-0270-4741-b480-72d727a28cf0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:50.171667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:50.172822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:50.173328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:50.173828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:50.175396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:50.178511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2d76f-ba6d-4958-9c7a-f9fc2540d9ec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:50.196836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3343/6730] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:14:50.200918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:50.220491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3636da-9272-4e9b-8cca-3467909560a7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:50.248349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:50.250528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:50.252499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:50.252964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] PATH_INFO: `/v3/projects/6ec02a566ee846e29f1a7db17d54880e/users/616c8321fb1b474abadcc0260311f455/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:50.296978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec02a566ee846e29f1a7db17d54880e, user_id=616c8321fb1b474abadcc0260311f455, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:50.302475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaff270-1c8e-4629-ab05-a8600b9063b4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:50.321477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3388/6731] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:14:50 2022] PUT /identity/v3/projects/6ec02a566ee846e29f1a7db17d54880e/users/616c8321fb1b474abadcc0260311f455/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:14:53.806234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:53.806792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:53.806792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:53.867188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] MFA Rules not processed for user `616c8321fb1b474abadcc0260311f455`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:53.868451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:54.075267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3344/6732] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:54.088622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:54.089188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:54.089188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:54.112195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] MFA Rules not processed for user `c8800a39664542548c4118863e1db800`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:14:54.113714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:54.204511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3389/6733] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:14:54.355321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:54.357299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:54.577785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeb34c-7646-478f-8627-e42c073d71c2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:54.598614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:54.599369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:54.599768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:54.600149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:54.616523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:54.618655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25e0b6-7402-49b8-950d-e54fd5f66c0e service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:54.632297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3345/6734] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:14:59.496730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:14:59.639831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa2c6f-496f-43bf-bf95-a70f99073208 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:14:59.651006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:14:59.652242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:14:59.652913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:14:59.653672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:14:59.657110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:14:59.872911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:14:59.875130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:14:59.889232 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3390/6735] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:02.385493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:02.387087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:02.387624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:02.429525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] MFA Rules not processed for user `31eadb5a85164126a7c838a093527ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:02.431938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:02.457758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:02.558508 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3346/6736] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:02.559194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:02.576275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e51fd-7602-4d95-8511-af2709bd5c4b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:02.583345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:02.584146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:02.584425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:02.584707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:02.585408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:02.588702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:02.673142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:02.711105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3391/6737] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:02 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:02.722445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27140509-6ddb-4f87-9096-f5d779d9b2c0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:02.904606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:02.905355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:02.905669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:02.905943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:02.910233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:02.912819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:02.968070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3347/6738] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:02 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:02.969721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:02.982662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062da5-5f2f-4281-8145-2477f85e5064 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:02.988443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:02.989327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:02.989790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:02.990352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:02.991523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:02.994293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:02.996635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:03.015605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:03.017237 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3392/6739] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:03.033972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ba20-2742-4547-99fd-9dc9e716eaca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:03.045528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:03.053773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:03.054199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:03.054578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] PATH_INFO: `/v3/projects/214ab8444b4949b0b1e6f1ee4929743b/users/913b1fac19d748908e6b9f5980e8bde9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:03.074096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] RBAC: Authorizing `identity:create_grant(project_id=214ab8444b4949b0b1e6f1ee4929743b, user_id=913b1fac19d748908e6b9f5980e8bde9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:03.077298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:03.104283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3348/6740] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:03 2022] PUT /identity/v3/projects/214ab8444b4949b0b1e6f1ee4929743b/users/913b1fac19d748908e6b9f5980e8bde9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:03.108493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:03.125167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26c33-bdb9-481e-8a68-e609d76ca9ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:03.286187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:03.286946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:03.287235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:03.287535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:03.289947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:03.296764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7b81-d80d-482f-b40b-6f4a3ae85699 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:03.311960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3393/6741] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:15:03.316094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:03.331180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4900113-e31b-40be-bbe1-4dcb1b17264b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:03.340112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:03.341370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:03.341722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:03.342148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] PATH_INFO: `/v3/projects/214ab8444b4949b0b1e6f1ee4929743b/users/913b1fac19d748908e6b9f5980e8bde9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:03.358103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214ab8444b4949b0b1e6f1ee4929743b, user_id=913b1fac19d748908e6b9f5980e8bde9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:03.363176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:03.388717 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3349/6742] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:03 2022] PUT /identity/v3/projects/214ab8444b4949b0b1e6f1ee4929743b/users/913b1fac19d748908e6b9f5980e8bde9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:13.305149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=31 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:13.382110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:15.501550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:15.502090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:15.502090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:15.545593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] MFA Rules not processed for user `913b1fac19d748908e6b9f5980e8bde9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:15.547234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:15.579542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:15.654071 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3394/6743] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:15.750065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f0fc5-f6c6-4ec3-b119-47bed922ed55 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:15.757953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:15.759536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:15.760111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:15.760555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:15.905859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:15.910637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da19a7-4f16-4764-97b3-a69636184c4a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:15.934349 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3350/6744] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:15 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:16.008932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:16.031193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed6a6-cbb9-43d6-b6af-196f192ba184 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:16.046710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:16.049166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:16.049474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:16.049797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:16.069711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:16.073640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:16.098954 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3395/6745] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:16.215716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf40a-3d86-4d70-a395-1cd2d01e72dc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:16.216048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf40a-3d86-4d70-a395-1cd2d01e72dc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:16.216393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf40a-3d86-4d70-a395-1cd2d01e72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:16.271992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e4cdf40a-3d86-4d70-a395-1cd2d01e72dc None None] MFA Rules not processed for user `31eadb5a85164126a7c838a093527ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:16.273249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4cdf40a-3d86-4d70-a395-1cd2d01e72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:16.434505 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3351/6746] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:17.049907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:17.059774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:17.213224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42fe2-edc8-498b-a7b6-bbb87a781dd7 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:17.223825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:17.224658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:17.225319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:17.226136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:17.230127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:17.259074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:17.260231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:17.307321 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3396/6747] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:19.269757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:19.270359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:19.270359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:19.295385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] MFA Rules not processed for user `e3dd0290b6e94050919656b761898ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:19.297468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:19.330084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:19.335708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:19.395642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:19.449303 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3352/6748] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:19.472744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d15d2-006a-42d5-83e4-843772a97459 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:19.479894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:19.480977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:19.481363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:19.481795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] PATH_INFO: `/v3/users/33de20254305474aa55173591da1b6a6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:19.484494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33de20254305474aa55173591da1b6a6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:19.494376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:19.516947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:19.520464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:19.522236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:19.615549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33de20254305474aa55173591da1b6a6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:19.628819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33de20254305474aa55173591da1b6a6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:19.629760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33de20254305474aa55173591da1b6a6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:19.630473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33de20254305474aa55173591da1b6a6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:19.648417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33de20254305474aa55173591da1b6a6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:19.670478 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3397/6749] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:19 2022] DELETE /identity/v3/users/33de20254305474aa55173591da1b6a6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:19.755409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4668a3-93c2-4bc0-b4d0-678c7c40c444 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:19.882416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:19.885965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:19.885965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:19.886287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:19.889272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:19.907480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:19.909964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:19.950149 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3353/6750] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:20.211698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:20.213646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:20.454851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec600-ff48-48bf-96a2-bf8515ed2fb6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:20.470095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:20.470882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:20.471171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:20.471458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] PATH_INFO: `/v3/projects/3a41aa195bb047cfae9f16c5e29050cc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:20.472929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a41aa195bb047cfae9f16c5e29050cc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:20.475048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:20.619965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a41aa195bb047cfae9f16c5e29050cc', 'request_id': 'req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.635411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a41aa195bb047cfae9f16c5e29050cc', 'request_id': 'req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.647936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a41aa195bb047cfae9f16c5e29050cc', 'request_id': 'req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.707807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] The token cache is being invalidate because project 3a41aa195bb047cfae9f16c5e29050cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:20.708185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.708870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.710622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3398/6751] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:20 2022] DELETE /identity/v3/projects/3a41aa195bb047cfae9f16c5e29050cc => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:20.715436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:20.729023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374341c9-1ebe-4d6f-b190-538ed410cd83 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:20.869533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:20.873377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:20.873567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:20.873920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] PATH_INFO: `/v3/users/9dbb2fba11204ab79617fd081e285476` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:20.875593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbb2fba11204ab79617fd081e285476)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:20.878290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:20.881130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:20.993447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbb2fba11204ab79617fd081e285476'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:20.994362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbb2fba11204ab79617fd081e285476'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.005868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbb2fba11204ab79617fd081e285476'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.006701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbb2fba11204ab79617fd081e285476'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.025534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce60888f-24fb-42c3-89af-81fce7c18570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbb2fba11204ab79617fd081e285476'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.052306 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3354/6752] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:20 2022] DELETE /identity/v3/users/9dbb2fba11204ab79617fd081e285476 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:15:21.606009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:21.609287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:21.625132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28906d3-6ee7-48d5-94cc-a494fb28c5a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:21.667447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:21.729457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:21.730868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:21.730868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:21.731167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] PATH_INFO: `/v3/projects/f946b83664fc4ed69db4933de434038e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:21.732861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f946b83664fc4ed69db4933de434038e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:21.735767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:21.800073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f946b83664fc4ed69db4933de434038e', 'request_id': 'req-50b6b9a9-34de-45f7-9735-b18ed4483812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.809192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f946b83664fc4ed69db4933de434038e', 'request_id': 'req-50b6b9a9-34de-45f7-9735-b18ed4483812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.817832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f946b83664fc4ed69db4933de434038e', 'request_id': 'req-50b6b9a9-34de-45f7-9735-b18ed4483812'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.838398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] The token cache is being invalidate because project f946b83664fc4ed69db4933de434038e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:21.845246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.845246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-50b6b9a9-34de-45f7-9735-b18ed4483812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:21.845246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3399/6753] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:21 2022] DELETE /identity/v3/projects/f946b83664fc4ed69db4933de434038e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:21.849350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:21.850301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:21.850627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:21.874636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:21.876143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:22.006198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3355/6754] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:22.016625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.016885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.017162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.056196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:22.057454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:22.075393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.084608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3400/6755] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:22.104719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fc3dd-aeb3-4413-8a85-838bdb32ad74 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.114100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.115967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.116238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.116563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.117579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:22.117899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.120907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.146074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.154044 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3356/6756] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:22.162647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fda64-090a-4370-91b7-0aa5697f92b6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.187490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.197937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.197937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.197937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.197937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.197937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.244306 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3401/6757] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:22 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:22.248431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.261207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916afe-2847-4e95-b562-cf4be08332d1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.343658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.344648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.345210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.345909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.346568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.348835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.363767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:22.392571 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3357/6758] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:22 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:22.393976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.414527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404069a-9595-4201-88f3-c8300395dbd3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.421041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.423988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.425206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.425513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.426362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.428118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.451555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3402/6759] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:15:22.456022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.468002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e79-6915-420d-a8d2-a8a962354cab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.474560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.475321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.475686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.476027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.476972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.478671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3f23-5ab6-4ed3-bf2d-ec7885ec3ded admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.494526 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3358/6760] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:22.495699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.510303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1f21-faeb-4eef-ae5b-0ce721a8d306 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.518448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.520653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.521533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.521965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] PATH_INFO: `/v3/projects/1cfc7c15670542ce979fe1ab45cf7034/users/1c1c95716bde4e28ac2a957eae09bb03/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.545070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfc7c15670542ce979fe1ab45cf7034, user_id=1c1c95716bde4e28ac2a957eae09bb03, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.550348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.580058 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3403/6761] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:22 2022] PUT /identity/v3/projects/1cfc7c15670542ce979fe1ab45cf7034/users/1c1c95716bde4e28ac2a957eae09bb03/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:22.580981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.581302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.581586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.603451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:22.604938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:22.680113 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3359/6762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:22.769509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:22.773724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:22.894679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc928-04c3-4335-ad0b-e466762ce26c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:22.900479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:22.901960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:22.902381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:22.902664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:22.910626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:22.916544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:22.918299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:22.937244 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3404/6763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:24.277943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:24.281433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:24.306985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab8ab-e3f7-4216-b8b5-049876d6e4be None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:24.319713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:24.321028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:24.325047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:24.325694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] PATH_INFO: `/v3/users/571f69e052a74d5d9ab7641add106010` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:24.328870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=571f69e052a74d5d9ab7641add106010)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:24.336809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:24.353181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:24.354962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:24.394523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56cc42-5965-4827-b548-91152d964dd7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:24.402016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:24.403253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:24.403843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:24.404394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] PATH_INFO: `/v3/users/c8800a39664542548c4118863e1db800` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:24.406039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8800a39664542548c4118863e1db800)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:24.409153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:24.451123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571f69e052a74d5d9ab7641add106010'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.452470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571f69e052a74d5d9ab7641add106010'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.465780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571f69e052a74d5d9ab7641add106010'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.467054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571f69e052a74d5d9ab7641add106010'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.496540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ca85e02d-39ad-49e2-b232-3ea841886c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571f69e052a74d5d9ab7641add106010'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.505057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8800a39664542548c4118863e1db800'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.514942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8800a39664542548c4118863e1db800'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.517340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8800a39664542548c4118863e1db800'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.518003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8800a39664542548c4118863e1db800'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.537837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8800a39664542548c4118863e1db800'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.539837 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3360/6764] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:24 2022] DELETE /identity/v3/users/571f69e052a74d5d9ab7641add106010 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:24.544126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:24.544304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:24.544450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:24.564417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3405/6765] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:24 2022] DELETE /identity/v3/users/c8800a39664542548c4118863e1db800 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:24.572261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:24.574329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:24.679992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:24.701861 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3361/6766] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:24.712803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:24.714680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:24.797382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be84d9-dbb7-4a3b-8738-0fb8ebe633ec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:24.801562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:24.802331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:24.803240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:24.803240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:24.818110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:24.820989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:24.838074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3406/6767] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:24.845291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:24.845291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:24.864600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb711-c77a-40cc-a2af-b19fa2b13d45 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:24.876367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:24.877949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:24.878613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:24.879118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] PATH_INFO: `/v3/projects/9be828d223874d6cbb4e57118acabfa4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:24.881153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be828d223874d6cbb4e57118acabfa4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:24.884664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:24.961590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be828d223874d6cbb4e57118acabfa4', 'request_id': 'req-0726187a-e1ff-4ed0-b657-34fdb3ea1509'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.970908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be828d223874d6cbb4e57118acabfa4', 'request_id': 'req-0726187a-e1ff-4ed0-b657-34fdb3ea1509'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:24.983105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be828d223874d6cbb4e57118acabfa4', 'request_id': 'req-0726187a-e1ff-4ed0-b657-34fdb3ea1509'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.003827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] The token cache is being invalidate because project 9be828d223874d6cbb4e57118acabfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:25.004252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.005000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.007166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3362/6768] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:24 2022] DELETE /identity/v3/projects/9be828d223874d6cbb4e57118acabfa4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:25.012361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.026476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c28608-a98e-4490-8055-c4ebf75ac84c service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.107454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.108351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.108619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.108898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] PATH_INFO: `/v3/users/616c8321fb1b474abadcc0260311f455` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.111447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=616c8321fb1b474abadcc0260311f455)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.116414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.118231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.120055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.135631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:25.167196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726187a-e1ff-4ed0-b657-34fdb3ea1509 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.175687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.177662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.177963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.178476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] PATH_INFO: `/v3/projects/675ec8e1ddda4f52980c530a8bec436e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.181060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=675ec8e1ddda4f52980c530a8bec436e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.185063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.220466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616c8321fb1b474abadcc0260311f455'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.233031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616c8321fb1b474abadcc0260311f455'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.233954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616c8321fb1b474abadcc0260311f455'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.235774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616c8321fb1b474abadcc0260311f455'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.256586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f4a8cf39-ea16-47a3-9c58-73e926932dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616c8321fb1b474abadcc0260311f455'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.280757 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3407/6769] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:25 2022] DELETE /identity/v3/users/616c8321fb1b474abadcc0260311f455 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:25.284902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675ec8e1ddda4f52980c530a8bec436e', 'request_id': 'req-0c857144-65e4-473f-b5b5-5e8e50bcac8e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.293394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675ec8e1ddda4f52980c530a8bec436e', 'request_id': 'req-0c857144-65e4-473f-b5b5-5e8e50bcac8e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.305162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675ec8e1ddda4f52980c530a8bec436e', 'request_id': 'req-0c857144-65e4-473f-b5b5-5e8e50bcac8e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.328275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] The token cache is being invalidate because project 675ec8e1ddda4f52980c530a8bec436e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:25.329179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.330393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0c857144-65e4-473f-b5b5-5e8e50bcac8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.332804 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3363/6770] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:25 2022] DELETE /identity/v3/projects/675ec8e1ddda4f52980c530a8bec436e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:15:25.337651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.340171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.340475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.369361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:25.370993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.466188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3408/6771] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:25.467154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.467732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.467732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.487555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:25.488668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.497815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3364/6772] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:25.503244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.513854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02792ee9-ac06-4637-a187-be5d9c8649ae None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.519998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.520973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.521608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.521901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.522772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:25.523115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.524872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.539289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3409/6773] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:25.542076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.543585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.550700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.575624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f8ced-5d24-4338-b205-e5aa735afd82 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.577457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bada475-41ae-4c0a-9d47-93c5f6ea5f2a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.582332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.583236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.584273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.584925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] PATH_INFO: `/v3/projects/6ec02a566ee846e29f1a7db17d54880e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.586280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec02a566ee846e29f1a7db17d54880e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.588991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.592438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.593128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.594223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.596662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.597468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.605468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.666121 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3410/6774] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:25.670182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.681873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec02a566ee846e29f1a7db17d54880e', 'request_id': 'req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.685044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:25.699025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec02a566ee846e29f1a7db17d54880e', 'request_id': 'req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.718039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec02a566ee846e29f1a7db17d54880e', 'request_id': 'req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.744540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] The token cache is being invalidate because project 6ec02a566ee846e29f1a7db17d54880e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:25.745087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.745963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd0dd301-6220-4ae5-9209-62d8c6eddf7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:25.752067 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3365/6775] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:25 2022] DELETE /identity/v3/projects/6ec02a566ee846e29f1a7db17d54880e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:25.755020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed043-bd70-4d53-b1b1-113543673b47 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.755771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed043-bd70-4d53-b1b1-113543673b47 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.756261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed043-bd70-4d53-b1b1-113543673b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.766550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:25.801383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557399c1-5859-4d79-ae55-5ddd08a18e87 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.814709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-650ed043-bd70-4d53-b1b1-113543673b47 None None] MFA Rules not processed for user `1c1c95716bde4e28ac2a957eae09bb03`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:25.817629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-650ed043-bd70-4d53-b1b1-113543673b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.819679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.820585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.820880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.821170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.821953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.824951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8be4b-eea6-4e87-983f-412a425ca381 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.877165 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3411/6776] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:25.877165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.877165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.880619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.919628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:25.922854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.937910 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3412/6777] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:25.939295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:25.942257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:25.958438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d890e6b-3ace-4e79-8826-6e76273d9d98 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:25.970673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:25.971559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:25.972018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:25.972425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:25.973822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:25.975541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:25.987083 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3366/6778] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:25.987892 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3413/6779] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:25.992606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.001571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.001571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.003485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.007055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ead9-733e-4415-8cea-b218ea1d596c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.013515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.014204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.014489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.014782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.015664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.017458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.027367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:26.030471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3414/6780] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:26.032252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.035244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:26.039070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:26.056043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3367/6781] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:26.057182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.077464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0783a-9e3c-4f0b-8df1-37b7551b1ba8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.089368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.092116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.092538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.093045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] PATH_INFO: `/v3/projects/0854567570ed4b83869deb6fdd94e0b1/users/141013aa101d4eeb8a14603127f1bb3e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.116089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0854567570ed4b83869deb6fdd94e0b1, user_id=141013aa101d4eeb8a14603127f1bb3e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.121485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.150473 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3368/6782] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:26 2022] PUT /identity/v3/projects/0854567570ed4b83869deb6fdd94e0b1/users/141013aa101d4eeb8a14603127f1bb3e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:26.163790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.164013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f6e31-c1b0-4f07-a261-ba7e69fbb4e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.283486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.285725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.286345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.287142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.287683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1eed9-18af-4f6b-9dcc-5b3ca520d3c0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.293697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.294872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.295166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.295588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.296527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:26.297228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.299226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c95800-f6ae-4e30-9ba0-a85d9d10f505 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.316488 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3369/6783] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:26.318525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.318777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.319057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.353926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:26.365231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] MFA Rules not processed for user `141013aa101d4eeb8a14603127f1bb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:26.366788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:26.368183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.369701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.388957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3415/6784] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:26.389677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.407455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66e1ad-7708-407d-9acf-fa8d714e0069 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.414941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.415834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.416123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.416408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.417166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.422177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.447078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:26.472611 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3416/6785] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:26 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:26.477342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.554997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3370/6786] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:26.556311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.562224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:26.585697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d993-4206-4138-b731-2b0b22d75ac6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.600822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.607390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.607390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.607390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.608779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.614691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.680326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3417/6787] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:26 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:26.686226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.729730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733726-c004-43e6-8921-06fe37339b23 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.736696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8d256-d8fa-46de-bc0c-8afa6318d851 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.754068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.755004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.755407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.755909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.756817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.758790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.771708 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3418/6788] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:26.775868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.791430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcc1ab-a24c-46e8-ae7b-57c9c9971e19 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.807404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.807404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.807404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.807404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.810178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.814304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.848793 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3419/6789] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:15:26.850033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:26.866563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3477e6-e2a7-4936-8a8c-949637a1a402 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:26.880251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:26.883396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:26.887139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:26.887922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] PATH_INFO: `/v3/projects/dfba5cd866c54177809d03b5a1d5e501/users/e40f5693f7e84256aa73d52dd19e95c4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:26.952809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba5cd866c54177809d03b5a1d5e501, user_id=e40f5693f7e84256aa73d52dd19e95c4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:26.956632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6e0ec-fe21-48f4-a369-e719f8c2d15b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:26.994039 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3420/6790] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:26 2022] PUT /identity/v3/projects/dfba5cd866c54177809d03b5a1d5e501/users/e40f5693f7e84256aa73d52dd19e95c4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:26.998925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:27.000189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:27.000599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:27.038419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:27.040137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:27.136230 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3421/6791] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:27.149386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:27.151491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:27.152207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:27.152577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:27.152847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:27.177345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:27.278344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82357-6912-4527-a79f-44a9012a82f0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:27.287921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:27.290187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d4979-3e8c-403b-ad45-117af470c553 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:27.290309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:27.291145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:27.291534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:27.292091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:27.301861 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3371/6792] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:27.310583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:27.317049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6129e-909e-4a9c-b49d-f2f6a5b2f56b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:27.335745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3422/6793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:28.209260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:28.211034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:28.211781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:28.249669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] MFA Rules not processed for user `1c1c95716bde4e28ac2a957eae09bb03`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:28.250357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:28.297492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:28.343322 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3372/6794] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:28.840996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:28.841653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:28.841653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:28.877178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] MFA Rules not processed for user `e40f5693f7e84256aa73d52dd19e95c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:28.878795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:29.011687 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3423/6795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:30.561087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:30.576579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b4c5-42a0-4578-aab5-69c7958d9a1f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:30.582949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:30.584288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:30.584669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:30.585218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] PATH_INFO: `/v3/users/e40f5693f7e84256aa73d52dd19e95c4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:30.586804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40f5693f7e84256aa73d52dd19e95c4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:30.590249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:30.662015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40f5693f7e84256aa73d52dd19e95c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:30.663101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40f5693f7e84256aa73d52dd19e95c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:30.672826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40f5693f7e84256aa73d52dd19e95c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:30.673047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:30.674214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40f5693f7e84256aa73d52dd19e95c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:30.674784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:30.698910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40f5693f7e84256aa73d52dd19e95c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:30.736862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3373/6796] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:30 2022] DELETE /identity/v3/users/e40f5693f7e84256aa73d52dd19e95c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:30.789980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd51086-5467-4a79-bc01-6f9b195de9eb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:30.858582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:30.879255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:30.880232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:30.880669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:30.881145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:30.883406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:30.907969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:30.911382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf30bd-1194-42e4-bd6b-0d93c599065f service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:30.925626 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3424/6797] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:31.151368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:31.153739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:31.304839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc6986-87bb-48da-85fa-618c232a4391 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:31.312779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:31.314303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.314874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.315380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] PATH_INFO: `/v3/projects/dfba5cd866c54177809d03b5a1d5e501` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.317066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfba5cd866c54177809d03b5a1d5e501)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:31.319470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:31.432502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfba5cd866c54177809d03b5a1d5e501', 'request_id': 'req-088b6eb8-c9a2-416f-9c7a-302277616647'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:31.435044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:31.455639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfba5cd866c54177809d03b5a1d5e501', 'request_id': 'req-088b6eb8-c9a2-416f-9c7a-302277616647'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:31.467737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfba5cd866c54177809d03b5a1d5e501', 'request_id': 'req-088b6eb8-c9a2-416f-9c7a-302277616647'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:31.494218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] The token cache is being invalidate because project dfba5cd866c54177809d03b5a1d5e501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:31.494519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:31.495198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-088b6eb8-c9a2-416f-9c7a-302277616647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:31.500789 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3374/6798] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:31 2022] DELETE /identity/v3/projects/dfba5cd866c54177809d03b5a1d5e501 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:31.502461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.502759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.503042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.564020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:31.565285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:31.679086 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3425/6799] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:31.687561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.688463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.688925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.709217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:31.710944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:31.721366 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3375/6800] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:31.725547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:31.737633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b749f5-f914-407e-ad6c-2a0e61284a71 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:31.743953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:31.745190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.745577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.746032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.747032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:31.747530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:31.749708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:31.767346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3426/6801] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:31.769009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:31.784396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06b854-66e4-4dd5-9b35-6da7182fe798 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:31.790135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:31.791129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.792061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.792607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.793590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:31.796659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:31.833184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3376/6802] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:31 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:31.836894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:31.851322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0049-bee9-433f-ac01-7798c4bb3b90 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:31.932406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:31.933240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:31.933528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:31.933862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:31.934934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:31.937329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:31.974571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3427/6803] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:31 2022] POST /identity/v3/users => generated 301 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:31.975733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:31.992636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44a25-9060-449a-a96f-1831f3f29ea5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:32.012750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:32.013824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.014111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.014388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.015556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:32.017693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:32.030125 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3377/6804] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:15:32.034018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:32.044963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a4f1d-e861-4cd8-950f-0aea09e4f6c8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:32.050213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:32.050896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.051183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.051459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.052828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:32.054578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4df01-2176-4f46-8cbd-961ac63a2223 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:32.071964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:32.072208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3428/6805] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:32.083299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56ab7-4e6a-4287-941a-695b24a867d6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:32.088236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:32.089072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.089441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.089717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] PATH_INFO: `/v3/projects/0c37674e181f4577a297750fa1b5b98f/users/cda8876393d14c5692cc2337b2f03bf8/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.113855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c37674e181f4577a297750fa1b5b98f, user_id=cda8876393d14c5692cc2337b2f03bf8, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:32.116730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:32.135433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3378/6806] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:32 2022] PUT /identity/v3/projects/0c37674e181f4577a297750fa1b5b98f/users/cda8876393d14c5692cc2337b2f03bf8/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:32.147392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561fbc-436d-4b0d-94ee-0efb9d538a11 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.147705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561fbc-436d-4b0d-94ee-0efb9d538a11 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.147981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a561fbc-436d-4b0d-94ee-0efb9d538a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.178544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6a561fbc-436d-4b0d-94ee-0efb9d538a11 None None] MFA Rules not processed for user `cda8876393d14c5692cc2337b2f03bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:32.179874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a561fbc-436d-4b0d-94ee-0efb9d538a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:32.217383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:32.275807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3429/6807] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:32.585594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:32.591593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bcb3-332e-482f-9d56-4576a5e75eed None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.592114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bcb3-332e-482f-9d56-4576a5e75eed None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.592624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bcb3-332e-482f-9d56-4576a5e75eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.625300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3e19bcb3-332e-482f-9d56-4576a5e75eed None None] MFA Rules not processed for user `31eadb5a85164126a7c838a093527ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:32.626973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3e19bcb3-332e-482f-9d56-4576a5e75eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:32.689100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673f464-a2dd-4fc3-ac32-36dcfc2eafbe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:32.694632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:32.696084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.696378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.696907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] PATH_INFO: `/v3/users/cda8876393d14c5692cc2337b2f03bf8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.699193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda8876393d14c5692cc2337b2f03bf8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:32.705151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:32.712190 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3430/6808] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:32.784080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda8876393d14c5692cc2337b2f03bf8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:32.785095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda8876393d14c5692cc2337b2f03bf8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:32.796606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda8876393d14c5692cc2337b2f03bf8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:32.800634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda8876393d14c5692cc2337b2f03bf8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:32.818804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda8876393d14c5692cc2337b2f03bf8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:32.824083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:32.852109 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3379/6809] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:32 2022] DELETE /identity/v3/users/cda8876393d14c5692cc2337b2f03bf8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:32.854692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:32.855000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:32.855284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:32.883718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:32.885508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:32.964189 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3431/6810] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:32.977832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:32.979389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:33.052024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063747e0-8226-4acb-8c3a-9dda8e11869a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:33.056032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:33.056800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:33.057174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:33.057524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:33.069762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:33.071084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9dabf-8d3b-4ca9-9cba-1f64a5f12ee6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:33.083372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3380/6811] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:15:33.774281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:33.775931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:33.795728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcf6a7-8fb7-4457-8993-03faac9c0025 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:33.803737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:33.805139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:33.805417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:33.805871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] PATH_INFO: `/v3/projects/0c37674e181f4577a297750fa1b5b98f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:33.807767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c37674e181f4577a297750fa1b5b98f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:33.809910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:33.883625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c37674e181f4577a297750fa1b5b98f', 'request_id': 'req-6e91ff6e-3403-4ebc-a965-6a48bc576b24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:33.893333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c37674e181f4577a297750fa1b5b98f', 'request_id': 'req-6e91ff6e-3403-4ebc-a965-6a48bc576b24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:33.902637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c37674e181f4577a297750fa1b5b98f', 'request_id': 'req-6e91ff6e-3403-4ebc-a965-6a48bc576b24'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:33.919180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:33.929755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] The token cache is being invalidate because project 0c37674e181f4577a297750fa1b5b98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:33.930984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:33.932144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6e91ff6e-3403-4ebc-a965-6a48bc576b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:33.934458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3432/6812] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:33 2022] DELETE /identity/v3/projects/0c37674e181f4577a297750fa1b5b98f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:33.941925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:33.942541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:33.942541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:33.975206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:33.977366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:34.103565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3381/6813] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:34.108848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.109477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.109795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.134048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:34.135283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:34.145634 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3433/6814] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:34.151615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.166378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8b6c-666e-45e4-8a71-9e5260c442fd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.174532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.175386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.175825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.176215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.176841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:34.177228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.179164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.227562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3382/6815] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:34.232403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.247495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97f68-a235-4bbd-a627-180d2c13e75c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.260433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.261275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.261596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.261913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.262920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.265090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.304720 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3434/6816] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:34 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:34.309657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.324656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fce00-7e9f-4f41-b737-a6960e439879 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.420075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.420075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.420513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.420871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.421897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.431463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.468584 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3383/6817] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:34 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:34.473717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.492685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95b8a-121e-43c2-affb-a321ac2ab3c0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.504041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.507116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.507655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.508199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.509810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.512841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.534469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3435/6818] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:34.536031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.553699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4514-0cc9-42a8-b819-4b5649c21946 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.569033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.569818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.570102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.570379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.571173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.573043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662ba38-5f7f-442c-92d2-072581dbc673 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.599545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3384/6819] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:34.602842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.622658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae021a-a806-485b-87cf-0ff89e903ada admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:34.636425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:34.637832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.638126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.638408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] PATH_INFO: `/v3/projects/d7752a37a5984bc99d2acfcc327fc14e/users/bff665dac5de4530ab70f20ba2da386d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.659787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7752a37a5984bc99d2acfcc327fc14e, user_id=bff665dac5de4530ab70f20ba2da386d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:34.662815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:34.691429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3436/6820] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:34 2022] PUT /identity/v3/projects/d7752a37a5984bc99d2acfcc327fc14e/users/bff665dac5de4530ab70f20ba2da386d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:34.711375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb37de-0220-4fe9-8447-c0b7e1fd821b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:34.711766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb37de-0220-4fe9-8447-c0b7e1fd821b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:34.713790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb37de-0220-4fe9-8447-c0b7e1fd821b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:34.764394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:34.797247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-45fb37de-0220-4fe9-8447-c0b7e1fd821b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:34.799136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-45fb37de-0220-4fe9-8447-c0b7e1fd821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:34.914865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3385/6821] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:34.925170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:34.929394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:35.021664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686f14b-950f-4064-8faa-fdf39461a1c2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:35.029080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:35.030024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:35.030374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:35.031061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:35.043657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:35.045864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:35.073787 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3437/6822] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:44.904318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=25 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:45.056364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:46.659246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df8098-cbb7-4611-9ea9-b2a8b7d29dee None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:46.660510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df8098-cbb7-4611-9ea9-b2a8b7d29dee None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:46.661095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df8098-cbb7-4611-9ea9-b2a8b7d29dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:46.799963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-98df8098-cbb7-4611-9ea9-b2a8b7d29dee None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:46.801721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-98df8098-cbb7-4611-9ea9-b2a8b7d29dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:46.921480 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3386/6823] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:47.024767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:47.027255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:47.212699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0ebe-9814-48c6-923f-87f2c11a78c5 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:47.218529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:47.219479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:47.219944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:47.220405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:47.240640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:47.242613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:47.266059 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3438/6824] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:50.219337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:50.219846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:50.219992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:50.284004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] MFA Rules not processed for user `bff665dac5de4530ab70f20ba2da386d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:50.285261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:50.488736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3387/6825] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:50.505654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:50.507975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:50.886222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850d220-5aef-4638-9992-44121cb0df8e service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:50.911124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:50.912554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:50.912847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:50.916180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:50.951017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:50.954242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:50.979774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3439/6826] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:51.347479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:51.349682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:51.515287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:51.541098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51279-08a7-4976-8362-9b7de413878e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:51.554893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:51.556231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:51.556700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:51.557907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:51.563573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:51.596280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:51.602796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:51.647392 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3388/6827] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:57.028414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:57.030405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:57.099281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5e3a9-210c-43cf-9c6d-43027ad45256 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:57.115103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:57.116225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:57.116681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:57.117138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:57.119323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:57.144718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:57.149784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac621a-9da1-40e7-bb42-4b302d5c1cbd service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:57.166272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3440/6828] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:15:57.224917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:57.227051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:57.257571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded72773-2fce-4aa7-8e82-5643707b6b1d service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:57.262645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:57.263790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:57.264256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:57.264804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] PATH_INFO: `/v3/users/1c1c95716bde4e28ac2a957eae09bb03` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:57.266237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1c95716bde4e28ac2a957eae09bb03)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:57.270741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:57.411975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1c95716bde4e28ac2a957eae09bb03'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:57.413002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1c95716bde4e28ac2a957eae09bb03'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:57.422746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1c95716bde4e28ac2a957eae09bb03'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:57.424006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1c95716bde4e28ac2a957eae09bb03'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:57.465045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1c95716bde4e28ac2a957eae09bb03'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:57.495932 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3389/6829] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:15:57 2022] DELETE /identity/v3/users/1c1c95716bde4e28ac2a957eae09bb03 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:57.958788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995d2be-e476-45eb-bae8-03efe0b14009 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:57.959050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995d2be-e476-45eb-bae8-03efe0b14009 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:57.959334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995d2be-e476-45eb-bae8-03efe0b14009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:57.993886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:57.994900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d995d2be-e476-45eb-bae8-03efe0b14009 None None] MFA Rules not processed for user `bff665dac5de4530ab70f20ba2da386d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:57.996179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d995d2be-e476-45eb-bae8-03efe0b14009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:57.996301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:58.169425 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3441/6830] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:15:58.215573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aae9d8-f7a3-4c3b-9fbd-a508ef6b45f6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:58.230652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:58.231571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:58.231862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:58.232143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] PATH_INFO: `/v3/projects/1cfc7c15670542ce979fe1ab45cf7034` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:58.240662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfc7c15670542ce979fe1ab45cf7034)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:58.242695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:58.352253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfc7c15670542ce979fe1ab45cf7034', 'request_id': 'req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:58.367891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfc7c15670542ce979fe1ab45cf7034', 'request_id': 'req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:58.416094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfc7c15670542ce979fe1ab45cf7034', 'request_id': 'req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:58.420933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:58.446095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] The token cache is being invalidate because project 1cfc7c15670542ce979fe1ab45cf7034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:15:58.446780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:58.447757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e9f8808-ad46-47a7-8e1b-42f1cee2cb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:15:58.450420 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3390/6831] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:15:57 2022] DELETE /identity/v3/projects/1cfc7c15670542ce979fe1ab45cf7034 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:58.456344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:58.456737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:58.457031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:58.474939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:58.486336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:58.494044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:58.582377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3442/6832] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:58.591806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:58.592099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:58.592710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:58.628807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:58.630332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:58.649199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3391/6833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:58.659758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:58.685664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744470e-6743-4f78-ba41-5b1a61c2f441 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:58.704422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:58.705285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:58.705810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:58.706328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:58.707314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:15:58.708044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:58.711148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:58.749267 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3443/6834] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:15:58.753782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:58.765060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914a8c-d325-434c-84dd-9f720c6bf947 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:58.770989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:58.772141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:58.772519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:58.773098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:58.774183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:58.776414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:58.857878 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3392/6835] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:15:58 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:15:58.862557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:58.878715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aaaf0-271a-4d18-a572-103f4c735305 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:59.078054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:59.078763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.079053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.083349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.084234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:59.087835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:59.145213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3444/6836] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:15:58 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:15:59.149234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:59.162500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d26ee-7455-4003-ae29-a44b22edceee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:59.201908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:59.203004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.203151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.203474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.204266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:59.205987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:59.239777 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3393/6837] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:59.243626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:59.262997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdbbc8-e041-4de6-a1d3-1b2918f31689 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:59.281151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:59.281639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.281930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.282209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.282957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:59.291215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352c81-48d8-4ef5-956e-701cc0bf8926 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:59.319657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:59.320847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3445/6838] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:15:59.331015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3b3f-3c95-47db-9316-58efb1f76337 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:59.351115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:59.355416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.357854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.359609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] PATH_INFO: `/v3/projects/85c8d0cb10be4ebeb3b8c7e899d66228/users/25ed8e5857cc4e46a4354a26613413a9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.416797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c8d0cb10be4ebeb3b8c7e899d66228, user_id=25ed8e5857cc4e46a4354a26613413a9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:59.419787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:59.449441 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3394/6839] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:15:59 2022] PUT /identity/v3/projects/85c8d0cb10be4ebeb3b8c7e899d66228/users/25ed8e5857cc4e46a4354a26613413a9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:15:59.454839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09bb9-471e-4f03-97c5-ec1bad662356 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.455141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09bb9-471e-4f03-97c5-ec1bad662356 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.455438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e09bb9-471e-4f03-97c5-ec1bad662356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.491301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b8e09bb9-471e-4f03-97c5-ec1bad662356 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:15:59.492598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b8e09bb9-471e-4f03-97c5-ec1bad662356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:59.609020 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3446/6840] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:15:59.646848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:15:59.649286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:15:59.806278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d972-4499-4481-8c73-24ed824f7cf6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:15:59.811541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:15:59.812766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:15:59.813971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:15:59.814414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:15:59.828317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:15:59.832130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187e8e5-9fc9-4b85-bc72-fd5cd7a392d6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:15:59.867621 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3395/6841] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:02.688001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:02.689006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:02.689451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:02.779256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:02.805336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] MFA Rules not processed for user `25ed8e5857cc4e46a4354a26613413a9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:02.807451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:02.966553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:02.967186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3447/6842] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:02.967787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:02.968282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:03.007014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] MFA Rules not processed for user `25ed8e5857cc4e46a4354a26613413a9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:03.011797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:03.042915 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3396/6843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:16:03.058606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:03.060575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:03.246745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc3d2f-7af1-4fb1-9446-d49a79ada031 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:03.267272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:03.268333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:03.268613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:03.268887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:03.288781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:03.290646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316719a9-1262-4123-bf2c-9415922179fd service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:03.390976 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3448/6844] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:05.319080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:05.321719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:05.386922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee20c-b548-4cdc-b231-37a3635a497d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:05.415200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:05.435002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:05.438145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:05.440813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:05.451849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:05.733614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:05.737828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:05.786491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3397/6845] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:09.881957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:09.883207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:09.883773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:09.936868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:09.938582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:09.966789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3449/6846] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:14.924905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:14.926897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:14.962822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72f854-c800-41a5-a244-db7ab97a0c25 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:14.990233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:14.991166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:14.991447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:14.991751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] PATH_INFO: `/v3/users/2ed5143e191a43cc892a9428a2a8376c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:15.018237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed5143e191a43cc892a9428a2a8376c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:15.023763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:15.149383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:15.241220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed5143e191a43cc892a9428a2a8376c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:15.242891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed5143e191a43cc892a9428a2a8376c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:15.276911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed5143e191a43cc892a9428a2a8376c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:15.277817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed5143e191a43cc892a9428a2a8376c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:15.309677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed5143e191a43cc892a9428a2a8376c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:15.344168 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3398/6847] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:14 2022] DELETE /identity/v3/users/2ed5143e191a43cc892a9428a2a8376c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:16.776190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:16.794312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d360e-becf-485f-bac4-17d617ad0501 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:17.013461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:17.015920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:17.016318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:17.017058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] PATH_INFO: `/v3/projects/a6f7eafafd554647ad42646ebdc1aa1b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:17.019159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f7eafafd554647ad42646ebdc1aa1b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:17.021930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:17.055330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:17.092648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f7eafafd554647ad42646ebdc1aa1b', 'request_id': 'req-70e6a24f-cc28-4735-80c1-2bd35ebf1182'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.101648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f7eafafd554647ad42646ebdc1aa1b', 'request_id': 'req-70e6a24f-cc28-4735-80c1-2bd35ebf1182'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.109746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f7eafafd554647ad42646ebdc1aa1b', 'request_id': 'req-70e6a24f-cc28-4735-80c1-2bd35ebf1182'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.146976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] The token cache is being invalidate because project a6f7eafafd554647ad42646ebdc1aa1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:17.148716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.151476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.159535 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3450/6848] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:16 2022] DELETE /identity/v3/projects/a6f7eafafd554647ad42646ebdc1aa1b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:17.160796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:17.163335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:17.185264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f4bf-05fe-453e-b86c-cd67ca8852e5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:17.360296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:17.362679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:17.363203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:17.363743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] PATH_INFO: `/v3/users/6b6e79bc390747dc8034d38a767d9f94` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:17.366019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6e79bc390747dc8034d38a767d9f94)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:17.369312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:17.512999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6e79bc390747dc8034d38a767d9f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.516516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6e79bc390747dc8034d38a767d9f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.544191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6e79bc390747dc8034d38a767d9f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.545323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6e79bc390747dc8034d38a767d9f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.575975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4917281e-6488-4b05-88d2-f0d44b2f36ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6e79bc390747dc8034d38a767d9f94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:17.622310 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3399/6849] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:17 2022] DELETE /identity/v3/users/6b6e79bc390747dc8034d38a767d9f94 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:19.935235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:19.939278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:19.969876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6a24f-cc28-4735-80c1-2bd35ebf1182 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:20.158840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:20.159685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:20.159971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:20.160253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] PATH_INFO: `/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:20.164517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbabf9a1b7e04263be1e81f35ad1082a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:20.171028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:20.418485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbabf9a1b7e04263be1e81f35ad1082a', 'request_id': 'req-269906d3-f409-4c17-bfd8-e3c025f2557e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:20.426241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbabf9a1b7e04263be1e81f35ad1082a', 'request_id': 'req-269906d3-f409-4c17-bfd8-e3c025f2557e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:20.434703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbabf9a1b7e04263be1e81f35ad1082a', 'request_id': 'req-269906d3-f409-4c17-bfd8-e3c025f2557e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:20.464468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] The token cache is being invalidate because project fbabf9a1b7e04263be1e81f35ad1082a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:20.464468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:20.464852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:20.467819 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3451/6850] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:19 2022] DELETE /identity/v3/projects/fbabf9a1b7e04263be1e81f35ad1082a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:25.400549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:25.401115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:25.401115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:25.428458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:25.430665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:25.443338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:25.597319 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3400/6851] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:25.612921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:25.614634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:25.713831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:25.772688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269906d3-f409-4c17-bfd8-e3c025f2557e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:25.786568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:25.787841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:25.789095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:25.789670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:25.804097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:25.818947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:25.839933 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3452/6852] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:16:29.357057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:29.358831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:29.439128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d8032-4a42-4c78-ab2d-bfde63496e27 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:29.444733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:29.445623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:29.445932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:29.446303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] PATH_INFO: `/v3/users/e3dd0290b6e94050919656b761898ffb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:29.448809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dd0290b6e94050919656b761898ffb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:29.451188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:29.473203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:29.474681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:29.490781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c318c3c-2b5c-4094-8e17-403096181e77 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:29.496721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:29.497651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:29.497989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:29.499188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] PATH_INFO: `/v3/users/31eadb5a85164126a7c838a093527ac4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:29.500617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31eadb5a85164126a7c838a093527ac4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:29.502721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:29.520245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dd0290b6e94050919656b761898ffb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.521261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dd0290b6e94050919656b761898ffb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.535804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dd0290b6e94050919656b761898ffb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.536805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dd0290b6e94050919656b761898ffb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.553615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dd0290b6e94050919656b761898ffb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.564270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31eadb5a85164126a7c838a093527ac4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.572136 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3401/6853] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:29 2022] DELETE /identity/v3/users/e3dd0290b6e94050919656b761898ffb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:29.602247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31eadb5a85164126a7c838a093527ac4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.603124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31eadb5a85164126a7c838a093527ac4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.603911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31eadb5a85164126a7c838a093527ac4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.630490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31eadb5a85164126a7c838a093527ac4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:29.674975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3453/6854] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:29 2022] DELETE /identity/v3/users/31eadb5a85164126a7c838a093527ac4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:29.971153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:29.974923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.013875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.016140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.058381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:30.104042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840d53b-d8c0-400b-9a2c-e2278fba0c48 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.150268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dfb4d-6f1c-4a3c-bb61-6c3aa728c3d4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.163051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.164155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.164261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.164549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] PATH_INFO: `/v3/projects/d32a0b2ad71d466ab29c1b0bc97b1e28` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.165828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32a0b2ad71d466ab29c1b0bc97b1e28)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.171171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.196082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.197677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.198184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.198629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] PATH_INFO: `/v3/projects/c7a8c28e867e4f068eda630b49aa76f1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.200455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a8c28e867e4f068eda630b49aa76f1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.202507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.248240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:30.253856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32a0b2ad71d466ab29c1b0bc97b1e28', 'request_id': 'req-5cbf735d-9c40-474a-9727-4aae803bb8cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.270719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32a0b2ad71d466ab29c1b0bc97b1e28', 'request_id': 'req-5cbf735d-9c40-474a-9727-4aae803bb8cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.283542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a8c28e867e4f068eda630b49aa76f1', 'request_id': 'req-448f264c-2865-4999-aace-1ab1f8330cb0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.287576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32a0b2ad71d466ab29c1b0bc97b1e28', 'request_id': 'req-5cbf735d-9c40-474a-9727-4aae803bb8cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.295301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a8c28e867e4f068eda630b49aa76f1', 'request_id': 'req-448f264c-2865-4999-aace-1ab1f8330cb0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.303934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a8c28e867e4f068eda630b49aa76f1', 'request_id': 'req-448f264c-2865-4999-aace-1ab1f8330cb0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.307285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] The token cache is being invalidate because project d32a0b2ad71d466ab29c1b0bc97b1e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:30.308705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.309881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.312002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3454/6855] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:30 2022] DELETE /identity/v3/projects/d32a0b2ad71d466ab29c1b0bc97b1e28 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:30.316550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.319123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.324109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] The token cache is being invalidate because project c7a8c28e867e4f068eda630b49aa76f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:30.324406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.325272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-448f264c-2865-4999-aace-1ab1f8330cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.328575 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3402/6856] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:29 2022] DELETE /identity/v3/projects/c7a8c28e867e4f068eda630b49aa76f1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:16:30.333655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625224-872e-4b9a-93db-b1305cfc6d38 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.334006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625224-872e-4b9a-93db-b1305cfc6d38 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.334203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625224-872e-4b9a-93db-b1305cfc6d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.356536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-22625224-872e-4b9a-93db-b1305cfc6d38 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:30.367277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-22625224-872e-4b9a-93db-b1305cfc6d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.430340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf735d-9c40-474a-9727-4aae803bb8cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.453797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3403/6857] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:30.461011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.461641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.461926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.483198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:30.484581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.494835 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3404/6858] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:30.499171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.499357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.500214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.500498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.500778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] PATH_INFO: `/v3/users/913b1fac19d748908e6b9f5980e8bde9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.502017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913b1fac19d748908e6b9f5980e8bde9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.504015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.511987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759813-45dc-4bc3-befa-00b39e1ce191 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.517426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.518567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.519593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.519593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.521032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:16:30.521032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.522430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.530961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:30.541263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3405/6859] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:16:30.542515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.556149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d9c8-4e1a-49de-bb12-086f69616e91 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.563747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.564565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.564941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.565276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.566211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.568110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913b1fac19d748908e6b9f5980e8bde9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.568546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.578394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913b1fac19d748908e6b9f5980e8bde9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.579440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913b1fac19d748908e6b9f5980e8bde9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.580406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913b1fac19d748908e6b9f5980e8bde9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.609966 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3406/6860] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:16:30 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:16:30.613744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.616007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.618875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913b1fac19d748908e6b9f5980e8bde9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:30.640922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:30.651259 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3455/6861] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:30 2022] DELETE /identity/v3/users/913b1fac19d748908e6b9f5980e8bde9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:16:30.737630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49c77-3505-4039-ab23-c26ff122f352 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.838970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.839730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.840175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.841496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.842250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.844934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.898154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.901693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:30.946881 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3407/6862] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:16:30 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:16:30.947993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:30.964943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989cc8-227c-4d67-bb24-885976de01c9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.976197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.978043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01acdeb-d66d-4a87-a69d-2465f52d209f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:30.978247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.978527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.979069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] PATH_INFO: `/v3/projects/214ab8444b4949b0b1e6f1ee4929743b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.980553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214ab8444b4949b0b1e6f1ee4929743b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:30.985296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:30.997795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:30.998531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:30.998818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:30.999097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:30.999884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.002154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.018419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3408/6863] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:31.022704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.037634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd04463-9491-4469-92fc-d714a130b0f8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.045119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.047173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.047692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.048130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.049021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.050739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.068819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3409/6864] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:16:31.069726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.077306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214ab8444b4949b0b1e6f1ee4929743b', 'request_id': 'req-5d890448-c529-4b15-a943-6609cb3ceec6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:31.084443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a06a8-c1f7-4a1b-ad52-717339879e6c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.084844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214ab8444b4949b0b1e6f1ee4929743b', 'request_id': 'req-5d890448-c529-4b15-a943-6609cb3ceec6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:31.093001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214ab8444b4949b0b1e6f1ee4929743b', 'request_id': 'req-5d890448-c529-4b15-a943-6609cb3ceec6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:31.119496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] The token cache is being invalidate because project 214ab8444b4949b0b1e6f1ee4929743b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:31.119845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:31.121604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d890448-c529-4b15-a943-6609cb3ceec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:31.127428 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3456/6865] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:30 2022] DELETE /identity/v3/projects/214ab8444b4949b0b1e6f1ee4929743b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:31.132207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747650a-d307-4b05-93a5-73fcbde2aef9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.132500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747650a-d307-4b05-93a5-73fcbde2aef9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.132778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747650a-d307-4b05-93a5-73fcbde2aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.156247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7747650a-d307-4b05-93a5-73fcbde2aef9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:31.157629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7747650a-d307-4b05-93a5-73fcbde2aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:31.161234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:31.179232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.181013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.181013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.181013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] PATH_INFO: `/v3/projects/82e56305a8994e3ca45920448336ba18/users/59e619953f32406891051e0e029c1670/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.198592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e56305a8994e3ca45920448336ba18, user_id=59e619953f32406891051e0e029c1670, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.201841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc7fe4-8203-4fb1-a713-9bdd305716b6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.241198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3410/6866] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:16:31 2022] PUT /identity/v3/projects/82e56305a8994e3ca45920448336ba18/users/59e619953f32406891051e0e029c1670/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:31.246588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.246997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.247319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.274414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:31.277667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:31.312568 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3457/6867] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:31.318317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.318640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.318907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.342663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:31.344366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:31.353617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3411/6868] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:31.370122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.372012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:31.380202 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3458/6869] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:31.384928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.395370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e8a6-27cd-4ebc-9c7e-dbe9aa0eae72 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.402111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.402731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.403023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.403302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.404319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:16:31.404775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.406500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.424349 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3459/6870] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:16:31.426235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.450316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699df5cf-55bf-402e-be9d-5b4915301a26 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.458779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1c445-0c6f-4596-8cb1-04fd511b593e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.462314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.463175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.463297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.463611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.464343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.466245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.471276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.472027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.472311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.472603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.490804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.492555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.503558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3412/6871] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:16:31.505527 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3460/6872] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:16:31.509696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.523850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e93a2-7d91-4749-91f2-7a62fcc5bd22 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.602634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.603460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.603767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.604102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.605192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.606745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.639794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3413/6873] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/users => generated 282 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:16:31.641040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.663389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637ffe9-33d5-4fe2-802b-49181b4bf2be admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.673424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.674521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.674938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.675431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.676336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.678766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.693366 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3461/6874] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:31.699263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.712195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42d6f-c398-4333-8039-d5dbe833571a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.719883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.720572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.720856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.721306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.722052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.724035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670377-d8a4-4e90-8656-abc9ff3e6124 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.725593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:31.747746 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3414/6875] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:31.748400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:31.771413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582e543-25f7-4acd-a3c9-fa0c0565018f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:31.778427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:31.781394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.781394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.781394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] PATH_INFO: `/v3/projects/d824fe2e7a7e45a5a273b6f759c6d860/users/f5d6a39dcd5a4514a7e6d963f61371b1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.806829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d824fe2e7a7e45a5a273b6f759c6d860, user_id=f5d6a39dcd5a4514a7e6d963f61371b1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:31.811439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:31.835689 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3462/6876] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:16:31 2022] PUT /identity/v3/projects/d824fe2e7a7e45a5a273b6f759c6d860/users/f5d6a39dcd5a4514a7e6d963f61371b1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:31.837470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f773-0147-4892-8c5f-5470a8f61b14 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:31.837807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f773-0147-4892-8c5f-5470a8f61b14 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:31.838106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f773-0147-4892-8c5f-5470a8f61b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:31.866815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6e94f773-0147-4892-8c5f-5470a8f61b14 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:31.868769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6e94f773-0147-4892-8c5f-5470a8f61b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:31.960143 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3415/6877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:31.985885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:32.001483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:32.103549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa82bdb-2daa-4ab1-a15c-793dde929a0f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:32.116339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:32.117055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:32.117381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:32.117631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:32.147449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:32.150934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:32.178527 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3463/6878] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:33.219798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:33.220315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:33.220315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:33.292753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] MFA Rules not processed for user `59e619953f32406891051e0e029c1670`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:33.293992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:33.437058 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3416/6879] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:33.452630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:33.454130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:33.544766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b89fe9-e253-487b-92b7-af4814e00a37 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:33.549573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:33.550369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:33.550507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:33.550793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:33.561287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:33.562767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da106321-c5b8-44f1-b7a1-2f2441e52875 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:33.575380 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3464/6880] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:35.383154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:35.386061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:35.415265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a87c2-3615-4f51-9d08-4bdbbecf7ae0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:35.427448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:35.429184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:35.429184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:35.432388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] PATH_INFO: `/v3/users/25ed8e5857cc4e46a4354a26613413a9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:35.439631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ed8e5857cc4e46a4354a26613413a9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:35.442309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:35.565726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ed8e5857cc4e46a4354a26613413a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:35.566992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ed8e5857cc4e46a4354a26613413a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:35.578885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ed8e5857cc4e46a4354a26613413a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:35.579999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ed8e5857cc4e46a4354a26613413a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:35.598931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ed8e5857cc4e46a4354a26613413a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:35.615277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:35.626302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3417/6881] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:35 2022] DELETE /identity/v3/users/25ed8e5857cc4e46a4354a26613413a9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:35.658828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37c29-16aa-487f-88fa-4d12c59738bb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:35.659450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37c29-16aa-487f-88fa-4d12c59738bb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:35.659997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37c29-16aa-487f-88fa-4d12c59738bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:35.696979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5de37c29-16aa-487f-88fa-4d12c59738bb None None] MFA Rules not processed for user `09431bbdbc394df8b368770d3e24a306`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:35.697968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5de37c29-16aa-487f-88fa-4d12c59738bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:35.834800 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3465/6882] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:35.958977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:35.962988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:36.070240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1142642-cf3b-481d-965d-d13b40c909f2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.078096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.079274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.079636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.079922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] PATH_INFO: `/v3/projects/85c8d0cb10be4ebeb3b8c7e899d66228` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.081133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c8d0cb10be4ebeb3b8c7e899d66228)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.083273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:36.190591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c8d0cb10be4ebeb3b8c7e899d66228', 'request_id': 'req-ad84f069-bdda-40dc-a4e0-7896a0a35669'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:36.208110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c8d0cb10be4ebeb3b8c7e899d66228', 'request_id': 'req-ad84f069-bdda-40dc-a4e0-7896a0a35669'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:36.223743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c8d0cb10be4ebeb3b8c7e899d66228', 'request_id': 'req-ad84f069-bdda-40dc-a4e0-7896a0a35669'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:36.264740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] The token cache is being invalidate because project 85c8d0cb10be4ebeb3b8c7e899d66228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:16:36.265084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:36.271779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ad84f069-bdda-40dc-a4e0-7896a0a35669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:36.274058 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3418/6883] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:16:35 2022] DELETE /identity/v3/projects/85c8d0cb10be4ebeb3b8c7e899d66228 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:16:36.279396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.280139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.280263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.329651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:36.332267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:36.425584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:36.447571 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3466/6884] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:36.459850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.460481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.461095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.503976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:36.505480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:36.522985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:36.523612 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3419/6885] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:36.535755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3bed6-aa5b-4aad-a070-4dd227055f98 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.552020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.553314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.554299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.554867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.555899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:16:36.556474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.558590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:36.581869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:36.591233 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3467/6886] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:16:36.593870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2daee0-a3b1-44b1-91e2-6bb791f94456 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.599276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.600101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.600223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.600497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.601271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.603304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:36.650154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:36.650458 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3420/6887] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:16:36 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:16:36.664980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a0d1-15cc-4821-a648-f7810ea924ea admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.756108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.757195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.757731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.758578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.781756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.786183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:36.851409 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3468/6888] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:16:36 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:16:36.855528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:36.873702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacfc16-c213-429a-998e-d721ff497ab1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.892475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.893577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.893785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.894060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.895340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.897075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:36.925454 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3421/6889] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:36.927183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:36.951937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e41fd5-47b7-43ae-9fe5-c37c4f9a5161 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:36.958263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:36.959132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:36.962973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:36.963366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:36.964270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:36.966261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3e1c-2643-43db-ba6f-2b8113484150 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:37.003786 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3469/6890] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:37.004534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:37.022153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890920c-d925-4f25-80e6-28edf70ba841 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:37.040603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:37.042710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:37.043842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:37.045298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] PATH_INFO: `/v3/projects/c284c2855bac423280d7e234dee6b7ac/users/2166b66a28214ff9802da4f955b5a4c5/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:37.089474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c284c2855bac423280d7e234dee6b7ac, user_id=2166b66a28214ff9802da4f955b5a4c5, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:37.092458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:37.128513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3422/6891] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:16:37 2022] PUT /identity/v3/projects/c284c2855bac423280d7e234dee6b7ac/users/2166b66a28214ff9802da4f955b5a4c5/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:16:37.134519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b0a8-26ab-40f8-9dce-3160809ab199 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:37.135777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b0a8-26ab-40f8-9dce-3160809ab199 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:37.136170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b0a8-26ab-40f8-9dce-3160809ab199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:37.158306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2185b0a8-26ab-40f8-9dce-3160809ab199 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:37.161338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2185b0a8-26ab-40f8-9dce-3160809ab199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:37.332087 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3470/6892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:37.352815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:37.355221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:37.435862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:37.560479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9c7e-9b70-4a76-a5e0-0e441040fb35 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:37.572441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:37.573507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:37.574013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:37.574644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:37.604261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:37.610115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:37.647290 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3423/6893] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:46.947294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:46.948343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:46.948825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.005661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] MFA Rules not processed for user `f5d6a39dcd5a4514a7e6d963f61371b1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:47.007761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:47.108968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:47.157021 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3471/6894] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:47.161465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:47.163206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:47.181904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209ec5-4115-495f-97ca-6b3abe3a8893 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:47.197418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:47.199264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:47.200172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:47.200992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.202009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:47.209493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:47.269864 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3424/6895] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:16:47 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:16:47.276419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:47.294190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078065-046f-45ed-962e-756de887ddc6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:47.307199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:47.308001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:47.308517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:47.310668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.311602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:47.313565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93a8c3-745f-43a0-8236-32988a3c7986 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:47.331109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3472/6896] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:47.334266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:47.376210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4703106-b9dc-4f7c-81f6-2205d3f6053b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:47.386685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:47.392361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:47.393381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:47.394430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] PATH_INFO: `/v3/system/users/782ef3491da1416b8e9daaf085a0819c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.417252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=782ef3491da1416b8e9daaf085a0819c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:47.419384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:47.433683 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3425/6897] 10.222.0.18 () {60 vars in 1377 bytes} [Sat Jun 4 21:16:47 2022] PUT /identity/v3/system/users/782ef3491da1416b8e9daaf085a0819c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:16:47.443321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:47.443693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:47.443989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.488777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] MFA Rules not processed for user `782ef3491da1416b8e9daaf085a0819c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:47.490666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:47.663582 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3473/6898] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:47 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 21:16:47.668216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:47.846600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca268-a2b2-4c0b-8e66-948f09e91399 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:47.911139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ef3491da1416b8e9daaf085a0819c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:47.912271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:47.912630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:47.913067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:47.913873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:47.915735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:47.918637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:47.935630 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3426/6899] 10.222.0.18 () {58 vars in 1109 bytes} [Sat Jun 4 21:16:47 2022] GET /identity/v3/services => generated 2191 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:16:47.936023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:48.144581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:48.155206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948c4fc-3b36-43da-afb5-3aadf2dc008c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:48.273498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ef3491da1416b8e9daaf085a0819c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:48.285885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:48.286186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:48.286479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] PATH_INFO: `/v3/limits` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:48.293599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:48.299797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jun 04 21:16:48.406100 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:16:48.407807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3474/6900] 10.222.0.18 () {60 vars in 1125 bytes} [Sat Jun 4 21:16:47 2022] POST /identity/v3/limits => generated 124 bytes in 476 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:16:48.413444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:48.730637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c28513-f1b3-4c48-ad98-2098be04de1e None tempest-ImageQuotaTest-609037598-system-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:48.866986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ef3491da1416b8e9daaf085a0819c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:48.867786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:48.868069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:48.868340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:48.869045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:48.870159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d6f45-0155-4e7a-bfad-75d79f7e05c8 None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:48.892933 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3427/6901] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:16:48 2022] GET /identity/v3/registered_limits => generated 129 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:16:48.901006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:49.155219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc48f4-58b5-4a5a-a782-9f2bd9854837 None tempest-ImageQuotaTest-609037598-system-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:49.238205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782ef3491da1416b8e9daaf085a0819c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:49.238897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:49.239184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:49.239469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:49.242811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:49.244142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd946b-aeaa-4dcc-a1f1-129edf6d0b2f None tempest-ImageQuotaTest-609037598-system-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:49.265865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3475/6902] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:16:48 2022] GET /identity/v3/registered_limits => generated 129 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:16:55.307543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:55.308203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:55.308324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:55.394981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] MFA Rules not processed for user `2166b66a28214ff9802da4f955b5a4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:55.396284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:55.558705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:55.564923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3428/6903] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:55.676673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:55.677203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:55.677431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:55.716292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] MFA Rules not processed for user `2166b66a28214ff9802da4f955b5a4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:16:55.717830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:55.744728 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3476/6904] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:16:55.752777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:55.755659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:16:56.022620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68678282-aedb-4f43-afb5-b9e0a0ec0d2f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:56.053466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:56.054258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:56.054412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:56.054710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:56.066608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:56.068539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:56.096442 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3429/6905] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:16:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:16:59.598310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:16:59.621522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3097d35-156d-45cd-87d2-de84f78d08cd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:16:59.635285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:16:59.638654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:16:59.639189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:16:59.639733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] PATH_INFO: `/v3/users/f5d6a39dcd5a4514a7e6d963f61371b1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:16:59.643806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d6a39dcd5a4514a7e6d963f61371b1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:16:59.646358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:16:59.671992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:59.787424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d6a39dcd5a4514a7e6d963f61371b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:59.798725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d6a39dcd5a4514a7e6d963f61371b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:59.800222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d6a39dcd5a4514a7e6d963f61371b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:59.801860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d6a39dcd5a4514a7e6d963f61371b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:59.829446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d6a39dcd5a4514a7e6d963f61371b1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:16:59.868271 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3477/6906] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:16:59 2022] DELETE /identity/v3/users/f5d6a39dcd5a4514a7e6d963f61371b1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:00.233084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:00.250455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d67b5-2720-40b7-a014-9c9b7ca2d47f service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:00.394211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:00.396157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:00.397536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:00.397996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] PATH_INFO: `/v3/projects/d824fe2e7a7e45a5a273b6f759c6d860` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:00.401746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d824fe2e7a7e45a5a273b6f759c6d860)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:00.405828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:00.516397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd824fe2e7a7e45a5a273b6f759c6d860', 'request_id': 'req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.524508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd824fe2e7a7e45a5a273b6f759c6d860', 'request_id': 'req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.533563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd824fe2e7a7e45a5a273b6f759c6d860', 'request_id': 'req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.558455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] The token cache is being invalidate because project d824fe2e7a7e45a5a273b6f759c6d860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:00.558796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.562449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6a9349c1-8ef5-45aa-a31e-75b3e6df6a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.567196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3430/6907] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:00 2022] DELETE /identity/v3/projects/d824fe2e7a7e45a5a273b6f759c6d860 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:00.571733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:00.573040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:00.597814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c7829-6286-481c-ad21-f2e59ba62359 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:00.705458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:00.707048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:00.707969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:00.708599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] PATH_INFO: `/v3/users/782ef3491da1416b8e9daaf085a0819c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:00.712247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=782ef3491da1416b8e9daaf085a0819c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:00.714642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:00.730667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:00.731630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:00.731938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:00.774003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] MFA Rules not processed for user `59e619953f32406891051e0e029c1670`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:00.775280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:00.796309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:00.865984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782ef3491da1416b8e9daaf085a0819c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.875411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782ef3491da1416b8e9daaf085a0819c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.876246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782ef3491da1416b8e9daaf085a0819c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.900493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782ef3491da1416b8e9daaf085a0819c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.929213 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3431/6908] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:00.948976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cbf4a950-044d-4b4a-8c6e-c39c09c412fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782ef3491da1416b8e9daaf085a0819c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:00.951493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=79,keystone:DELETE=20,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:00.997995 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3478/6909] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:00 2022] DELETE /identity/v3/users/782ef3491da1416b8e9daaf085a0819c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:01.675365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:01.676861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:01.692247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f97d31-3714-46f5-a7c1-eca0f12cc54b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:01.793806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:01.796008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:01.796662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:01.797028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:01.805544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:01.809043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-bedfa8d6-e260-4b1c-aa02-6afc3a020775 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:17:01.822895 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jun 04 21:17:01.824199 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:17:01.828284 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3432/6910] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:17:01 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:17:01.832266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:01.832744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:01.832848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:01.868080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:01.869492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:01.890043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:01.891549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:01.891941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:01.898036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3479/6911] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:01.914392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:01.915818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:01.927905 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3433/6912] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:01.931924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:01.944995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c361f-6607-4e75-85a2-d9174253e333 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:01.953772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:01.954750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:01.955220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:01.955981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:01.956894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:17:01.957383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:01.959839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:01.976055 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3480/6913] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:17:01.980169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:01.993433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f19e2e-bbf0-4827-9265-e05632f37b8e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.002341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.003530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.004145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.004586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.005461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.008191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.082372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3434/6914] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:02.083132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:02.105742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb3137-9b6d-4239-833d-f1e433e5f59b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.200247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.201292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.202483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.202865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.203866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.206389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.248015 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3481/6915] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:02 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:02.253064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:02.268924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264e09f-f767-4ea3-bfd0-410b2b13b487 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.281932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.283176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.283837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.284375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.285622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.287359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.304626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3435/6916] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:02.308820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:02.326121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3246-48ef-46a6-9596-13368f2c08ee admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.337014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.337832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.338269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.338722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.339647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.342141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01f8b-2be4-4d5e-aa5e-8eb4d5b48469 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.396037 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3482/6917] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:02.398105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:02.420221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d9af9-38cf-47ea-92ab-5c7a2dd5cab4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.435463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.439316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.439566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.440538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] PATH_INFO: `/v3/projects/fc6af5f33fb64a17906872b7edb1e049/users/2356361a22724a45a9213f5b1b4b71fb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.497324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6af5f33fb64a17906872b7edb1e049, user_id=2356361a22724a45a9213f5b1b4b71fb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.507645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.538630 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3436/6918] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:02 2022] PUT /identity/v3/projects/fc6af5f33fb64a17906872b7edb1e049/users/2356361a22724a45a9213f5b1b4b71fb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:02.545298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf183-04b0-4e53-933c-ca715b792e00 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.546106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf183-04b0-4e53-933c-ca715b792e00 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.546557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cf183-04b0-4e53-933c-ca715b792e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.598904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aa6cf183-04b0-4e53-933c-ca715b792e00 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:02.601770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aa6cf183-04b0-4e53-933c-ca715b792e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:02.700010 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3483/6919] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:02.715134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:02.718397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:02.854185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9711-e51f-4bc4-b2ec-201c32574b0c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:02.859854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:02.860722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:02.861070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:02.862900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:02.872795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:02.878531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:02.881592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:02.899008 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3437/6920] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:04.955190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73455-eb94-4c17-8fc7-b196ea53d460 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:04.955869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73455-eb94-4c17-8fc7-b196ea53d460 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:04.956090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73455-eb94-4c17-8fc7-b196ea53d460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:04.995187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c1b73455-eb94-4c17-8fc7-b196ea53d460 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:04.996471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c1b73455-eb94-4c17-8fc7-b196ea53d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:05.154177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:05.182996 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3484/6921] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:05.210586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:05.212713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:05.335199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538830-5cab-43e4-b431-ec41e0e92fb4 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:05.348897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:05.350024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:05.351031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:05.352078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:05.386664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:05.389431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:05.405677 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3438/6922] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:17:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:17:15.184289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:15.399255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=35 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:16.252601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:16.253258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:16.253258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:16.341449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:16.342774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:16.510849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3485/6923] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:16.511787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:16.530415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163b72-e695-485e-a609-8fa80de6e458 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:16.543064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:16.546028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:16.546599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:16.547389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:16.550121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:16.554110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:16.713033 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3439/6924] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:16 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:16.717302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:16.733385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545e8bf-eff5-4c15-a91d-88ad17556621 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:16.908271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:16.910689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:16.910980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:16.911259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:16.911993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:16.923375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:16.973915 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3486/6925] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:16 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:16.978193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:16.995352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0f59-199f-4414-af52-61fd1bd9e060 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:17.001934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:17.002633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:17.007311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:17.010035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:17.011062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:17.013832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:17.041080 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3440/6926] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:17.041830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:17.058044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0ac9a-b775-48ec-b7e1-93650d10d833 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:17.068720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:17.069652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:17.069991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:17.070209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] PATH_INFO: `/v3/projects/8915bacd5c394cca8b774743453f6585/users/d31d03063af6409a890cb9c3cf7a9a50/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:17.109494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8915bacd5c394cca8b774743453f6585, user_id=d31d03063af6409a890cb9c3cf7a9a50, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:17.119090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:17.153825 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3487/6927] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:17 2022] PUT /identity/v3/projects/8915bacd5c394cca8b774743453f6585/users/d31d03063af6409a890cb9c3cf7a9a50/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:17.158528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:17.193298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614238b-834b-474b-940f-de7dddb1b497 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:17.353563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:17.355676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:17.355676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:17.355676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:17.356407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:17.361312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65395bc8-edef-4db8-8cf6-68e34d24e2f6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:17.390967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3441/6928] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:17.396131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:17.412924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790eca-29d0-4f54-a25c-7661020e693a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:17.430839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:17.434348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:17.435339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:17.435864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] PATH_INFO: `/v3/projects/8915bacd5c394cca8b774743453f6585/users/d31d03063af6409a890cb9c3cf7a9a50/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:17.442789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8915bacd5c394cca8b774743453f6585, user_id=d31d03063af6409a890cb9c3cf7a9a50, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:17.454885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:17.501186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3488/6929] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:17 2022] PUT /identity/v3/projects/8915bacd5c394cca8b774743453f6585/users/d31d03063af6409a890cb9c3cf7a9a50/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:20.879691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55060-7b39-464c-8e61-9eedfe77f19b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:20.880285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55060-7b39-464c-8e61-9eedfe77f19b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:20.880285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55060-7b39-464c-8e61-9eedfe77f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:20.933431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82f55060-7b39-464c-8e61-9eedfe77f19b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:20.936461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82f55060-7b39-464c-8e61-9eedfe77f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:21.114283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3442/6930] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:17:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:21.120924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:21.237739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:21.283543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66fbc-89ce-4c9c-aa12-f931a59141bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:21.297727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:21.298553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:21.298927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:21.299310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:21.316699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:21.318477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:21.345469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3489/6931] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:17:30.045814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:30.046697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:30.047144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:30.090763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] MFA Rules not processed for user `d31d03063af6409a890cb9c3cf7a9a50`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:30.092283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:30.190642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:30.245546 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3443/6932] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:30.266455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:30.269324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:30.476653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530295b-4256-4c07-8335-1fc7c8df59c4 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:30.488369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:30.489486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:30.490140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:30.490671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:30.691395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:30.694312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:30.731946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3490/6933] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:31.121719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:31.123439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:31.365411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9da82-9c7d-4560-8d1b-8a918794e775 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:31.378204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:31.379299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:31.379645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:31.381090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:31.407921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:31.676241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:31.678207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:31.696143 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3444/6934] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:17:32.063204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:32.065348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:32.335079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f355-7197-462c-9d89-89bec9d781c8 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:32.361451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:32.369988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:32.375416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:32.378388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:32.394923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:32.432027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:32.434265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dc97e-537b-4eae-9659-9a49ed8c4a46 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:32.486964 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3491/6935] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:17:36.429949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:36.432826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:36.653112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ac343-a203-410a-9e88-ccc23ef4ffed service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:36.662934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:36.663875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:36.664802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:36.665188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] PATH_INFO: `/v3/users/141013aa101d4eeb8a14603127f1bb3e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:36.667379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141013aa101d4eeb8a14603127f1bb3e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:36.675118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:36.807816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:36.843801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141013aa101d4eeb8a14603127f1bb3e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:36.844650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141013aa101d4eeb8a14603127f1bb3e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:36.856396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141013aa101d4eeb8a14603127f1bb3e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:36.857297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141013aa101d4eeb8a14603127f1bb3e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:36.891412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141013aa101d4eeb8a14603127f1bb3e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:36.928723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3445/6936] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:36 2022] DELETE /identity/v3/users/141013aa101d4eeb8a14603127f1bb3e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:36.933710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd30db-41f4-4bbd-8cea-e17bfbcec588 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:36.934411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd30db-41f4-4bbd-8cea-e17bfbcec588 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:36.934671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd30db-41f4-4bbd-8cea-e17bfbcec588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:36.975411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d3fd30db-41f4-4bbd-8cea-e17bfbcec588 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:36.981816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d3fd30db-41f4-4bbd-8cea-e17bfbcec588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:36.991351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:37.187752 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3492/6937] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:37.193859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:37.196006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:37.366398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4349a11-efd3-40d3-96d7-2615b18935f5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:37.380389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:37.380389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:37.380389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:37.380389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:37.396318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:37.398527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:37.432976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3446/6938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:37.909636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efff9b-f278-4605-b6f3-dc1d87b1f24b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:37.909932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efff9b-f278-4605-b6f3-dc1d87b1f24b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:37.910212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efff9b-f278-4605-b6f3-dc1d87b1f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:37.936754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:37.938366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:37.977507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7310a-0874-465e-94fe-e1cb93978588 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:37.985718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a4efff9b-f278-4605-b6f3-dc1d87b1f24b None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:37.986623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:37.987835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:37.988422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:37.988546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] PATH_INFO: `/v3/projects/0854567570ed4b83869deb6fdd94e0b1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:37.990410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0854567570ed4b83869deb6fdd94e0b1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:37.992366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:37.995619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a4efff9b-f278-4605-b6f3-dc1d87b1f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:38.094675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0854567570ed4b83869deb6fdd94e0b1', 'request_id': 'req-e4893e4f-9c78-4cc8-a721-675a0b83d739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:38.112680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0854567570ed4b83869deb6fdd94e0b1', 'request_id': 'req-e4893e4f-9c78-4cc8-a721-675a0b83d739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:38.128430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0854567570ed4b83869deb6fdd94e0b1', 'request_id': 'req-e4893e4f-9c78-4cc8-a721-675a0b83d739'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:38.165026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] The token cache is being invalidate because project 0854567570ed4b83869deb6fdd94e0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:38.169936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:38.171020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e4893e4f-9c78-4cc8-a721-675a0b83d739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:38.178583 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3447/6939] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:37 2022] DELETE /identity/v3/projects/0854567570ed4b83869deb6fdd94e0b1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:38.181409 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3493/6940] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:38.184453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:38.187916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:38.189252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:38.247713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:38.256538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:38.335019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:38.416693 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3448/6941] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:38.425572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:38.426121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:38.426575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:38.463282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:38.464844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:38.480405 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3494/6942] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:38.485524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:38.498681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d28280-141f-40ea-9ddb-c947ef5fffb6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:38.506614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:38.508009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:38.510652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:38.511277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:38.529062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:17:38.529645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:38.531556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:38.551953 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3449/6943] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:17:38.553828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:38.574320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af8de-d3d4-466f-8d52-7f10a53557b5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:38.593666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:38.594744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:38.596380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:38.596961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:38.598104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:38.604460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:38.667270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3495/6944] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:38.678095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:38.693953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88edb1e-29ba-4e07-8a26-e7970c4428c5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:38.883853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:38.884684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:38.884974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:38.885262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:38.886040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:38.888094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:38.980943 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3450/6945] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:38 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:38.982477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:38.994914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fc3b-7fb9-44f8-a825-1ae74d0564fd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.013949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.014650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.014942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.015223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.015998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.017990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.051286 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3496/6946] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:39.053013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.068837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adea7e-f457-4ac1-8870-0eba00eb93c8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.074628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.075313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.075665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.076008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.077092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.078812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5452f-f7ac-4228-85b7-857402f0bc49 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.110286 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3451/6947] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:39.114065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.152420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08897b7e-c891-4f33-a5d6-52ce812cf607 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.167136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25035d56-8033-4449-bc91-378312015064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.168170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25035d56-8033-4449-bc91-378312015064 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.168451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25035d56-8033-4449-bc91-378312015064 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.168725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25035d56-8033-4449-bc91-378312015064 admin admin] PATH_INFO: `/v3/projects/307c5547e3b940d1a51fc614d22f8e32/users/224ecd59a97c469481051dacc261083b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.218028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25035d56-8033-4449-bc91-378312015064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307c5547e3b940d1a51fc614d22f8e32, user_id=224ecd59a97c469481051dacc261083b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.220822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25035d56-8033-4449-bc91-378312015064 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.261924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3497/6948] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:39 2022] PUT /identity/v3/projects/307c5547e3b940d1a51fc614d22f8e32/users/224ecd59a97c469481051dacc261083b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:17:39.263788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.264082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.264362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.317627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] MFA Rules not processed for user `224ecd59a97c469481051dacc261083b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:39.319156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:39.483031 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3452/6949] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:39.487465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25035d56-8033-4449-bc91-378312015064 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.597791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:39.612849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25035d56-8033-4449-bc91-378312015064 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.623710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.625059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.625689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.626825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.628222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.631031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.717932 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3498/6950] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:39 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:39.720793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.735400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.741025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:39.744720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba4d52-2f3c-4e94-a52b-7ada61d47d17 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.786174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:39.847722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.849949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.850446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.851428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.852195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.857232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.915563 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3453/6951] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:39 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:39.920108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.932724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b71b8-b512-4ce8-bcd2-bc265a4dcb45 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.945196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c44406-21e9-4887-816d-b79b839c98c6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:39.946442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.947247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.947635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.947797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.950710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:39.963678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:39.964393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:39.964721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:39.965002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:39.966079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.966656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:39.968289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.971626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:39.983816 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3454/6952] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:39.988932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:39.993060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3499/6953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:40.001542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b53221-0129-4eb1-9287-705f79ecde18 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:40.007550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:40.008217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:40.008893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:40.009322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] PATH_INFO: `/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85/users/2d994198cd344241bec7e3fd7ffb3fb8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:40.027700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f08f2ba84a4e3f9053f92052bd4f85, user_id=2d994198cd344241bec7e3fd7ffb3fb8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:40.030999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:40.051345 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3455/6954] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:39 2022] PUT /identity/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85/users/2d994198cd344241bec7e3fd7ffb3fb8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:40.055347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:40.068256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f9c1e-3221-46c3-b3b1-f3079f98dbbd service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:40.150226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:40.151022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:40.151401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:40.151801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:40.152689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:40.154540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c00323-39ef-45e7-a3ed-b26ad2281dcb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:40.170344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3500/6955] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:40.172329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:40.183402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe1bbf-6652-4289-bbaa-d908c2d89b37 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:40.191048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:40.192126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:40.192677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:40.193166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] PATH_INFO: `/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85/users/2d994198cd344241bec7e3fd7ffb3fb8/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:40.195757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f08f2ba84a4e3f9053f92052bd4f85, user_id=2d994198cd344241bec7e3fd7ffb3fb8, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:40.198750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:40.238793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3456/6956] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:40 2022] PUT /identity/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85/users/2d994198cd344241bec7e3fd7ffb3fb8/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:40.240663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:40.241024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:40.241374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:40.313764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] MFA Rules not processed for user `2d994198cd344241bec7e3fd7ffb3fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:40.315229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:40.456983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:40.509968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3501/6957] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:40.524636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:40.537614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:40.668825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e349c9-e2b0-44d3-9b4c-066920f22781 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:40.675292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:40.676127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:40.676332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:40.676568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:40.688747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:40.690801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c535723-70f8-482d-b7d2-c1c1c7103df0 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:40.703598 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3457/6958] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:40.806444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:41.005683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c19fcb-b76c-413e-9cfe-2aa3d1b54e85 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:41.025474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:41.027272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:41.027829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:41.028391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] PATH_INFO: `/v3/users/224ecd59a97c469481051dacc261083b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:41.030521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224ecd59a97c469481051dacc261083b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:41.033167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:41.106155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224ecd59a97c469481051dacc261083b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:41.116066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224ecd59a97c469481051dacc261083b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:41.117190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224ecd59a97c469481051dacc261083b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:41.117980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224ecd59a97c469481051dacc261083b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:41.135484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224ecd59a97c469481051dacc261083b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:41.165693 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3502/6959] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:40 2022] DELETE /identity/v3/users/224ecd59a97c469481051dacc261083b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:41.165939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:41.165939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:41.165939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:41.184971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:41.186198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:41.264756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3458/6960] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:41.275235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:41.276821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:41.390128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6360-0fe2-4381-8e34-9357781409d6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:41.394495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:41.395275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:41.395665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:41.396014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:41.407175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:41.408856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:41.446823 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3503/6961] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:42.436118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:42.438713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:42.464676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13676fc1-99b2-4041-a939-402a97d235c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:42.488568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:42.499563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:42.502225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:42.504429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] PATH_INFO: `/v3/projects/307c5547e3b940d1a51fc614d22f8e32` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:42.511196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307c5547e3b940d1a51fc614d22f8e32)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:42.524613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:42.542788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:42.630811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307c5547e3b940d1a51fc614d22f8e32', 'request_id': 'req-39d91397-981d-45d2-9088-cad41ba0e899'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.654523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307c5547e3b940d1a51fc614d22f8e32', 'request_id': 'req-39d91397-981d-45d2-9088-cad41ba0e899'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.666004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307c5547e3b940d1a51fc614d22f8e32', 'request_id': 'req-39d91397-981d-45d2-9088-cad41ba0e899'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.696756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] The token cache is being invalidate because project 307c5547e3b940d1a51fc614d22f8e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:42.697435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.699594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.701995 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3459/6962] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:42 2022] DELETE /identity/v3/projects/307c5547e3b940d1a51fc614d22f8e32 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:42.706366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:42.736795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a0632-dfff-4447-b192-34be36bbcbdb service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:42.756563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:42.862599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:42.864781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:42.865497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:42.866117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] PATH_INFO: `/v3/users/2d994198cd344241bec7e3fd7ffb3fb8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:42.869991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d994198cd344241bec7e3fd7ffb3fb8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:42.873544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:42.975306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d994198cd344241bec7e3fd7ffb3fb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.984185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d994198cd344241bec7e3fd7ffb3fb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.984945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d994198cd344241bec7e3fd7ffb3fb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.985596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d994198cd344241bec7e3fd7ffb3fb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:42.999986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a2d8a7e2-8c1a-4b13-82d3-e5e4da0c3f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d994198cd344241bec7e3fd7ffb3fb8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:43.024286 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3504/6963] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:42 2022] DELETE /identity/v3/users/2d994198cd344241bec7e3fd7ffb3fb8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:43.939370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:43.942561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:43.981049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d91397-981d-45d2-9088-cad41ba0e899 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.129480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.131041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.132641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.133030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] PATH_INFO: `/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.137399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f08f2ba84a4e3f9053f92052bd4f85)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.139450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.233277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f08f2ba84a4e3f9053f92052bd4f85', 'request_id': 'req-682b6311-37d4-4644-aca2-e81c79f553f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:44.242594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f08f2ba84a4e3f9053f92052bd4f85', 'request_id': 'req-682b6311-37d4-4644-aca2-e81c79f553f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:44.252252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f08f2ba84a4e3f9053f92052bd4f85', 'request_id': 'req-682b6311-37d4-4644-aca2-e81c79f553f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:44.288542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] The token cache is being invalidate because project 67f08f2ba84a4e3f9053f92052bd4f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:44.290976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:44.293686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-682b6311-37d4-4644-aca2-e81c79f553f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:44.305399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bb85-3411-4b31-92c3-129481572937 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.305838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bb85-3411-4b31-92c3-129481572937 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.306070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3460/6964] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:43 2022] DELETE /identity/v3/projects/67f08f2ba84a4e3f9053f92052bd4f85 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:44.306200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6bb85-3411-4b31-92c3-129481572937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.342364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.342879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.343231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.384534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c7a6bb85-3411-4b31-92c3-129481572937 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:44.387926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c7a6bb85-3411-4b31-92c3-129481572937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:44.394095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] MFA Rules not processed for user `2166b66a28214ff9802da4f955b5a4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:44.396754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:44.437758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:44.509813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3505/6965] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:44.510361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3461/6966] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:44.512234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.512631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.512982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.536790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:44.538184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:44.552680 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3506/6967] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:44.557132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.571422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0946e-abf8-4854-9179-d4e6fffb5034 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.578250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.579254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.579254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.580031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.580771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:17:44.581229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.583063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.598344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3462/6968] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:17:44.601923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.614322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb5b19-49f3-499b-9be4-75097d5ce508 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.619058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.619762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.620044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.620320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.621181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.623648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.663200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:44.684680 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3507/6969] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/projects => generated 395 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:44.689639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.701999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f54c3d-2417-4ee3-a808-65564bc9ed8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.763289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.764020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.764305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.764590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.765286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.768155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.793522 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3463/6970] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:44.794912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.805837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4093fd-9a5e-40dd-918a-c40ba865bc66 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.810559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.811222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.811499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.811802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.812652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.814267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.825980 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3508/6971] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:44.830494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.841477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185accbc-ea4e-448a-8b64-770e9c26adb5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.847991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.848721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.849018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.849307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.850129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.851816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47043d-98b4-4baa-be81-4f0a99a3f9a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.871721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3464/6972] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:44.873249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:44.894656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a2f79-78bd-4310-94e7-ef4a9e132d84 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:44.902316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:44.904022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.904303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.905302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] PATH_INFO: `/v3/projects/941319569ea44243830f9f524a04f769/users/54bf05edabd042a9ae88038c25509d8b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:44.929779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941319569ea44243830f9f524a04f769, user_id=54bf05edabd042a9ae88038c25509d8b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:44.933027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:44.954455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3509/6973] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:44 2022] PUT /identity/v3/projects/941319569ea44243830f9f524a04f769/users/54bf05edabd042a9ae88038c25509d8b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:44.965542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:44.966051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:44.966198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.008442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] MFA Rules not processed for user `54bf05edabd042a9ae88038c25509d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:45.009703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:45.127959 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3465/6974] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:45.132966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.204833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf9fde-07de-49f2-bad6-ae4c1c35aa08 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.210079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.210746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.211027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.211439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.212176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.220833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.256754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3510/6975] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:45 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:45.260718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.278989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87154bc0-e880-48d4-8359-7b9f078dd6c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.305285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:45.380692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.381020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.381474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.381768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.382550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.384718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.444210 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3466/6976] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:45 2022] POST /identity/v3/users => generated 307 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:45.448196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.468285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3ea93-c1ca-4b97-a487-93783b5c7055 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.480900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.483771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.485589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.486078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.488421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.493042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.514596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.523716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3511/6977] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:45.537634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1ca4-06cf-47d1-aca6-27f934e00fa1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.543308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.544298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.544591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.544873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] PATH_INFO: `/v3/projects/8e16ac3bac2949fc8e0169165842558d/users/9b0f65d61e60436884e849d013279955/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.575299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e16ac3bac2949fc8e0169165842558d, user_id=9b0f65d61e60436884e849d013279955, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.578065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.610860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3467/6978] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:45 2022] PUT /identity/v3/projects/8e16ac3bac2949fc8e0169165842558d/users/9b0f65d61e60436884e849d013279955/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:45.615066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.628861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b7089-724b-40f9-ab3d-244d9fc316e5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.696141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.697129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.697329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.697709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.698513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.700388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebbad8-7d62-45a3-b437-e3c6d67ebe98 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.715789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3512/6979] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:45.717235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.729557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcd593-d443-43bf-962c-5d2dab3f6dab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:45.734645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:45.735742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.736234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.736520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] PATH_INFO: `/v3/projects/8e16ac3bac2949fc8e0169165842558d/users/9b0f65d61e60436884e849d013279955/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.738621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e16ac3bac2949fc8e0169165842558d, user_id=9b0f65d61e60436884e849d013279955, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:45.741332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:45.753801 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3468/6980] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:45 2022] PUT /identity/v3/projects/8e16ac3bac2949fc8e0169165842558d/users/9b0f65d61e60436884e849d013279955/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:45.766384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:45.766755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:45.767385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:45.801061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] MFA Rules not processed for user `9b0f65d61e60436884e849d013279955`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:45.802419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:45.831678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:45.916533 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3513/6981] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:45.929091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:45.931470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:46.014798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1377eaa-c3a3-487a-a993-cd1509ac4e8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:46.019451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:46.020233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:46.020583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:46.021380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:46.032129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:46.033799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:46.047041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3469/6982] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:46.180072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:46.194630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418036b-27f4-4747-94be-d01fe8a84c9a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:46.202768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:46.204567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:46.205312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:46.206202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:46.288753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:46.290790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:46.314805 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3514/6983] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:48.057003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:48.058901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:48.110884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:48.113569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:48.186890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce54c0d-1249-4d6d-95f1-f000c23a7335 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:48.195319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:48.196087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:48.196550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:48.197092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:48.204139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:48.249540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:48.255720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:48.273586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10a907-0e7e-477c-98ec-9ff4849d157f service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:48.276951 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3470/6984] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:48.279770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:48.280790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:48.281406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:48.281882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:48.295227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:48.296757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:48.314133 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3515/6985] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:49.662212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:49.664483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:49.696392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:49.752776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220251a8-88df-4f4d-80ee-453c6ce5ce6f service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:49.757028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:49.757991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:49.758471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:49.758958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:49.761010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:49.918938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:49.920651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:49.944954 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3471/6986] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:17:50.025981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:50.028866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:50.056353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1739cd-c4ac-4b15-86e5-cc08c7b862b6 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:50.063129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:50.064268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:50.064778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:50.065288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:50.068480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:50.086915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:50.088673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:50.101134 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3516/6987] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:50.192787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:50.206052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0e1a8-70aa-4510-ac57-7e4a11f6ff32 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:50.211168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:50.211999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:50.212432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:50.212875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:50.215751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:50.232685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:50.234134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f72934-a601-4c6e-95a4-0119737e9f00 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:50.247847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3472/6988] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:51.204746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:51.281356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:51.304672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295d96-3c0f-4107-affa-89bc48f4affc service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:51.311257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:51.312322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:51.313060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:51.313410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] PATH_INFO: `/v3/users/54bf05edabd042a9ae88038c25509d8b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:51.315953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bf05edabd042a9ae88038c25509d8b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:51.318934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:51.414524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bf05edabd042a9ae88038c25509d8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:51.426527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bf05edabd042a9ae88038c25509d8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:51.427481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bf05edabd042a9ae88038c25509d8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:51.428095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bf05edabd042a9ae88038c25509d8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:51.446007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bf05edabd042a9ae88038c25509d8b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:51.464625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3517/6989] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:51 2022] DELETE /identity/v3/users/54bf05edabd042a9ae88038c25509d8b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:51.469220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:51.469789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:51.469789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:51.490369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:51.493495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:51.597235 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3473/6990] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:51.607809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:51.610344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:51.691783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1359-b70d-4885-a076-2d5ac95c6663 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:51.695739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:51.696846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:51.696846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:51.697108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:51.708431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:51.710167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:51.721626 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3518/6991] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:52.104622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:52.106495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:52.127809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58400895-b7c1-40b7-b537-01ba99f614c3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:52.139581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:52.140474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:52.140754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:52.141026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] PATH_INFO: `/v3/projects/941319569ea44243830f9f524a04f769` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:52.142781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941319569ea44243830f9f524a04f769)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:52.147828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:52.238043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:52.241082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941319569ea44243830f9f524a04f769', 'request_id': 'req-e73a4a11-86a9-4eab-8a44-507e19fa86f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.249682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941319569ea44243830f9f524a04f769', 'request_id': 'req-e73a4a11-86a9-4eab-8a44-507e19fa86f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.260082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941319569ea44243830f9f524a04f769', 'request_id': 'req-e73a4a11-86a9-4eab-8a44-507e19fa86f4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.279138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] The token cache is being invalidate because project 941319569ea44243830f9f524a04f769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:52.279536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.280249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.282268 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3474/6992] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:52 2022] DELETE /identity/v3/projects/941319569ea44243830f9f524a04f769 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:52.286209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:52.298817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44681ca-ec45-4457-bbdb-66e2470a8c8a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:52.384880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:52.386753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:52.388475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:52.388475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] PATH_INFO: `/v3/users/9b0f65d61e60436884e849d013279955` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:52.390350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0f65d61e60436884e849d013279955)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:52.394639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:52.410789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:52.451244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0f65d61e60436884e849d013279955'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.458744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0f65d61e60436884e849d013279955'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.459706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0f65d61e60436884e849d013279955'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.460811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0f65d61e60436884e849d013279955'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.474677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8c47bc5a-edc1-4cba-b46c-c078a8bdf311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0f65d61e60436884e849d013279955'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.490527 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3519/6993] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:52 2022] DELETE /identity/v3/users/9b0f65d61e60436884e849d013279955 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:52.784161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:52.785799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:52.802357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a4a11-86a9-4eab-8a44-507e19fa86f4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:52.869799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:52.870985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:52.871627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:52.872001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] PATH_INFO: `/v3/projects/8e16ac3bac2949fc8e0169165842558d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:52.873798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e16ac3bac2949fc8e0169165842558d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:52.875994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:52.949628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e16ac3bac2949fc8e0169165842558d', 'request_id': 'req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.956329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e16ac3bac2949fc8e0169165842558d', 'request_id': 'req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.971294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e16ac3bac2949fc8e0169165842558d', 'request_id': 'req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.995936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] The token cache is being invalidate because project 8e16ac3bac2949fc8e0169165842558d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:52.996168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.996977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b370e7cc-3fbf-41ee-aff1-c59ca290e01e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:52.998618 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3475/6994] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:52 2022] DELETE /identity/v3/projects/8e16ac3bac2949fc8e0169165842558d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:53.004483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.004644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.007742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.033743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:53.035556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:53.105181 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3520/6995] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:53.112966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.113791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.113927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.140901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:53.142602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:53.154541 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3476/6996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:53.158963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.169738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc4a9-ab9f-4785-92ab-3bb947aa4ca2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.176172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.176860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.177146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.177424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.178171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:17:53.178481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.180165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.195789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3521/6997] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:17:53.198097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.210178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15d8e1-7c56-41a8-afbe-37edab84892d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.215341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.216048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.216512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.216792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.217525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.219494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.251321 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3477/6998] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:53.252893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.265780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aefe74-494f-4652-9092-a71f6916ae85 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.343227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.343952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.344217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.344582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.345637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.347782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.390911 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3522/6999] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:53.391158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.402684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0487d36-85ce-4c71-847a-21c4df107271 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.408072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.408732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.409019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.409301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.410047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.411743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.427061 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3478/7000] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:53.428395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.442349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b84d08-d29d-4788-accd-6167b1440ade admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.448264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.449057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.449336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.449609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.450459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.452145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65331c-aa56-4adf-8d24-83f66a3630a9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.453833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:53.479548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3523/7001] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:53.481552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.495464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de7c3-42f7-41d4-b5b9-3cc353199bb2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.501051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.502287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.502586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.502977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] PATH_INFO: `/v3/projects/3efe6e7bbae04d729779563e0dda8c79/users/a7a150aa7b564de48537889c367cb04f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.543566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efe6e7bbae04d729779563e0dda8c79, user_id=a7a150aa7b564de48537889c367cb04f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.545453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.558367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:53.569088 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3479/7002] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:53 2022] PUT /identity/v3/projects/3efe6e7bbae04d729779563e0dda8c79/users/a7a150aa7b564de48537889c367cb04f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:53.576425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.576732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.576987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.608230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] MFA Rules not processed for user `a7a150aa7b564de48537889c367cb04f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:53.609740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:53.691569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3524/7003] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:53.696328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.788529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2204-8453-44ef-943d-e76ee76b1dcf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.795257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.795990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.796279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.796560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.797814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.799246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.829475 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3480/7004] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:53.833816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.873838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ba577-0270-4345-8fc4-4b9597153597 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:53.945626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:53.946648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:53.947730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:53.948235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:53.950116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:53.952416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:53.982256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3525/7005] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:53 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:53.986468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:53.998118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3645-db1a-4c10-be1f-597e800530cd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.003390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.003904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.004257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.004610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.005436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.007268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.019925 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3481/7006] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:17:54.024979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:54.052157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa4905-3f9c-42b7-845d-1ccf5fd3ec20 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.067744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.068717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.068995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.069273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] PATH_INFO: `/v3/projects/ff1567d7530d443eb00c1b19a6659857/users/e37b795269bc4a4fb6cff41b6d5d31bc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.102891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1567d7530d443eb00c1b19a6659857, user_id=e37b795269bc4a4fb6cff41b6d5d31bc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.106319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.129552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3526/7007] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:54 2022] PUT /identity/v3/projects/ff1567d7530d443eb00c1b19a6659857/users/e37b795269bc4a4fb6cff41b6d5d31bc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:17:54.133961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:54.153122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784724d-a1c6-4f5a-b562-f6e07c09a655 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.220244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.220912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.221194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.221474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.222202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.223848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7ac6-0dc6-401f-851b-4ec4936f764b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.241267 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3482/7008] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:54.245945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:54.257678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48723a4-8a81-4fbe-89f1-1a58f73a254f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.263569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.264562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.264906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.265250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] PATH_INFO: `/v3/projects/ff1567d7530d443eb00c1b19a6659857/users/e37b795269bc4a4fb6cff41b6d5d31bc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.267846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1567d7530d443eb00c1b19a6659857, user_id=e37b795269bc4a4fb6cff41b6d5d31bc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.271416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.282997 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3527/7009] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:54 2022] PUT /identity/v3/projects/ff1567d7530d443eb00c1b19a6659857/users/e37b795269bc4a4fb6cff41b6d5d31bc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:54.297000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc898-4b02-40f3-ad5b-d380abbeb2fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.297000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc898-4b02-40f3-ad5b-d380abbeb2fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.297000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc898-4b02-40f3-ad5b-d380abbeb2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.334805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7f5bc898-4b02-40f3-ad5b-d380abbeb2fd None None] MFA Rules not processed for user `e37b795269bc4a4fb6cff41b6d5d31bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:54.336048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7f5bc898-4b02-40f3-ad5b-d380abbeb2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:54.398217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:54.408772 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3483/7010] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:54.419861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:54.421801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:54.498104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:54.537148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75260d-26f2-4b12-8991-a1a652398ead admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.547889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.549024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.549684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.549684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.566904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.568744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.580184 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3528/7011] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:54.674791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.675204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.675436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.706307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:54.707582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:54.782360 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3484/7012] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:17:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:54.795894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:54.797409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:54.900730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684152d2-5537-4e7d-b945-65e541f44473 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:54.907964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:54.908875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:54.909252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:54.910019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:54.920285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:54.923058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7223393-d6c6-4261-a763-3cd63fc69390 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:54.934023 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3529/7013] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:17:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:17:55.513982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:55.645008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540990-cc61-4e47-9cf8-073bbade39de None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:55.650954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:55.652604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:55.653156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:55.654468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] PATH_INFO: `/v3/users/a7a150aa7b564de48537889c367cb04f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:55.656128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a150aa7b564de48537889c367cb04f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:55.658342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:55.735858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a150aa7b564de48537889c367cb04f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:55.738121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a150aa7b564de48537889c367cb04f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:55.758332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a150aa7b564de48537889c367cb04f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:55.764729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a150aa7b564de48537889c367cb04f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:55.791174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a150aa7b564de48537889c367cb04f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:55.819816 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3485/7014] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:55 2022] DELETE /identity/v3/users/a7a150aa7b564de48537889c367cb04f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:55.822290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:55.822807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:55.822903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:55.850171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:55.851467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:55.987742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3530/7015] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:55.996452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:55.997966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:56.050002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:56.143475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dcf61-a369-4aea-88f6-15d71aa0a233 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:56.151483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:56.152414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:56.152701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:56.152980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:56.170819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:56.170819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:56.187629 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3486/7016] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:17:56.963948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:56.966161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:57.028939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38a79-449a-4c67-8298-b28147674a61 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:57.066022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:57.066876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:57.067162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:57.067439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] PATH_INFO: `/v3/projects/3efe6e7bbae04d729779563e0dda8c79` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:57.079073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efe6e7bbae04d729779563e0dda8c79)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:57.084781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:57.182954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efe6e7bbae04d729779563e0dda8c79', 'request_id': 'req-92055931-29fd-4308-bc7f-5b6bfa6a53e1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.193405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efe6e7bbae04d729779563e0dda8c79', 'request_id': 'req-92055931-29fd-4308-bc7f-5b6bfa6a53e1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.223671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efe6e7bbae04d729779563e0dda8c79', 'request_id': 'req-92055931-29fd-4308-bc7f-5b6bfa6a53e1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.239712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:57.263766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] The token cache is being invalidate because project 3efe6e7bbae04d729779563e0dda8c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:57.264195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.265491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.273034 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3531/7017] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:56 2022] DELETE /identity/v3/projects/3efe6e7bbae04d729779563e0dda8c79 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:57.274917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:57.288937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff54f-aff8-44d6-b9fb-52014ff18bba service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:57.422253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:57.423542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:57.423848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:57.424299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] PATH_INFO: `/v3/users/e37b795269bc4a4fb6cff41b6d5d31bc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:57.426635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37b795269bc4a4fb6cff41b6d5d31bc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:57.444047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:57.564953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37b795269bc4a4fb6cff41b6d5d31bc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.569199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37b795269bc4a4fb6cff41b6d5d31bc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.581285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37b795269bc4a4fb6cff41b6d5d31bc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.582470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37b795269bc4a4fb6cff41b6d5d31bc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.655336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb9be617-d3be-47f2-9ef5-0bdca114b2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37b795269bc4a4fb6cff41b6d5d31bc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:57.675974 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3487/7018] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:17:57 2022] DELETE /identity/v3/users/e37b795269bc4a4fb6cff41b6d5d31bc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:58.179184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.181921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:58.211390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92055931-29fd-4308-bc7f-5b6bfa6a53e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.280004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.281014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.281291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.281608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] PATH_INFO: `/v3/projects/ff1567d7530d443eb00c1b19a6659857` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.283377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1567d7530d443eb00c1b19a6659857)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.284826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.335386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1567d7530d443eb00c1b19a6659857', 'request_id': 'req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:58.342008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1567d7530d443eb00c1b19a6659857', 'request_id': 'req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:58.347959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1567d7530d443eb00c1b19a6659857', 'request_id': 'req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:58.361784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] The token cache is being invalidate because project ff1567d7530d443eb00c1b19a6659857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:17:58.362079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:58.362697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-316c36ae-92a9-45e6-b8a0-22f1d4c1259a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:17:58.364565 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3532/7019] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:17:58 2022] DELETE /identity/v3/projects/ff1567d7530d443eb00c1b19a6659857 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:58.369596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.370136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.370329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.393477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:58.394813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:58.436591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:58.463909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3488/7020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:58.468264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.468552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.468827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.488554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:58.489760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:58.498859 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3533/7021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:58.503244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.513696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac573d4-9b18-4c82-b8ca-1f570cccd83a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.521706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.522585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.522937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.523459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.524614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:17:58.524994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.537204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.571225 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3489/7022] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:17:58.572476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.583907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb629-c567-4299-afca-cdd462d14179 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.590824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.591846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.592275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.592689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.593419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.595581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.636553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3534/7023] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:58 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:58.638193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.667210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92732f9f-ba9b-4884-abbb-f90e3c702215 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.766573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.767754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.768099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.768437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.769251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.771713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.799313 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3490/7024] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:58 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:17:58.803706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.815862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b492e-913e-46a9-9d82-62e2115e4fa7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.821388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.822664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.822664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.835298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.836305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.838000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.855417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3535/7025] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:58.859711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.874155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf378d-a605-4d1e-bb6e-5bf8b43a2b00 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.881422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.882384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.883004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.883634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.884351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.887209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473ff98-1835-464c-b100-3d38b4786c1a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.907555 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3491/7026] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:58.910891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:58.922752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2504c-da71-481e-a949-d593489d00d8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:58.928226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:58.929128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.929446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.930653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] PATH_INFO: `/v3/projects/dce38e77bab94c85a10d14d424bbd255/users/4d5a489be63544e084bf03c64e3ebab0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:58.954563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce38e77bab94c85a10d14d424bbd255, user_id=4d5a489be63544e084bf03c64e3ebab0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:58.957647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:58.988552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3536/7027] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:58 2022] PUT /identity/v3/projects/dce38e77bab94c85a10d14d424bbd255/users/4d5a489be63544e084bf03c64e3ebab0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:17:58.992453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:58.992782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:58.993020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.037898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] MFA Rules not processed for user `4d5a489be63544e084bf03c64e3ebab0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:59.041051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:59.158221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3492/7028] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:17:59.162736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:59.200155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:59.290425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0723-bb10-4c01-bacc-bd02bcf34ef5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:59.297238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:59.298441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.299074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.299617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.300893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:59.303054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:59.367886 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3537/7029] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:59 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:59.372386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:59.387191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffe11d-5431-4ddf-b161-d9a927c71de3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:59.450690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:59.473441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:59.474244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.474610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.474950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.475906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:59.483559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:59.508955 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3493/7030] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:17:59 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:17:59.521026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:59.547304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603fed3-b005-49ce-9342-c8ab5d19fcd8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:59.560919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:59.561768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.562150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.562529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.563373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:59.565124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:59.588054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3538/7031] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:59.592513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:59.617252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906413d9-7c75-488c-b77f-372d71d26114 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:59.629734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:59.630870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.631392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.631970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.633291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:59.635877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34afaf5-84a6-4374-b17c-050149806bea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:59.653208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3494/7032] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:17:59.657494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:17:59.668949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412d88-b22f-4ae8-973b-68bd4afb28e3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:17:59.674153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:17:59.675122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.675409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.675729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] PATH_INFO: `/v3/projects/73507a07e4844c0fb6f7f1670e99df9b/users/91e381ad35f94152802ed6faeab4fd47/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.693948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73507a07e4844c0fb6f7f1670e99df9b, user_id=91e381ad35f94152802ed6faeab4fd47, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:17:59.697164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:17:59.717770 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3539/7033] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:17:59 2022] PUT /identity/v3/projects/73507a07e4844c0fb6f7f1670e99df9b/users/91e381ad35f94152802ed6faeab4fd47/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:17:59.733981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:17:59.734833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:17:59.735350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:17:59.777389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] MFA Rules not processed for user `91e381ad35f94152802ed6faeab4fd47`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:17:59.778974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:17:59.889569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3495/7034] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:17:59.894414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.018116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42099cb3-0f85-48f4-9700-8917f104c136 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.025804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.026659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.043359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.043900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.045619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.047565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.078740 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3540/7035] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:17:59 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:00.086082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.097735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68b66-6bdc-4ce6-87fb-efd518012640 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.192591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.193389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.193879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.194219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.195017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.197230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6391b3-e585-40f6-9c9c-cd423fe7c5f2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.234161 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3496/7036] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:00 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:00.238465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.253057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499171-be2b-4ffb-9aad-5a1c6af2cdb3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.267345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.270071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.270299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.270875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.272810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.275292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.284625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.284625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.284625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.309019 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3541/7037] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:00.311297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.326550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cde41-3239-45b2-b32e-7a9d51b9d5e2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.330564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:00.332548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:00.333498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.334791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.335098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.335465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] PATH_INFO: `/v3/projects/da5bb44d813b43308a399522925be0a2/users/8632c41d25784ffea97cb0cf5ce5d5fc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.361406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5bb44d813b43308a399522925be0a2, user_id=8632c41d25784ffea97cb0cf5ce5d5fc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.364835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.389660 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3542/7038] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:00 2022] PUT /identity/v3/projects/da5bb44d813b43308a399522925be0a2/users/8632c41d25784ffea97cb0cf5ce5d5fc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:00.394890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.433519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:00.443813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:00.509884 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3497/7039] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:00.522183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb05f-e648-479a-9407-8fc0a5f65f0e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.527580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.528284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.529274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.529274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.530132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.531741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.544213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3543/7040] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:00.544925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.546361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:00.549667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.585831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07115-e4ae-4914-8212-897be6de7035 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.596501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.599215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.599383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.599651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] PATH_INFO: `/v3/projects/da5bb44d813b43308a399522925be0a2/users/8632c41d25784ffea97cb0cf5ce5d5fc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.606565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5bb44d813b43308a399522925be0a2, user_id=8632c41d25784ffea97cb0cf5ce5d5fc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:00.609285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915d978-b6fa-47d2-aedf-0e91a27f5a1b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:00.636041 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3544/7041] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:00 2022] PUT /identity/v3/projects/da5bb44d813b43308a399522925be0a2/users/8632c41d25784ffea97cb0cf5ce5d5fc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:00.652400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.653069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.653451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:00.716401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] MFA Rules not processed for user `8632c41d25784ffea97cb0cf5ce5d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:00.717909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:00.732911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9251-c3e5-4de8-b2d3-634dcde451c4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:00.837192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3545/7042] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:00.849474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:00.850985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:00.865790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:00.868413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:00.868413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:00.868679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:01.009684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ec61-40f5-4ca4-a1b3-deca6e8d38e3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:01.014593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:01.015259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:01.015570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:01.015847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:01.020444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:01.022174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:01.032961 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3498/7043] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:18:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:01.080274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:01.112274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:01.113853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccdc1c-5ff5-4131-9d2e-5db2b05b8273 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:01.125806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3546/7044] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:02.985223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:03.002443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c2132-5b09-4e73-99ef-359cf93e29b0 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:03.023362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:03.024851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:03.025137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:03.025526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:03.047255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdeb65-c188-4ab8-8c3c-04eac7e6bd21 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:03.047862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdeb65-c188-4ab8-8c3c-04eac7e6bd21 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:03.048027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdeb65-c188-4ab8-8c3c-04eac7e6bd21 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:03.049851 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3547/7045] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:18:03.066111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:03.068021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:03.068189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:03.068462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:03.148380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:03.149768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:03.162917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:03.171419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:03.175008 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3499/7046] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:03.399914 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3548/7047] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:03.442314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:03.444368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:03.492989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb3dae-7221-4394-8a36-d49543ff07b5 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:03.516269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:03.517287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:03.517600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:03.517910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:03.551858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:03.552745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:03.569887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3500/7048] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:04.213335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:04.225236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d0ba-50a2-4d84-ad6a-3bb3d979089f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:04.229030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:04.229893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:04.230244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:04.230524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:04.240143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:04.241574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e82b-5d9e-4333-8b80-acf203e51a12 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:04.251455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3549/7049] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:08.242323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:08.308673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb97f4-a0a4-49f3-adec-cd88f62860ee service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:08.314777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:08.315642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:08.315922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:08.316196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] PATH_INFO: `/v3/users/4d5a489be63544e084bf03c64e3ebab0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:08.317560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5a489be63544e084bf03c64e3ebab0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:08.319539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:08.373217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5a489be63544e084bf03c64e3ebab0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:08.373976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5a489be63544e084bf03c64e3ebab0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:08.381390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5a489be63544e084bf03c64e3ebab0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:08.382158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5a489be63544e084bf03c64e3ebab0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:08.395764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5a489be63544e084bf03c64e3ebab0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:08.410631 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3501/7050] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:08 2022] DELETE /identity/v3/users/4d5a489be63544e084bf03c64e3ebab0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:08.415279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:08.415837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:08.415975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:08.435325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:08.436742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:08.499197 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3550/7051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:08.509179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:08.510670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:08.545851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:08.578700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109e1fe-fff4-47f4-ad38-d319b4f0f913 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:08.582452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:08.583140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:08.583482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:08.583855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:08.593209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:08.594679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:08.604639 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3502/7052] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:09.018753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:09.020384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:09.033495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976936e8-a095-4eb5-8994-9878d6880290 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:09.038756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:09.039661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:09.039945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:09.040221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] PATH_INFO: `/v3/projects/dce38e77bab94c85a10d14d424bbd255` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:09.041461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce38e77bab94c85a10d14d424bbd255)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:09.044433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:09.106695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:09.108301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce38e77bab94c85a10d14d424bbd255', 'request_id': 'req-6cf0e2a2-1729-4fe2-b85c-a7f293557791'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.118364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce38e77bab94c85a10d14d424bbd255', 'request_id': 'req-6cf0e2a2-1729-4fe2-b85c-a7f293557791'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.125671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce38e77bab94c85a10d14d424bbd255', 'request_id': 'req-6cf0e2a2-1729-4fe2-b85c-a7f293557791'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.146269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] The token cache is being invalidate because project dce38e77bab94c85a10d14d424bbd255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:09.146647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.147425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.149132 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3551/7053] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:09 2022] DELETE /identity/v3/projects/dce38e77bab94c85a10d14d424bbd255 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:09.154227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:09.168189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac342660-c0b0-48ba-94e7-f5194af1372c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:09.257970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:09.261898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:09.261898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:09.261898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] PATH_INFO: `/v3/users/91e381ad35f94152802ed6faeab4fd47` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:09.266041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e381ad35f94152802ed6faeab4fd47)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:09.268574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:09.338215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e381ad35f94152802ed6faeab4fd47'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.338946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e381ad35f94152802ed6faeab4fd47'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.346925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e381ad35f94152802ed6faeab4fd47'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.347733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e381ad35f94152802ed6faeab4fd47'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.360350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e381ad35f94152802ed6faeab4fd47'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.378402 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3503/7054] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:09 2022] DELETE /identity/v3/users/91e381ad35f94152802ed6faeab4fd47 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:09.771255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:09.774269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:09.793016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0e2a2-1729-4fe2-b85c-a7f293557791 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:09.886970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:09.887910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:09.888199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:09.888482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] PATH_INFO: `/v3/projects/73507a07e4844c0fb6f7f1670e99df9b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:09.889788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73507a07e4844c0fb6f7f1670e99df9b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:09.892254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:09.948648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73507a07e4844c0fb6f7f1670e99df9b', 'request_id': 'req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.955491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73507a07e4844c0fb6f7f1670e99df9b', 'request_id': 'req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.962217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73507a07e4844c0fb6f7f1670e99df9b', 'request_id': 'req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.976391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] The token cache is being invalidate because project 73507a07e4844c0fb6f7f1670e99df9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:09.976697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.977348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:09.978969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3552/7055] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:09 2022] DELETE /identity/v3/projects/73507a07e4844c0fb6f7f1670e99df9b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:09.983080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:09.984581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:09.997570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846940d-8735-4256-b51f-987187eeca75 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:10.060493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:10.077421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:10.078487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:10.079161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:10.080039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] PATH_INFO: `/v3/users/8632c41d25784ffea97cb0cf5ce5d5fc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:10.081551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8632c41d25784ffea97cb0cf5ce5d5fc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:10.084604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:10.201556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8632c41d25784ffea97cb0cf5ce5d5fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.202562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8632c41d25784ffea97cb0cf5ce5d5fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.213793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8632c41d25784ffea97cb0cf5ce5d5fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.214984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8632c41d25784ffea97cb0cf5ce5d5fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.237305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa0ce1c2-1e81-43d0-aef8-3fe67c8d79c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8632c41d25784ffea97cb0cf5ce5d5fc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.260566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3504/7056] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:09 2022] DELETE /identity/v3/users/8632c41d25784ffea97cb0cf5ce5d5fc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:10.595796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:10.597652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:10.615332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cdc7-18b3-4b2d-8c20-fd34ee49aba4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:10.687669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:10.689527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:10.690007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:10.690332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] PATH_INFO: `/v3/projects/da5bb44d813b43308a399522925be0a2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:10.692282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5bb44d813b43308a399522925be0a2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:10.694711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:10.706148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:10.772109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5bb44d813b43308a399522925be0a2', 'request_id': 'req-30082dfb-3181-443c-b593-cc95f0a88b16'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.778713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5bb44d813b43308a399522925be0a2', 'request_id': 'req-30082dfb-3181-443c-b593-cc95f0a88b16'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.784529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5bb44d813b43308a399522925be0a2', 'request_id': 'req-30082dfb-3181-443c-b593-cc95f0a88b16'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.801069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] The token cache is being invalidate because project da5bb44d813b43308a399522925be0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:10.801361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.802135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-30082dfb-3181-443c-b593-cc95f0a88b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:10.803861 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3553/7057] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:10 2022] DELETE /identity/v3/projects/da5bb44d813b43308a399522925be0a2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:10.809998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:10.810355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:10.810720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:10.830896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:10.832166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:10.905272 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3505/7058] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:10.918102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:10.918631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:10.919026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:10.943910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:10.943910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:10.952081 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3554/7059] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:10.957963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:10.970304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a18ef-13e9-4a98-9db5-af314afa5927 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:10.975079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:10.975776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:10.976054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:10.976328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:10.977078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:10.977380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:10.978961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:10.990674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3506/7060] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:10.995262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.005255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3db70-b333-49b7-b333-5f31ee56ca6f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.009871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.010531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.010990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.011129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.011902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.013804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.040709 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3555/7061] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:10 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:11.046167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.065486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eda4a-b373-4815-afcd-3bd2ce0de091 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.128015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:11.134862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.135720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.136261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.136802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.137956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.140077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.164467 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3507/7062] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:11 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:11.168736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.179072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed51a-94d9-4587-bafe-555d1a8667e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.183952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.184900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.185187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.185464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.186220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.187868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.209128 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3556/7063] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:11.210655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.225668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baf2c8-59f4-4b9c-add6-e5f2665b939e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.231263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.232033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.232419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.232718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.233462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.235064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2d959-a7dd-42fe-ab2a-c4a2ec20dccd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.245727 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3508/7064] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:11.249944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.261557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf63e12-d17f-4076-898f-ceed63bfc0e3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.266051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.267388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.267703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.268005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] PATH_INFO: `/v3/projects/2c417b1fc0ad4165bbdc7241d6a121b0/users/c24c494c63bc4a7db02c60e5421175dc/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.295211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c417b1fc0ad4165bbdc7241d6a121b0, user_id=c24c494c63bc4a7db02c60e5421175dc, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.298304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.314621 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3557/7065] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:11 2022] PUT /identity/v3/projects/2c417b1fc0ad4165bbdc7241d6a121b0/users/c24c494c63bc4a7db02c60e5421175dc/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:11.325576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252257-2ade-4d41-986a-1bb4bc943ba8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.326183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252257-2ade-4d41-986a-1bb4bc943ba8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.326338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252257-2ade-4d41-986a-1bb4bc943ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.356351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-50252257-2ade-4d41-986a-1bb4bc943ba8 None None] MFA Rules not processed for user `c24c494c63bc4a7db02c60e5421175dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:11.358249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-50252257-2ade-4d41-986a-1bb4bc943ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:11.489524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3509/7066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:11.501931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:11.503801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:11.597128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae500b-271b-4f54-a042-692ab33a92df admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:11.602151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:11.602809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:11.603088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:11.603359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:11.614586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:11.616133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:11.636927 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3558/7067] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:12.870791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb1ee-e9bc-4844-9d1a-b94d99a6ef40 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:12.871313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb1ee-e9bc-4844-9d1a-b94d99a6ef40 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:12.871313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bb1ee-e9bc-4844-9d1a-b94d99a6ef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:12.891567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4f4bb1ee-e9bc-4844-9d1a-b94d99a6ef40 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:12.893233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4f4bb1ee-e9bc-4844-9d1a-b94d99a6ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:12.961592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3510/7068] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:12.990280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:12.992182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:13.048923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:13.087780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160eb8-a4bb-465c-a286-109a6549a65e service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:13.093256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:13.093964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:13.094184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:13.094458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:13.103213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:13.105302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:13.115016 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3559/7069] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:14.153834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e7-5a30-46d7-bb39-c7bfa088e0ff None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:14.154345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e7-5a30-46d7-bb39-c7bfa088e0ff None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:14.154456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e7-5a30-46d7-bb39-c7bfa088e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:14.173263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-50e3d3e7-5a30-46d7-bb39-c7bfa088e0ff None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:14.174485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-50e3d3e7-5a30-46d7-bb39-c7bfa088e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:14.242567 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3511/7070] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:14.269177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:14.397106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4cc5c-4bf5-4f51-b770-bec434abf3f4 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:14.406009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:14.406909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:14.407450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:14.408194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] PATH_INFO: `/v3/users/c24c494c63bc4a7db02c60e5421175dc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:14.409153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24c494c63bc4a7db02c60e5421175dc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:14.411375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:14.464061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24c494c63bc4a7db02c60e5421175dc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:14.471005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24c494c63bc4a7db02c60e5421175dc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:14.471720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24c494c63bc4a7db02c60e5421175dc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:14.472326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24c494c63bc4a7db02c60e5421175dc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:14.484682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24c494c63bc4a7db02c60e5421175dc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:14.503826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3560/7071] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:14 2022] DELETE /identity/v3/users/c24c494c63bc4a7db02c60e5421175dc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:14.505326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:14.505623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:14.505974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:14.526013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:14.527363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:14.537883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:14.596318 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3512/7072] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:14.607747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:14.609690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:14.673131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:14.691240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae408d-c60f-4450-94bc-7e602efcc3bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:14.698676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:14.699822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:14.700123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:14.700478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:14.712555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:14.715047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfe444-9867-4e48-84b0-d030a4549d63 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:14.725959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3561/7073] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:15.010213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.011903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:15.025037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1328703-b5ec-458e-aa28-130062736e30 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.031083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.032677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.033138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.033575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] PATH_INFO: `/v3/projects/2c417b1fc0ad4165bbdc7241d6a121b0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.035164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c417b1fc0ad4165bbdc7241d6a121b0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.037436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.110170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c417b1fc0ad4165bbdc7241d6a121b0', 'request_id': 'req-896546b0-1fe1-49c9-8779-508ce22fb360'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:15.122325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c417b1fc0ad4165bbdc7241d6a121b0', 'request_id': 'req-896546b0-1fe1-49c9-8779-508ce22fb360'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:15.131757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c417b1fc0ad4165bbdc7241d6a121b0', 'request_id': 'req-896546b0-1fe1-49c9-8779-508ce22fb360'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:15.154824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] The token cache is being invalidate because project 2c417b1fc0ad4165bbdc7241d6a121b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:15.155474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:15.156072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-896546b0-1fe1-49c9-8779-508ce22fb360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:15.163582 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3513/7074] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:15 2022] DELETE /identity/v3/projects/2c417b1fc0ad4165bbdc7241d6a121b0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:15.168779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.169073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.169376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.196989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:15.198918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:15.278511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3562/7075] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:15.286749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.287114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.287410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.316564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:15.317934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:15.328385 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3514/7076] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:15.332972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.348325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26986fa-2cec-44bf-89c9-681eac00c45d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.356330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.357491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.357983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.358478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.359656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:15.360554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.362747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.383039 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3563/7077] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:15.387875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.400041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1099e8a-a6ec-4523-9801-34ad4273da73 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.415543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.416460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.416856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.417540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.418456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.420712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.465739 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3515/7078] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:15 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:15.471215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.487915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd916-ed75-43a2-a590-01d805434d9c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.573076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.574280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.574730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.575186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.576106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.578303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.615274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3564/7079] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:15 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:15.620074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.631398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c29b9-5abd-49b4-8c1d-154baad9150c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.637676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.638447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.638649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.639249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.640217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.642678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.655672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3516/7080] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:15.660813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.672213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac2991-ea70-436c-96ef-3c07cbe735a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.676966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.677641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.677917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.678405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.679242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.681175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e29414-b81b-40f8-8b61-f6562ff315b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.697073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3565/7081] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:15.698392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.710781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670346ab-de61-47ef-8839-c0edcfd31eca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.716948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.717883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.718168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.718458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] PATH_INFO: `/v3/projects/d221ae6f9e3d4de1b7babad7f3ff7b23/users/0c291cf04f314fd3a551e3e8f76438c3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.736815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d221ae6f9e3d4de1b7babad7f3ff7b23, user_id=0c291cf04f314fd3a551e3e8f76438c3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.739561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.756753 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3517/7082] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:15 2022] PUT /identity/v3/projects/d221ae6f9e3d4de1b7babad7f3ff7b23/users/0c291cf04f314fd3a551e3e8f76438c3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:15.768558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.768875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.769164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.798781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] MFA Rules not processed for user `0c291cf04f314fd3a551e3e8f76438c3`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:15.800011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:15.843862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:15.875741 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3566/7083] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:15.888153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:15.890315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:15.935711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:15.956477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc3fec-b583-42b7-8e5e-10526b5338bb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:15.960580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:15.961239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:15.961519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:15.961796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:15.971021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:15.972506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:15.982193 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3518/7084] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:21.021249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:21.023523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:21.088071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6c12-4f05-4c15-8cca-d92118ab5b6c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:21.093285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:21.094011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:21.094303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:21.094587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:21.096453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:21.176661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:21.178734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:21.192294 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3567/7085] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:24.860742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:24.862274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:24.879818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1ed3b-886f-411a-8fe6-2e0726c63d1f service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:24.884492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:24.885421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:24.885727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:24.886148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] PATH_INFO: `/v3/users/09431bbdbc394df8b368770d3e24a306` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:24.887288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09431bbdbc394df8b368770d3e24a306)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:24.889339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:24.965178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09431bbdbc394df8b368770d3e24a306'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:24.965987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09431bbdbc394df8b368770d3e24a306'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:24.973679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09431bbdbc394df8b368770d3e24a306'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:24.974465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09431bbdbc394df8b368770d3e24a306'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:24.988759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3dae39d4-00b0-4c96-971a-ea1bbd85b595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09431bbdbc394df8b368770d3e24a306'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.013860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3519/7086] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:24 2022] DELETE /identity/v3/users/09431bbdbc394df8b368770d3e24a306 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:25.215800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.228101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d462-44c5-40aa-be7e-bf172f788151 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.293912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.294801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.295120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.295443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] PATH_INFO: `/v3/projects/0dc813c0affe4551bd334712c53fdd3c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.296956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc813c0affe4551bd334712c53fdd3c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.299268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.343409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:25.354443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc813c0affe4551bd334712c53fdd3c', 'request_id': 'req-4ab9f491-1ec6-4530-ac15-b8092373d422'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.362000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc813c0affe4551bd334712c53fdd3c', 'request_id': 'req-4ab9f491-1ec6-4530-ac15-b8092373d422'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.368002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc813c0affe4551bd334712c53fdd3c', 'request_id': 'req-4ab9f491-1ec6-4530-ac15-b8092373d422'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.388248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] The token cache is being invalidate because project 0dc813c0affe4551bd334712c53fdd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:25.388545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.389208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4ab9f491-1ec6-4530-ac15-b8092373d422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:25.391115 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3568/7087] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:25 2022] DELETE /identity/v3/projects/0dc813c0affe4551bd334712c53fdd3c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:25.396735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.397086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.397442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.419684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:25.421192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:25.503108 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3520/7088] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:25.503762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.504084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.504368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.533929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:25.535436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:25.545226 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3569/7089] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:25.549620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.559884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a09f9-afb0-491e-b296-bfb0ebb5f35c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.564968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.565682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.565935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.566224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.566981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:25.567384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.569534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.582735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3521/7090] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:25.587112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.596956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d94db3-9091-4808-894f-b3a0b7bf3032 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.601952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.602723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.603077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.603422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.604345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.606477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.637501 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3570/7091] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:25 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:25.641578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.652279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fd9d8-7dea-44c3-aa36-e96d767f0e58 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.685510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:25.712344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.713010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.713327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.714095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.714802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.716790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.739545 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3522/7092] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:25 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:25.741138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.752410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc4a4-50cb-4aa8-9236-a87bb89d0287 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.757681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.758351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.758639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.758916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.759765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.761515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.773312 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3571/7093] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:25.777502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.789032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888ba9c-eecf-4fcf-94ea-3eacb6b6122a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.795109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.795817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.796101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.796375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.797138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.798740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e217-b402-471c-ab1e-3dc5684540b7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.809844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3523/7094] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:25.813935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.824901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1254a24-96f0-48eb-84f2-eaca72f35f81 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:25.830332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:25.831214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.831502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.831813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] PATH_INFO: `/v3/projects/5458fb2dce9f43f193d47e33ae9e0f0b/users/f0a215946af641d1b50c4f6191191ce1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.850502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5458fb2dce9f43f193d47e33ae9e0f0b, user_id=f0a215946af641d1b50c4f6191191ce1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:25.853894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:25.868787 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3572/7095] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:25 2022] PUT /identity/v3/projects/5458fb2dce9f43f193d47e33ae9e0f0b/users/f0a215946af641d1b50c4f6191191ce1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:25.874180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7b15-e6e9-4a3c-9419-8d80a78fa416 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:25.874714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7b15-e6e9-4a3c-9419-8d80a78fa416 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:25.874847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7b15-e6e9-4a3c-9419-8d80a78fa416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:25.893652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f79a7b15-e6e9-4a3c-9419-8d80a78fa416 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:25.895003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f79a7b15-e6e9-4a3c-9419-8d80a78fa416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:25.964417 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3524/7096] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:25.974280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:25.976254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:26.048650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f4e3b-9d86-4177-89de-4f161c2abdc4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:26.056508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:26.057288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:26.057648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:26.057942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:26.069281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:26.070483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb2788-418f-41dc-bf21-425ea2595376 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:26.082776 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3573/7097] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:26.560986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:26.561285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:26.561612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:26.602041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] MFA Rules not processed for user `f0a215946af641d1b50c4f6191191ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:26.604039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:26.675317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3525/7098] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:26.688265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5d32-2f66-4dbf-8346-690bf23557b2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:26.688724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5d32-2f66-4dbf-8346-690bf23557b2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:26.688724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5d32-2f66-4dbf-8346-690bf23557b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:26.711027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-63bf5d32-2f66-4dbf-8346-690bf23557b2 None None] MFA Rules not processed for user `f0a215946af641d1b50c4f6191191ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:26.712275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-63bf5d32-2f66-4dbf-8346-690bf23557b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:26.727186 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3574/7099] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:26.872951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:26.874389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:26.937859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:26.971550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73fb51-7ec4-44ed-8389-094508c71750 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:26.977395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:26.978048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:26.978324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:26.978595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:26.986677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:26.988330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:26.997224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3526/7100] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:27.253703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:27.254303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:27.254704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:27.275344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:27.277115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:27.328005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:27.336030 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3575/7101] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:27.348910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:27.350396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:27.427889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20fd81-7707-4619-9fe4-687d63802ff7 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:27.433238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:27.433923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:27.434202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:27.434474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:27.442859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:27.444475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:27.452888 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3527/7102] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:27.638903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:27.664589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8e81-e9e6-4062-a03b-a2c30cc5acc8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:27.677946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:27.678840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:27.679118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:27.679383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] PATH_INFO: `/v3/users/f0a215946af641d1b50c4f6191191ce1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:27.680621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a215946af641d1b50c4f6191191ce1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:27.682653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:27.746198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a215946af641d1b50c4f6191191ce1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:27.755660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a215946af641d1b50c4f6191191ce1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:27.756856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a215946af641d1b50c4f6191191ce1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:27.757545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a215946af641d1b50c4f6191191ce1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:27.777167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9234c561-c6b6-492e-8e0d-cb04814daf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a215946af641d1b50c4f6191191ce1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:27.791695 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3576/7103] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:27 2022] DELETE /identity/v3/users/f0a215946af641d1b50c4f6191191ce1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:28.046149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.057354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405299a-1056-4a3a-bbee-9fe30c85e8e6 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.133461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.134676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.135068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.135490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] PATH_INFO: `/v3/projects/5458fb2dce9f43f193d47e33ae9e0f0b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.136907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5458fb2dce9f43f193d47e33ae9e0f0b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.139097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.196814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5458fb2dce9f43f193d47e33ae9e0f0b', 'request_id': 'req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.207223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5458fb2dce9f43f193d47e33ae9e0f0b', 'request_id': 'req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.215602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5458fb2dce9f43f193d47e33ae9e0f0b', 'request_id': 'req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.218318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:28.238009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] The token cache is being invalidate because project 5458fb2dce9f43f193d47e33ae9e0f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:28.238815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.240444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.242354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3528/7104] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:28 2022] DELETE /identity/v3/projects/5458fb2dce9f43f193d47e33ae9e0f0b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:28.248474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85530e2-39ec-4f5e-841d-bf64284f434a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.248764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85530e2-39ec-4f5e-841d-bf64284f434a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.249042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85530e2-39ec-4f5e-841d-bf64284f434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.270650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a85530e2-39ec-4f5e-841d-bf64284f434a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:28.272089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a85530e2-39ec-4f5e-841d-bf64284f434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.319901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.321476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.364286 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3577/7105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:28.372313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.372608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.372891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.401784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:28.403156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.411867 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3578/7106] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:28.416023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.425606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e9cc8-7fc0-4221-b82d-1372e512818c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.429489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aa58a-c913-4dd8-9e0e-7ca44a697a8d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.430297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.430960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.431238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.431561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.432398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:28.432663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.434443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.435254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.436174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.436452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.436729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] PATH_INFO: `/v3/users/0c291cf04f314fd3a551e3e8f76438c3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.437936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c291cf04f314fd3a551e3e8f76438c3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.439891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.451738 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3579/7107] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:28.453477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.465629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a609ca-3d7a-4df1-82bc-1a895493d7b5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.470979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.471700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.471987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.472268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.473122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.475163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.503484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c291cf04f314fd3a551e3e8f76438c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.504503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c291cf04f314fd3a551e3e8f76438c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.506458 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3580/7108] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:28.510993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.512504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.513173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c291cf04f314fd3a551e3e8f76438c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.513920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c291cf04f314fd3a551e3e8f76438c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.528391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f4b05780-01cd-4884-85a9-c5897e212514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c291cf04f314fd3a551e3e8f76438c3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:28.544365 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3529/7109] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:28 2022] DELETE /identity/v3/users/0c291cf04f314fd3a551e3e8f76438c3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:28.549637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.549926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.550201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.556686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:28.574270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:28.575659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.594220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55168493-4999-4dcd-8592-633358fd5fa8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.648254 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3530/7110] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:28.658462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.659855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.660836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.661579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.661924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.662359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.663124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.665132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.673840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:28.695540 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3581/7111] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:28.696603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.707262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d7a89-2849-425f-aae5-e8e56bd9fc46 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.712168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.712863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.713173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.714068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.714815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.716507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.724283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43083c-f21b-4d1b-b9ee-87daa7e77259 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.727090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3582/7112] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:28.728063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.728712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.729041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.729346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.730806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.739926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.741374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.742462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996c2d9-dd82-45fe-bdf9-ceed174ba04a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.747190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.747935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.748285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.748627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.749341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.750926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32ebcb-2cc4-4327-9188-59e5b4d96eb1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.753024 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3531/7113] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:28.763332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3583/7114] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:28.767981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.778593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7eab-f917-4e53-823a-b0f38cda9022 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:28.784001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:28.785009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.785177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.785454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] PATH_INFO: `/v3/projects/87608a2ca91846cab148c802519d40b2/users/d96cade4cead4edeb39f14ad902985d0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.808271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87608a2ca91846cab148c802519d40b2, user_id=d96cade4cead4edeb39f14ad902985d0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:28.811244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfad21-d10f-4683-83e1-fea0077fb8b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:28.817101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.817380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.817665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.830446 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3532/7115] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:28 2022] PUT /identity/v3/projects/87608a2ca91846cab148c802519d40b2/users/d96cade4cead4edeb39f14ad902985d0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:28.837920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:28.840421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.841413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:28.841706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:28.841977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:28.870803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] MFA Rules not processed for user `d96cade4cead4edeb39f14ad902985d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:28.872071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:28.915230 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3584/7116] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:28.957285 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3533/7117] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:28.971485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:28.973129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:29.032473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:29.058625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86629-9b41-434f-86be-70f0894354bc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:29.065039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:29.065782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:29.066067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:29.066343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:29.075318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:29.076981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:29.086925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3585/7118] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:29.499102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:29.604371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:29.606180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:29.626175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da1696-3024-4f5c-9461-c067cbb831a6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:29.630975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:29.631742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:29.632575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:29.632881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:29.635378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:29.650736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:29.652488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff5a1-e7da-4d2f-b609-f999359d9c24 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:29.669969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3534/7119] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:29.729045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-9fd3-4447-a881-73ab1b251c82 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:29.744086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:29.745353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:29.746052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:29.746409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] PATH_INFO: `/v3/projects/d221ae6f9e3d4de1b7babad7f3ff7b23` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:29.747785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d221ae6f9e3d4de1b7babad7f3ff7b23)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:29.750134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:29.806213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd221ae6f9e3d4de1b7babad7f3ff7b23', 'request_id': 'req-54b68410-7801-4af0-adae-23609a94e801'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:29.813308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd221ae6f9e3d4de1b7babad7f3ff7b23', 'request_id': 'req-54b68410-7801-4af0-adae-23609a94e801'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:29.819808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd221ae6f9e3d4de1b7babad7f3ff7b23', 'request_id': 'req-54b68410-7801-4af0-adae-23609a94e801'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:29.843537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] The token cache is being invalidate because project d221ae6f9e3d4de1b7babad7f3ff7b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:29.843879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:29.845117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54b68410-7801-4af0-adae-23609a94e801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:29.847090 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3586/7120] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:29 2022] DELETE /identity/v3/projects/d221ae6f9e3d4de1b7babad7f3ff7b23 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:29.852111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:29.852743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:29.853015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:29.875107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:29.876368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:29.895422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:29.941626 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3535/7121] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:29.950128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:29.950676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:29.951023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:29.970667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:29.971925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:29.980986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3587/7122] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:29.985177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:29.996322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d147b10-4aeb-4298-8a45-03d02cca7368 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.001629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.002639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.003291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.003480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.004340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:30.004749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.006463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.023185 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3536/7123] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:30.024513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.034496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e317-6532-4155-96f7-cbf180ee7349 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.039601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.040395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.040747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.041095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.041937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.044027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.075594 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3588/7124] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:30 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:30.079870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.089960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b819e7-e6fa-4703-839c-cf1fa505fd88 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.151141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.151926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.152211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.152515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.153215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.155125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.176363 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3537/7125] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:30 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:30.180630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.191498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143541d-f681-4c4f-801b-a7be23145abd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.196894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.198039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.198359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.198640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.199480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.201281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.214379 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3589/7126] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:30.218651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.229190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc4c-9c63-4e6d-870a-d4e22e7736e7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.234455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.235127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.235426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.235752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.236478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.238096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e9165-534b-444b-8f7a-a83ddab92cb0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.251622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3538/7127] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:30.253312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.264220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4a1dd-ecd2-4860-b323-db1556f80d7e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.269621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.270514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.270799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.271076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] PATH_INFO: `/v3/projects/278f1e89f4784523999f8c3aa0017dad/users/dda14bb28a0c46928de7f87c58cb942f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.286418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=278f1e89f4784523999f8c3aa0017dad, user_id=dda14bb28a0c46928de7f87c58cb942f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.289140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.303827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3590/7128] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:30 2022] PUT /identity/v3/projects/278f1e89f4784523999f8c3aa0017dad/users/dda14bb28a0c46928de7f87c58cb942f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:30.314458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.314751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.315033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.343729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] MFA Rules not processed for user `dda14bb28a0c46928de7f87c58cb942f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:30.345008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:30.417229 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3539/7129] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:30.428288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:30.430038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:30.435617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:30.501749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff04e26-0bd8-4f3a-b0bd-3d54ad20e94c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:30.505879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:30.506531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:30.506799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:30.507069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:30.517586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:30.519035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f47417-cb2c-4469-9c40-ce90db66c05d service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:30.530198 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3591/7130] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:32.224182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:32.225632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:32.292286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:32.411542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3cf6-67ba-4a44-a82f-57b51e4e1a14 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:32.422130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:32.436773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:32.437260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:32.438151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] PATH_INFO: `/v3/users/d96cade4cead4edeb39f14ad902985d0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:32.443784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96cade4cead4edeb39f14ad902985d0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:32.449425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:32.534879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96cade4cead4edeb39f14ad902985d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:32.535812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96cade4cead4edeb39f14ad902985d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:32.564504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96cade4cead4edeb39f14ad902985d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:32.565232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96cade4cead4edeb39f14ad902985d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:32.598648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96cade4cead4edeb39f14ad902985d0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:32.623232 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3540/7131] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:32 2022] DELETE /identity/v3/users/d96cade4cead4edeb39f14ad902985d0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:32.632465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:32.633462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:32.633462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:32.657221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:32.659022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:32.755482 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3592/7132] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:32.766204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:32.768265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:32.842089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893517d-cb7d-404c-92da-04f2a50f50dd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:32.846582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:32.847423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:32.847924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:32.848379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:32.859753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:32.861517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd6a25-e6ba-4b2c-b44d-5742a6724a6a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:32.873335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3541/7133] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:33.570513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:33.572306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:33.594788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8ad0b-0f55-4677-bacf-dcfa6ffc91d2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:33.599408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:33.600451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:33.600740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:33.601054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] PATH_INFO: `/v3/projects/87608a2ca91846cab148c802519d40b2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:33.602353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87608a2ca91846cab148c802519d40b2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:33.604541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:33.656040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87608a2ca91846cab148c802519d40b2', 'request_id': 'req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:33.662524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87608a2ca91846cab148c802519d40b2', 'request_id': 'req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:33.668529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87608a2ca91846cab148c802519d40b2', 'request_id': 'req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:33.687985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] The token cache is being invalidate because project 87608a2ca91846cab148c802519d40b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:33.688467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:33.689468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48a0b054-5c16-4c2e-a72f-0bda2b8012b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:33.692672 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3593/7134] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:33 2022] DELETE /identity/v3/projects/87608a2ca91846cab148c802519d40b2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:33.700285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:33.700745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:33.700867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:33.720608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:33.722204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:33.761380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:33.789826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3542/7135] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:33.798058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185242be-1684-4623-ae3c-d7a888143453 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:33.798431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185242be-1684-4623-ae3c-d7a888143453 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:33.798773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185242be-1684-4623-ae3c-d7a888143453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:33.819118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-185242be-1684-4623-ae3c-d7a888143453 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:33.820470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-185242be-1684-4623-ae3c-d7a888143453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:33.829822 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3594/7136] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:33.836725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:33.848783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e3ef9-af24-46b5-91e5-f6d6fb451206 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:33.853567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:33.854398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:33.854812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:33.855098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:33.855886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:33.856198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:33.857808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:33.870366 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3543/7137] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:33.874989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185242be-1684-4623-ae3c-d7a888143453 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:33.884600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185242be-1684-4623-ae3c-d7a888143453 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:33.889740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:33.890392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:33.890671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:33.890942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:33.891660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:33.894009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:33.914673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:33.922986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3595/7138] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:33 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:33.927451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:33.938380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6838f5-e413-4e9f-96fc-daf770437ba1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:33.999668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.000345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.000627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.000896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.001578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.003594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.026144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3544/7139] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:33 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:34.030663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.042822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff87f30-2b0f-4eaf-afd1-377995494f05 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.048075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.048744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.049024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.049319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.050028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.051830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.063408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3596/7140] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:34.067940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.079444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6e5b-b759-4f12-b5da-a037ecac6dae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.084469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.085156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.085442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.085718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.086434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.088064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8cc7-410b-4ad5-bb59-3ad14c2e730b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.100049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3545/7141] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:34.105300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.115889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc776b-4e9d-4bfd-a6d7-7dbef057cac6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.121553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.122448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.122727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.123033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] PATH_INFO: `/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9/users/af802c2807214ac988e2d88b8b38b370/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.139761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44beeddabf24f8b9d17a3edbbc501d9, user_id=af802c2807214ac988e2d88b8b38b370, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.143295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.159796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3597/7142] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:34 2022] PUT /identity/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9/users/af802c2807214ac988e2d88b8b38b370/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:34.170741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.171276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.171609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.199695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] MFA Rules not processed for user `af802c2807214ac988e2d88b8b38b370`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:34.201190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:34.267303 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3546/7143] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:34.271907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.339350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfa861-e015-486b-9eb0-18bb30b6072f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.345119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.345785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.346060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.346337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.347030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.348991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.378653 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3598/7144] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:34.382962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.395611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5485e-7202-4f7e-afa2-d7a3b5115463 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.431686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:34.462962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.463799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.464181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.464467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.465204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.467576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.488942 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3547/7145] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/users => generated 307 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:34.493413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.505415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010bb0-00e0-473a-a00d-ef4d590d957b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.512627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.513306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.513589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.513859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.514589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.516436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.531447 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3599/7146] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:34.535889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.546767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e32a1e-0984-4388-bb38-f69bc20e3f97 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.558051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.558051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.558051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.558051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] PATH_INFO: `/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53/users/872eb5bd61b7408eb820a5f8412ee039/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.573972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe8efca6c2e414abeb96ea3e53dcc53, user_id=872eb5bd61b7408eb820a5f8412ee039, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.576873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.596674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3548/7147] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:34 2022] PUT /identity/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53/users/872eb5bd61b7408eb820a5f8412ee039/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:34.600391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.612761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e973b-be60-470e-8683-73ec28942004 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.679569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.681089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.681602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.682293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.683388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.685137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff8487-d578-45e4-936d-c06632378ac0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.697089 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3600/7148] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:34.701810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.714103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37be5f-2eb7-40db-9493-997285ef3e7e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.720926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.721382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.721721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.721984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] PATH_INFO: `/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53/users/872eb5bd61b7408eb820a5f8412ee039/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.724693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe8efca6c2e414abeb96ea3e53dcc53, user_id=872eb5bd61b7408eb820a5f8412ee039, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.727556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.740098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3549/7149] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:34 2022] PUT /identity/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53/users/872eb5bd61b7408eb820a5f8412ee039/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:34.752768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.753070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.753357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.780699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] MFA Rules not processed for user `872eb5bd61b7408eb820a5f8412ee039`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:34.781933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:34.806552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:34.852961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3601/7150] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:34.858579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.870713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8367cf-4df4-4c1a-9dfa-55b800186400 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.877760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872eb5bd61b7408eb820a5f8412ee039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe8efca6c2e414abeb96ea3e53dcc53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.878564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.878851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.879126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.879893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.881499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.902420 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3550/7151] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/roles => generated 240 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:34.906679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:34.917002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7925-dc5e-49f6-b021-618b8616c3f0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:34.921840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872eb5bd61b7408eb820a5f8412ee039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe8efca6c2e414abeb96ea3e53dcc53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:34.922980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:34.923363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:34.923718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] PATH_INFO: `/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9/users/af802c2807214ac988e2d88b8b38b370/roles/d3598f2773ce496d8d88fb375dc232c8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:34.926101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b44beeddabf24f8b9d17a3edbbc501d9, user_id=af802c2807214ac988e2d88b8b38b370, role_id=d3598f2773ce496d8d88fb375dc232c8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:34.929086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3054e-8870-4869-8fa1-fa1612f0cbf0 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:34.970438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3602/7152] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:34 2022] PUT /identity/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9/users/af802c2807214ac988e2d88b8b38b370/roles/d3598f2773ce496d8d88fb375dc232c8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:34.971463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:35.067157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c59295-e84e-4fff-b278-4b1812e347bb tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:35.143221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af802c2807214ac988e2d88b8b38b370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44beeddabf24f8b9d17a3edbbc501d9', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1445035141', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:35.144288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:35.144424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:35.144758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] PATH_INFO: `/v3/users/af802c2807214ac988e2d88b8b38b370/application_credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:35.145522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: Authorizing `identity:create_application_credential(user_id=af802c2807214ac988e2d88b8b38b370)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:35.146563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:35.175340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:35.244360 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3551/7153] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:18:34 2022] POST /identity/v3/users/af802c2807214ac988e2d88b8b38b370/application_credentials => generated 659 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:35.246121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:35.246421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:35.246706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:35.285435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] MFA Rules not processed for user `af802c2807214ac988e2d88b8b38b370`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:35.286722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:35.466768 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3603/7154] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jun 04 21:18:35.470400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:35.484007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6abdc-ce6d-4564-9092-ac20cc68de2f tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:35.491001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af802c2807214ac988e2d88b8b38b370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b44beeddabf24f8b9d17a3edbbc501d9', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-1445035141', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:35.492142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:35.492428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:35.492725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] PATH_INFO: `/v3/users/af802c2807214ac988e2d88b8b38b370/application_credentials/35ef30707a9249acb57308c6dc068e1b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:35.494422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: Authorizing `identity:delete_application_credential(user_id=af802c2807214ac988e2d88b8b38b370, application_credential_id=35ef30707a9249acb57308c6dc068e1b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:35.505460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:35.539592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3552/7155] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:18:35 2022] DELETE /identity/v3/users/af802c2807214ac988e2d88b8b38b370/application_credentials/35ef30707a9249acb57308c6dc068e1b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:35.542682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:35.620183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:35.646269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602353a6-a490-4950-8ffc-7a60c099b577 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:35.651311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '872eb5bd61b7408eb820a5f8412ee039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fe8efca6c2e414abeb96ea3e53dcc53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:35.652243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:35.652577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:35.652863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] PATH_INFO: `/v3/roles/d3598f2773ce496d8d88fb375dc232c8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:35.654896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d3598f2773ce496d8d88fb375dc232c8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:35.658616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:35.725204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] Invalidating the token cache because role d3598f2773ce496d8d88fb375dc232c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:35.726646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:35.727913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0a6f757-71d9-4557-93ba-94aaf921e2d8 tempest-ApplicationCredentialsV3AdminTest-546008802 tempest-ApplicationCredentialsV3AdminTest-546008802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:35.730726 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3604/7156] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:35 2022] DELETE /identity/v3/roles/d3598f2773ce496d8d88fb375dc232c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:35.739293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:35.743442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:35.858109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c48b85-dffd-44fd-8fa3-aa651fd3f067 tempest-ApplicationCredentialsV3AdminTest-1983958691 tempest-ApplicationCredentialsV3AdminTest-1983958691-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:35.930633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:35.932320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:35.932646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:35.932940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] PATH_INFO: `/v3/users/af802c2807214ac988e2d88b8b38b370` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:35.934182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af802c2807214ac988e2d88b8b38b370)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:35.936462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:35.991192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af802c2807214ac988e2d88b8b38b370'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:35.992232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af802c2807214ac988e2d88b8b38b370'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:35.993473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:36.005254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af802c2807214ac988e2d88b8b38b370'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.007366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af802c2807214ac988e2d88b8b38b370'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.022894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af802c2807214ac988e2d88b8b38b370'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.037550 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3553/7157] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:35 2022] DELETE /identity/v3/users/af802c2807214ac988e2d88b8b38b370 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:36.042613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:36.043132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:36.043417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:36.063706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:36.064937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:36.131947 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3605/7158] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:36.144124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:36.145835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:36.218567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d061-adaa-48d8-91f0-bc8e4e9f5b39 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:36.224021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:36.224670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:36.224955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:36.225245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:36.235761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:36.237341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:36.248283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3554/7159] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:36.592235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:36.593697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:36.607281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf3a8-123f-49d6-bd01-05083b6e6f59 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:36.621860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:36.627810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:36.628483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:36.629012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] PATH_INFO: `/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:36.632728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44beeddabf24f8b9d17a3edbbc501d9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:36.635202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:36.691856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44beeddabf24f8b9d17a3edbbc501d9', 'request_id': 'req-748a7e63-b465-4d97-b2cc-9de1687e9254'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.698212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44beeddabf24f8b9d17a3edbbc501d9', 'request_id': 'req-748a7e63-b465-4d97-b2cc-9de1687e9254'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.704268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44beeddabf24f8b9d17a3edbbc501d9', 'request_id': 'req-748a7e63-b465-4d97-b2cc-9de1687e9254'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.720971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] The token cache is being invalidate because project b44beeddabf24f8b9d17a3edbbc501d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:36.721293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.721969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.723599 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3606/7160] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:36 2022] DELETE /identity/v3/projects/b44beeddabf24f8b9d17a3edbbc501d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:36.727700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:36.738270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03e19-a0fb-47b7-b7d1-0f1a0dc4766e service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:36.798336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:36.799530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:36.799881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:36.800286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] PATH_INFO: `/v3/users/872eb5bd61b7408eb820a5f8412ee039` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:36.802375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=872eb5bd61b7408eb820a5f8412ee039)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:36.805424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:36.869702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872eb5bd61b7408eb820a5f8412ee039'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.871415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872eb5bd61b7408eb820a5f8412ee039'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.881946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872eb5bd61b7408eb820a5f8412ee039'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.884058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872eb5bd61b7408eb820a5f8412ee039'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.908718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:36.911599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fc230df9-a380-4754-9fb2-b375e0182fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872eb5bd61b7408eb820a5f8412ee039'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:36.939822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3555/7161] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:36 2022] DELETE /identity/v3/users/872eb5bd61b7408eb820a5f8412ee039 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:37.290243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.291956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:37.305104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7e63-b465-4d97-b2cc-9de1687e9254 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.352678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:37.403961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.405468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.405996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.406657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] PATH_INFO: `/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.408248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe8efca6c2e414abeb96ea3e53dcc53)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.410585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.487679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe8efca6c2e414abeb96ea3e53dcc53', 'request_id': 'req-87170662-1e79-4daa-8d35-d0efcbb03aa1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:37.495923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe8efca6c2e414abeb96ea3e53dcc53', 'request_id': 'req-87170662-1e79-4daa-8d35-d0efcbb03aa1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:37.503044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe8efca6c2e414abeb96ea3e53dcc53', 'request_id': 'req-87170662-1e79-4daa-8d35-d0efcbb03aa1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:37.521096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] The token cache is being invalidate because project 5fe8efca6c2e414abeb96ea3e53dcc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:37.521468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:37.522111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-87170662-1e79-4daa-8d35-d0efcbb03aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:37.523729 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3607/7162] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:37 2022] DELETE /identity/v3/projects/5fe8efca6c2e414abeb96ea3e53dcc53 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:37.529238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.529537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.529820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.558622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:37.559908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:37.631398 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3556/7163] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:37.647649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.647649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.647649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.666652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:37.668258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:37.676874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3608/7164] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:37.682602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.691860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44730f8-281b-4955-b2a2-bda9824685b8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.696659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.697435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.697741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.698260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.698813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:37.699120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.700797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.716806 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3557/7165] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:37.717892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.728737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bf1dc-aff0-4189-b28c-18ada57cc543 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.734046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.734853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.735101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.735386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.736306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.738293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.775792 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3609/7166] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:37 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:37.780262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.792070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17bac2-43df-43f1-904e-dc4af5b15c51 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.854475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.855388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.855775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.856119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.857012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.858945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.880807 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3558/7167] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:37 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:37.885473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.897129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dbcbf-a181-4045-bfb8-795edab888bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.901910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.902575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.902856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.903205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.904104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.905713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.916769 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3610/7168] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:37.921368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.932998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1523-28cd-4e38-b7b9-37bd6a842386 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.938366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.939039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.939373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.939679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.940441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.942102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3276-1b52-451d-97e7-eb90087632d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:37.954969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3559/7169] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:37.959493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:37.970279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928751-1309-4192-9887-adf4e82b58de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:37.975263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:37.976188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:37.976466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:37.976737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] PATH_INFO: `/v3/projects/1ed64289404c42799b8a47a81ed61b81/users/20786ad729824ce282d93eb9cd2bbc99/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:37.993345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed64289404c42799b8a47a81ed61b81, user_id=20786ad729824ce282d93eb9cd2bbc99, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:37.996183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.014834 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3611/7170] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:37 2022] PUT /identity/v3/projects/1ed64289404c42799b8a47a81ed61b81/users/20786ad729824ce282d93eb9cd2bbc99/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:38.022884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.023185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.023468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.052893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] MFA Rules not processed for user `20786ad729824ce282d93eb9cd2bbc99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:38.054111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:38.097079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:38.129036 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3560/7171] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:38.134646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.206026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6d185-4201-4d38-9789-27817d93d1b6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.211816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.212914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.213521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.213848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.214732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.217126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.221781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:38.250236 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3612/7172] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:38.254492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.267192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19144c7-476d-4976-b427-3dacf09a22e6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.338828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.339502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.339861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.340153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.340839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.342823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.366931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3561/7173] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:38.368384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.380119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beaa76-85a3-46be-9fcf-c5b28749a2f1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.384757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.385516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.385771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.386050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.386786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.388436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.399639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3613/7174] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:38.404070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.414150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fed3ff-2c67-498a-b25a-ac55bd3727bd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.418990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.419899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.420182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.420461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] PATH_INFO: `/v3/projects/5dfe043fdf8d417e848cae49afaed1fb/users/daf7d9fc74e74503996b614e4cc22240/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.437827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfe043fdf8d417e848cae49afaed1fb, user_id=daf7d9fc74e74503996b614e4cc22240, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.440551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.456835 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3562/7175] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:38 2022] PUT /identity/v3/projects/5dfe043fdf8d417e848cae49afaed1fb/users/daf7d9fc74e74503996b614e4cc22240/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:38.460985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.472300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8077-afe3-416c-8bba-6e96a5466ca6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.537196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.537885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.538171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.538455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.539189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.540854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79451f2-57ff-4181-b1f9-44dad264f731 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.551971 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3614/7176] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:38.557055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.574852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3774912-668b-4bae-969e-eb270488d66e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.580097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.581155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.581524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.581889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] PATH_INFO: `/v3/projects/5dfe043fdf8d417e848cae49afaed1fb/users/daf7d9fc74e74503996b614e4cc22240/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.588022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfe043fdf8d417e848cae49afaed1fb, user_id=daf7d9fc74e74503996b614e4cc22240, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.591075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.607926 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3563/7177] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:38 2022] PUT /identity/v3/projects/5dfe043fdf8d417e848cae49afaed1fb/users/daf7d9fc74e74503996b614e4cc22240/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:38.618670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.618963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.619583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.651250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] MFA Rules not processed for user `daf7d9fc74e74503996b614e4cc22240`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:38.652527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:38.733632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3615/7178] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:38.738707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.750578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e55da-73c4-4178-b284-2e532b54f59d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.755427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.756223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.756511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.756797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.757530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.759144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.780780 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3564/7179] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/domains => generated 245 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:38.782218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.795768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff957-9ab5-42a3-8136-ac17f2a465fc None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.855984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:38.863543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.864214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.865182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.865461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.866316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:38.868963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:38.913276 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3616/7180] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/projects => generated 410 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:38.917902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:38.930645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da5da-4dc2-46a1-9c89-765c400377ce tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:38.996683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:38.997342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:38.997605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:38.997924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:38.998649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.000673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.024933 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3565/7181] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:38 2022] POST /identity/v3/users => generated 347 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:39.030182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.043872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568cdd2-664e-421b-ba82-77c66d89a449 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.050711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.051432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.051758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.052061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.052778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.054434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469997f-6418-43c3-825a-8fb5832fadf1 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.067556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3617/7182] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:39.070348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.080497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dce4e9-eef0-444a-8e33-384496449df7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.085256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.086159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.086449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.086730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/projects/0c7231163a234eb28d6eaa588bbbfa88/users/9fa0ae57fc654128bb9ead85a1a60341/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.096413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:39.105058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0c7231163a234eb28d6eaa588bbbfa88, user_id=9fa0ae57fc654128bb9ead85a1a60341, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.108279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018f35a-b5f4-425e-a50e-7d80b1e2950a tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.122844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3566/7183] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:39 2022] PUT /identity/v3/projects/0c7231163a234eb28d6eaa588bbbfa88/users/9fa0ae57fc654128bb9ead85a1a60341/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:39.127517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.127934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.128316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.240344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] MFA Rules not processed for user `9fa0ae57fc654128bb9ead85a1a60341`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:39.247644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:39.265640 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3618/7184] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:39.275631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.276229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.276681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.305002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] MFA Rules not processed for user `9fa0ae57fc654128bb9ead85a1a60341`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:39.307582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:39.321098 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3567/7185] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:39.322246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.334854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed55b1c-6060-4615-a068-69cbb79b6728 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.341768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fa0ae57fc654128bb9ead85a1a60341', 'user_domain_id': 'c3f63fa403d14d0983c7979eda70b21f', 'system_scope': None, 'project_id': '0c7231163a234eb28d6eaa588bbbfa88', 'project_domain_id': 'c3f63fa403d14d0983c7979eda70b21f', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.342569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.342948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.343325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.355407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.361247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.387560 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3619/7186] 10.222.0.18 () {56 vars in 1283 bytes} [Sat Jun 4 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3350 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:39.390407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.480814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bef0b-a2da-418a-996f-dd99fcfd7be7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.485508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.486396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.486711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.486998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/users/9fa0ae57fc654128bb9ead85a1a60341` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.488241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9fa0ae57fc654128bb9ead85a1a60341)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.490280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.541148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa0ae57fc654128bb9ead85a1a60341'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.541742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa0ae57fc654128bb9ead85a1a60341'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.549496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa0ae57fc654128bb9ead85a1a60341'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.550163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa0ae57fc654128bb9ead85a1a60341'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.562161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa0ae57fc654128bb9ead85a1a60341'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.579384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3568/7187] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:39 2022] DELETE /identity/v3/users/9fa0ae57fc654128bb9ead85a1a60341 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:39.585201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.597948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9dad8-f8ba-4333-95fe-bd2b8fcc69b5 tempest-test_project-2025901234 tempest-user-791753270] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.662948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.663893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.664293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.664577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/projects/0c7231163a234eb28d6eaa588bbbfa88` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.665768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0c7231163a234eb28d6eaa588bbbfa88)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.667740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.690382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:39.717258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7231163a234eb28d6eaa588bbbfa88', 'request_id': 'req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.723818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7231163a234eb28d6eaa588bbbfa88', 'request_id': 'req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.731808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7231163a234eb28d6eaa588bbbfa88', 'request_id': 'req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.748014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] The token cache is being invalidate because project 0c7231163a234eb28d6eaa588bbbfa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:39.748310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.748958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.750551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3620/7188] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:39 2022] DELETE /identity/v3/projects/0c7231163a234eb28d6eaa588bbbfa88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:39.754881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.756392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:39.770243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419efab8-7c5d-4177-ace1-969d4ff4ea8f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.830483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.831368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.831700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.832022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/domains/c3f63fa403d14d0983c7979eda70b21f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:39.833388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c3f63fa403d14d0983c7979eda70b21f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:39.835060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:39.837389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:39.861221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.862024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.897642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.898286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:39.904179 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3569/7189] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:39 2022] PATCH /identity/v3/domains/c3f63fa403d14d0983c7979eda70b21f => generated 246 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:39.907143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:39.908588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:39.924525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf57cfc-d9f6-403d-8dfd-1c2a032cc95f tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:39.988454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daf7d9fc74e74503996b614e4cc22240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dfe043fdf8d417e848cae49afaed1fb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:39.989313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:39.989606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:39.989892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] PATH_INFO: `/v3/domains/c3f63fa403d14d0983c7979eda70b21f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:40.003007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c3f63fa403d14d0983c7979eda70b21f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:40.005286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:40.033077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.036845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.091359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.098413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.103604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.117411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] The token cache is being invalidate because project c3f63fa403d14d0983c7979eda70b21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:40.117703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.118397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.121577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:40.127013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.127709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.131878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f88e341b-97c5-4bb0-ab51-3622f4352fde tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c3f63fa403d14d0983c7979eda70b21f', 'request_id': 'req-f88e341b-97c5-4bb0-ab51-3622f4352fde'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.138373 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3621/7190] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:18:39 2022] DELETE /identity/v3/domains/c3f63fa403d14d0983c7979eda70b21f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:40.144548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:40.145996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:40.218341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3bb57-3a58-42b9-a059-f9953f0d55e7 tempest-TestDefaultProjectId-855669547 tempest-TestDefaultProjectId-855669547-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:40.286020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:40.286939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:40.287222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:40.287497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] PATH_INFO: `/v3/users/20786ad729824ce282d93eb9cd2bbc99` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:40.288863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=20786ad729824ce282d93eb9cd2bbc99)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:40.291171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:40.343604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20786ad729824ce282d93eb9cd2bbc99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.344214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20786ad729824ce282d93eb9cd2bbc99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.352721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20786ad729824ce282d93eb9cd2bbc99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.353851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20786ad729824ce282d93eb9cd2bbc99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.367252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20786ad729824ce282d93eb9cd2bbc99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:40.369026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:40.391562 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3570/7191] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:40 2022] DELETE /identity/v3/users/20786ad729824ce282d93eb9cd2bbc99 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:40.396530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:40.397084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:40.397084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:40.414741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:40.416043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:40.477904 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3622/7192] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:40.493131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:40.494785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:40.557575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463aa37-ccb0-4fe3-98a5-35dc79a29cfe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:40.568419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:40.569642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:40.570094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:40.570524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:40.582291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:40.583882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:40.594007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3571/7193] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:40.959626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:40.961126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:40.973672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c893f9-1cbc-4e61-a996-72f8f677685c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:40.979987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:40.981003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:40.981381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:40.982216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] PATH_INFO: `/v3/projects/1ed64289404c42799b8a47a81ed61b81` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:40.984382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed64289404c42799b8a47a81ed61b81)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:40.986428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:41.057992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed64289404c42799b8a47a81ed61b81', 'request_id': 'req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.065454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed64289404c42799b8a47a81ed61b81', 'request_id': 'req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.072376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed64289404c42799b8a47a81ed61b81', 'request_id': 'req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.091581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] The token cache is being invalidate because project 1ed64289404c42799b8a47a81ed61b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:41.091879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.095033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.095033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3623/7194] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:40 2022] DELETE /identity/v3/projects/1ed64289404c42799b8a47a81ed61b81 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:41.098926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:41.112549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d551cf-a78d-47d2-80b8-6ef4b370810b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:41.178138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:41.179665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:41.179957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:41.180239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] PATH_INFO: `/v3/users/daf7d9fc74e74503996b614e4cc22240` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:41.181448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf7d9fc74e74503996b614e4cc22240)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:41.184160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:41.234234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf7d9fc74e74503996b614e4cc22240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.235350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf7d9fc74e74503996b614e4cc22240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.242956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf7d9fc74e74503996b614e4cc22240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.243778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf7d9fc74e74503996b614e4cc22240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.256662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-007e6b98-ac65-495f-953c-449b4dd4b411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf7d9fc74e74503996b614e4cc22240'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.272194 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3572/7195] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:41 2022] DELETE /identity/v3/users/daf7d9fc74e74503996b614e4cc22240 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:41.615367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:41.616948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:41.647839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d0eb-fc0d-4ee6-8cfb-f3bdf27f6191 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:41.712172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:41.713044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:41.713378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:41.713655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] PATH_INFO: `/v3/projects/5dfe043fdf8d417e848cae49afaed1fb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:41.714851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfe043fdf8d417e848cae49afaed1fb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:41.716786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:41.727866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:41.767825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfe043fdf8d417e848cae49afaed1fb', 'request_id': 'req-28ad49f5-7906-4571-b636-9922a84f0b47'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.774470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfe043fdf8d417e848cae49afaed1fb', 'request_id': 'req-28ad49f5-7906-4571-b636-9922a84f0b47'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.780274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfe043fdf8d417e848cae49afaed1fb', 'request_id': 'req-28ad49f5-7906-4571-b636-9922a84f0b47'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.795030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] The token cache is being invalidate because project 5dfe043fdf8d417e848cae49afaed1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:41.795324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.796008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-28ad49f5-7906-4571-b636-9922a84f0b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:41.797636 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3624/7196] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:41 2022] DELETE /identity/v3/projects/5dfe043fdf8d417e848cae49afaed1fb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:41.802706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:41.803023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:41.803306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:41.821922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:41.823222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:41.832467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:41.891054 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3573/7197] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:41.900061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:41.900359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:41.900641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:41.923918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:41.926772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:41.938945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3625/7198] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:41.942814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:41.954063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b97b30-4d4c-4552-ba3d-5f56b74dcc82 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:41.961278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:41.961561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:41.962063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:41.962460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:41.963459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:41.964046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:41.965844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:41.983475 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3574/7199] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:41.984822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:41.996050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903035e-4a88-4ea7-98ac-70574ed3f4d3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.001817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.002783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.003083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.003369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.004809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.007415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.047772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3626/7200] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:41 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:42.052009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.065095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983e91-fb53-4a0e-bd98-d3519af311a0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.134561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.135295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.135638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.135925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.136857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.138962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.168177 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3575/7201] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:42.172434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.186082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a542e-12ab-40ac-8bd4-5bfc7e48b9ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.191447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.195169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.195459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.195775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.196332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.196799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.198481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.198744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.210780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee4d9c-f534-4ea1-b075-5d9972a25046 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.211753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3627/7202] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:42.215614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.216882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.218244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.218744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.219234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] PATH_INFO: `/v3/users/dda14bb28a0c46928de7f87c58cb942f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.221442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda14bb28a0c46928de7f87c58cb942f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.223687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.225895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13f1f-6606-42fa-9b4e-db89cfb9aeac admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.232425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.233107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.233389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.233664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.234403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.236043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.247450 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3628/7203] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:42.252547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.265111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838817-abc3-4406-af7c-5816cb2b91af admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.276992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.277943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.278255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.278569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] PATH_INFO: `/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/b5a73076a3384223a412a8cc0c4d39c4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.288120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda14bb28a0c46928de7f87c58cb942f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:42.288804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda14bb28a0c46928de7f87c58cb942f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:42.294170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1a8e1780344ee6a8a2a7dfc999547a, user_id=b5a73076a3384223a412a8cc0c4d39c4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.295972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda14bb28a0c46928de7f87c58cb942f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:42.296695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda14bb28a0c46928de7f87c58cb942f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:42.297063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9b74-3532-4e12-8080-1a781154d007 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.310437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e60c0d20-088d-4c85-a4ce-c687affffd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda14bb28a0c46928de7f87c58cb942f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:42.314073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3629/7204] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:42 2022] PUT /identity/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/b5a73076a3384223a412a8cc0c4d39c4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:42.324031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.324555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.324841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.332981 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3576/7205] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:42 2022] DELETE /identity/v3/users/dda14bb28a0c46928de7f87c58cb942f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:42.337496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.337793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.338098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.345081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:42.353098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] MFA Rules not processed for user `b5a73076a3384223a412a8cc0c4d39c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:42.354537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.359708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:42.361198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.427219 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3577/7206] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:42.430483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3630/7207] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:42.434980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.436683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.437341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.438667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.448912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895fa71-9f57-46e8-8862-6cc23f4303cc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.453532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.454427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.454582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:42.454683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.454771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.455436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.457639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.488535 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3578/7208] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:42.489856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.502418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c3db6-08f2-40dc-af27-1fe2f717cb4c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.554797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd2be-4f5d-4979-8a05-f9364b5c85b3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.560432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.561107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.561387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.561662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.562347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.564330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.564529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.565229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.565530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.565782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.575748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.577286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.586289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3579/7209] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:42.587793 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3631/7210] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:42.590152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.599887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bcf98-bd0f-4197-b332-ddfdf49ce055 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.604803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.605459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.605746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.606027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.606755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.608397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.622856 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3632/7211] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:42.627346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.642902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd5b5d-1a91-4077-b154-78b7f752df6b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.660158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.661111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.661504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.661882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] PATH_INFO: `/v3/projects/b509d64c7bc349b19730085a622173f6/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.682074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b509d64c7bc349b19730085a622173f6, user_id=f0a0d671ed2543138221974a0688410f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.684968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.700428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3580/7212] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:42 2022] PUT /identity/v3/projects/b509d64c7bc349b19730085a622173f6/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:42.704556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.716323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff681e-7d9c-4bed-88b2-1817df4a0b4e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.782440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.782440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.782863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.783202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.784045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.785781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a68c29-1fae-499d-b4fe-6bc2e2098f74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.797473 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3633/7213] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:42.801334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.812778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43e34-f294-4779-a7e7-ba806bac6cf4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:42.818204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:42.818903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.819179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.819452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] PATH_INFO: `/v3/projects/b509d64c7bc349b19730085a622173f6/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.821451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b509d64c7bc349b19730085a622173f6, user_id=f0a0d671ed2543138221974a0688410f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:42.824584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:42.844037 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3581/7214] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:42 2022] PUT /identity/v3/projects/b509d64c7bc349b19730085a622173f6/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:42.847390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:42.847888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:42.848378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:42.881564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] MFA Rules not processed for user `f0a0d671ed2543138221974a0688410f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:42.883744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.898749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:42.901459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:42.951692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:42.967014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:42.997986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3634/7215] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:42.998254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69994f-6ce5-49c5-8551-94357b08d4f1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.002136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.007188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.008427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.008775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.009148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] PATH_INFO: `/v3/projects/278f1e89f4784523999f8c3aa0017dad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.010540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278f1e89f4784523999f8c3aa0017dad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.012857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.014139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0336-2b69-434b-a791-42aee16edc64 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.021592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.021592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.022383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.022723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.023526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.025495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.063384 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3635/7216] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:43 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:43.067350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.078129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278f1e89f4784523999f8c3aa0017dad', 'request_id': 'req-79a1f458-a53b-4f5d-81d0-8780d9753265'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:43.086041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278f1e89f4784523999f8c3aa0017dad', 'request_id': 'req-79a1f458-a53b-4f5d-81d0-8780d9753265'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:43.097213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278f1e89f4784523999f8c3aa0017dad', 'request_id': 'req-79a1f458-a53b-4f5d-81d0-8780d9753265'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:43.138766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] The token cache is being invalidate because project 278f1e89f4784523999f8c3aa0017dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:43.139363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:43.140389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:43.144200 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3582/7217] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:42 2022] DELETE /identity/v3/projects/278f1e89f4784523999f8c3aa0017dad => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:43.197466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86105c4-5dc3-4478-b71e-4f1dda30afef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.213545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.214644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.215143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.215641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.216544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.218920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.258578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3636/7218] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:43 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:43.262685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.265421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:43.388776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1f458-a53b-4f5d-81d0-8780d9753265 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.395127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.395863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.396144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.396607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.397394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.399230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.414457 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3583/7219] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:43.415975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.428360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99638458-e9ab-48ca-98e4-48920e0c1f5c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.433400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.434087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.434368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.434645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.435408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.437125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cfea-0d4b-4f97-8c84-3fdafe67bc8b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.451394 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3637/7220] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:43.453180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.466869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5da18-9e0b-481b-a62b-f34c923cab99 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.474292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.475585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.475963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.476346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] PATH_INFO: `/v3/projects/4d12f133a1094f30a8dd379fe54de6db/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.498199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d12f133a1094f30a8dd379fe54de6db, user_id=d3f87e06e56e42e78b31f1f5617b2a3c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.502819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.531988 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3584/7221] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:43 2022] PUT /identity/v3/projects/4d12f133a1094f30a8dd379fe54de6db/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:43.546847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.547295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.548178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.586965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] MFA Rules not processed for user `d3f87e06e56e42e78b31f1f5617b2a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:43.589354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:43.714377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3638/7222] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:43.719937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.721777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:43.767585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.769955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:43.791448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:43.819740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:43.830849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9298c3-d977-4b5f-b758-fcde8e664364 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.841350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.842246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.842625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.843025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.844465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.846481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.868787 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3585/7223] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:18:43 2022] POST /identity/v3/domains => generated 275 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:43.872744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.887162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0ce02-28c1-4faa-a070-7b9000c905a3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.937399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea2fa-9e40-4e7a-8280-48f10431d0b6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.942405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.943083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.943366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.943680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.944423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.946032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.951939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.952870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.953209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.953517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.955769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:43.966407 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3586/7224] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:43 2022] POST /identity/v3/roles => generated 240 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:43.967411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:43.972653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:43.975025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:43.978687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054f5b-fe17-4f26-a77b-7c853857deb6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:43.984925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:43.985958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:43.986245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:43.986527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/d67f029180004708b2c8ece5e7070381/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/80e566784ee142e8b512b7f1ceeecb8b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:43.988851 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3639/7225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:43.999467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d67f029180004708b2c8ece5e7070381, user_id=d3f87e06e56e42e78b31f1f5617b2a3c, role_id=80e566784ee142e8b512b7f1ceeecb8b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.002185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.016449 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3587/7226] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Jun 4 21:18:43 2022] PUT /identity/v3/domains/d67f029180004708b2c8ece5e7070381/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/80e566784ee142e8b512b7f1ceeecb8b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:44.021097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.033533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c737-dd77-40aa-94ca-d5105630708e service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.092157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.092837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.093130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.093409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.094142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.095789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.115196 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3640/7227] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/domains => generated 275 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.116391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.127716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af593164-ef7f-45ad-b2d3-47b5b089bf9f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.189076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.189806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.190163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.190355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.191090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.192871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.208790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3588/7228] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/roles => generated 240 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:44.213011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.223612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e726d25-349f-4f4c-8969-4f684b5e0b88 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.228399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.229220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.229482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.229757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.230485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.232440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.263008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3641/7229] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/groups => generated 324 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.268237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.281788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24618f8-06d0-46a5-af66-f6b924b63bd1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.288069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.289023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.289339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.289623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a/users/d3f87e06e56e42e78b31f1f5617b2a3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.296151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c4af3ac13e264b82a9ae5caad8e4961a, user_id=d3f87e06e56e42e78b31f1f5617b2a3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.298125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.324344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3589/7230] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:18:44 2022] PUT /identity/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a/users/d3f87e06e56e42e78b31f1f5617b2a3c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:44.328614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.339432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc16ee7-805c-459d-82b5-3730eddf5d7a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.362906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:44.405502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.406464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.406751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.407065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/32228832ca4e4a18aa60b7134a2dadb2/groups/c4af3ac13e264b82a9ae5caad8e4961a/roles/62dbc84dd45e42628861dbf2dc9a46a4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.409570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=32228832ca4e4a18aa60b7134a2dadb2, group_id=c4af3ac13e264b82a9ae5caad8e4961a, role_id=62dbc84dd45e42628861dbf2dc9a46a4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.412278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.426605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3642/7231] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:44 2022] PUT /identity/v3/domains/32228832ca4e4a18aa60b7134a2dadb2/groups/c4af3ac13e264b82a9ae5caad8e4961a/roles/62dbc84dd45e42628861dbf2dc9a46a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:44.430931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.441817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f2c0-1552-4afc-b156-527af23c997e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.447053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:44.500725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.501332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.501612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.501885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.502629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.504274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.522487 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3590/7232] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/domains => generated 277 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:44.526802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.553206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d55017-5ce9-480c-9629-8da68f0c91ea tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.625182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.625948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.626240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.626537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.628508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.629308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.645772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3643/7233] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/roles => generated 239 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.650136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.669839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4553c-5781-423f-99b0-024f04bdced7 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.675190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.676886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.677170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.677478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/065da686924d4223a58ad68d73960046` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.698024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=fcc7ced9643e4b5ab4005ea72437c65d, user_id=d3f87e06e56e42e78b31f1f5617b2a3c, role_id=065da686924d4223a58ad68d73960046)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.701763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.726296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3591/7234] 10.222.0.18 () {60 vars in 1479 bytes} [Sat Jun 4 21:18:44 2022] PUT /identity/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/065da686924d4223a58ad68d73960046 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:44.733918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.744406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dba21-d408-416a-b574-e7fabf48a935 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.808922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.809522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.809948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.810235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.810989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.812655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.829875 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3644/7235] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/domains => generated 276 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.834124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.845891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948a57-2ac5-40ec-8b51-8772314fa73e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.911292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.912113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.912403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.912690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.913444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.915352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.933028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3592/7236] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/roles => generated 240 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.937583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:44.948680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d34cc-4d29-4e27-b7e9-03550b46d946 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:44.954144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:44.955093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:44.955403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:44.955748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:44.956448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:44.958404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:44.987983 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3645/7237] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:18:44 2022] POST /identity/v3/groups => generated 326 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:44.992181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.002928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856325-64f0-4834-afb5-d9053dde0d6c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.007913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.008811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.009085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.009572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/39123901607d4a1f8f265814e702d08d/users/d3f87e06e56e42e78b31f1f5617b2a3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.016469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=39123901607d4a1f8f265814e702d08d, user_id=d3f87e06e56e42e78b31f1f5617b2a3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.018993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.048327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3593/7238] 10.222.0.18 () {60 vars in 1359 bytes} [Sat Jun 4 21:18:44 2022] PUT /identity/v3/groups/39123901607d4a1f8f265814e702d08d/users/d3f87e06e56e42e78b31f1f5617b2a3c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:45.052873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.068803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f93b3c-b18b-426a-8459-e21c58e33222 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.094022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:45.144218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.145150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.146098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.146440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/3bf3896ecdbf414cb054995d591630b4/groups/39123901607d4a1f8f265814e702d08d/roles/5be6c1cb842348518f651252cdd11d92` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.149068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3bf3896ecdbf414cb054995d591630b4, group_id=39123901607d4a1f8f265814e702d08d, role_id=5be6c1cb842348518f651252cdd11d92)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.152999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.171643 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3646/7239] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:45 2022] PUT /identity/v3/domains/3bf3896ecdbf414cb054995d591630b4/groups/39123901607d4a1f8f265814e702d08d/roles/5be6c1cb842348518f651252cdd11d92 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:45.175663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.263049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:45.325969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4198f7-d753-4c8c-920a-569556e649f9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.460961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3f87e06e56e42e78b31f1f5617b2a3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d12f133a1094f30a8dd379fe54de6db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.461667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.461958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.462288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] PATH_INFO: `/v3/auth/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.462993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.464540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.546919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3594/7240] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 21:18:45 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:45.551201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.622294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd150-aec0-408b-80ee-4bbf1e815943 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.627140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.628080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.628361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.628622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/3bf3896ecdbf414cb054995d591630b4/groups/39123901607d4a1f8f265814e702d08d/roles/5be6c1cb842348518f651252cdd11d92` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.630825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3bf3896ecdbf414cb054995d591630b4, group_id=39123901607d4a1f8f265814e702d08d, role_id=5be6c1cb842348518f651252cdd11d92)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.633551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.639484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 5be6c1cb842348518f651252cdd11d92 was removed from group 39123901607d4a1f8f265814e702d08d on domain 3bf3896ecdbf414cb054995d591630b4. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:45.639795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:45.640456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:45.656414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3647/7241] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:18:45 2022] DELETE /identity/v3/domains/3bf3896ecdbf414cb054995d591630b4/groups/39123901607d4a1f8f265814e702d08d/roles/5be6c1cb842348518f651252cdd11d92 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:45.660424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.663831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:45.680098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db2f75-2849-4a3d-ab3e-88e02b8704a5 tempest-TokensV3TestJSON-1839296897 tempest-TokensV3TestJSON-1839296897-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.740568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:45.760296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.761402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.761719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.762048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/39123901607d4a1f8f265814e702d08d/users/d3f87e06e56e42e78b31f1f5617b2a3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.763920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=39123901607d4a1f8f265814e702d08d, user_id=d3f87e06e56e42e78b31f1f5617b2a3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.766264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.776723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:45.798681 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3595/7242] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:18:45 2022] DELETE /identity/v3/groups/39123901607d4a1f8f265814e702d08d/users/d3f87e06e56e42e78b31f1f5617b2a3c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:45.802900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.814000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f184bc-975a-4765-b9f7-67deb43aa21d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:45.891565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:45.893345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:45.893673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:45.893958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/39123901607d4a1f8f265814e702d08d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:45.895269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_group(group_id=39123901607d4a1f8f265814e702d08d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:45.897266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:45.958714 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3648/7243] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:18:45 2022] DELETE /identity/v3/groups/39123901607d4a1f8f265814e702d08d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:45.963639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:45.976945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172e7e8-708d-4497-9cfa-3385a615d87b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:46.070723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:46.071858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:46.072461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:46.072911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles/5be6c1cb842348518f651252cdd11d92` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:46.074789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5be6c1cb842348518f651252cdd11d92)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:46.077197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:46.132734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 5be6c1cb842348518f651252cdd11d92 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:46.133037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.133835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.136493 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3596/7244] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:45 2022] DELETE /identity/v3/roles/5be6c1cb842348518f651252cdd11d92 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:46.141383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:46.143847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:46.159857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0fe02-eef1-44d1-a2a2-88f54674a0e8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:46.165502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:46.228956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:46.230128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:46.230575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:46.231015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/3bf3896ecdbf414cb054995d591630b4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:46.232939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3bf3896ecdbf414cb054995d591630b4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:46.234675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:46.267707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.268547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.334889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.337918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.340502 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3649/7245] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:46 2022] PATCH /identity/v3/domains/3bf3896ecdbf414cb054995d591630b4 => generated 277 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:46.344854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:46.371658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b17ce9-6119-4b8f-a21d-874feb381e48 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:46.520316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:46.521681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:46.522139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:46.522598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/3bf3896ecdbf414cb054995d591630b4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:46.537610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3bf3896ecdbf414cb054995d591630b4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:46.540468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:46.581728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.588393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3bf3896ecdbf414cb054995d591630b4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.594311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:46.660969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.668157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.674982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.692984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project 3bf3896ecdbf414cb054995d591630b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:46.693768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.694443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.704021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.704722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.705478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3bf3896ecdbf414cb054995d591630b4', 'request_id': 'req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.719921 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3597/7246] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:18:46 2022] DELETE /identity/v3/domains/3bf3896ecdbf414cb054995d591630b4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:46.721120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:46.722582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:46.736498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2000cf-1aaa-43ce-9be1-0c8c0fe4942f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:46.804815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:46.806096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:46.806096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:46.806306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/065da686924d4223a58ad68d73960046` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:46.809945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=fcc7ced9643e4b5ab4005ea72437c65d, user_id=d3f87e06e56e42e78b31f1f5617b2a3c, role_id=065da686924d4223a58ad68d73960046)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:46.813165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:46.819978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 065da686924d4223a58ad68d73960046 was removed from user d3f87e06e56e42e78b31f1f5617b2a3c on domain fcc7ced9643e4b5ab4005ea72437c65d. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:46.820489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.821369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.840775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3650/7247] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Jun 4 21:18:46 2022] DELETE /identity/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/065da686924d4223a58ad68d73960046 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:46.844935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:46.846421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:46.860352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0a2dd-2dc6-4286-adcf-1be6281da5ee tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:46.925388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:46.926191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:46.926485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:46.926756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles/065da686924d4223a58ad68d73960046` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:46.928319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_role(role_id=065da686924d4223a58ad68d73960046)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:46.929969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:46.972873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 065da686924d4223a58ad68d73960046 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:46.973253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.974226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:46.976457 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3598/7248] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:46 2022] DELETE /identity/v3/roles/065da686924d4223a58ad68d73960046 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:46.981006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:46.983979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:46.997970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2eb9a9-587f-4e07-97a0-602bef9d6770 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.075129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.076281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.076604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.077015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.078607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fcc7ced9643e4b5ab4005ea72437c65d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.080308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.084690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:47.108718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.109472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.153876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.154719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.160821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3651/7249] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:46 2022] PATCH /identity/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d => generated 278 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:47.162479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.164220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:47.178407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d1c1d-5a9f-4105-b837-29b0586f99c1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.221455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:47.242247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.243237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.243854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.244173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.256925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fcc7ced9643e4b5ab4005ea72437c65d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.258572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.285504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.289572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.342863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.349977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.357063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.376178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project fcc7ced9643e4b5ab4005ea72437c65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:47.376684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.377639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.389564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.390652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.390894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fcc7ced9643e4b5ab4005ea72437c65d', 'request_id': 'req-3302c59d-bf23-4874-9d26-2d5f9102848f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.404406 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3599/7250] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:47.408368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.409896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:47.422976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd26f1-6026-4d2c-a9c6-e9b950486bed tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.522257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.523436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.523681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.523992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/32228832ca4e4a18aa60b7134a2dadb2/groups/c4af3ac13e264b82a9ae5caad8e4961a/roles/62dbc84dd45e42628861dbf2dc9a46a4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.526373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=32228832ca4e4a18aa60b7134a2dadb2, group_id=c4af3ac13e264b82a9ae5caad8e4961a, role_id=62dbc84dd45e42628861dbf2dc9a46a4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.529043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.535001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 62dbc84dd45e42628861dbf2dc9a46a4 was removed from group c4af3ac13e264b82a9ae5caad8e4961a on domain 32228832ca4e4a18aa60b7134a2dadb2. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:47.535332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.536101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.552164 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3652/7251] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/domains/32228832ca4e4a18aa60b7134a2dadb2/groups/c4af3ac13e264b82a9ae5caad8e4961a/roles/62dbc84dd45e42628861dbf2dc9a46a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:47.559312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.560947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:47.586104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302c59d-bf23-4874-9d26-2d5f9102848f tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.653758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.654694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.654982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.655243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a/users/d3f87e06e56e42e78b31f1f5617b2a3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.657071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c4af3ac13e264b82a9ae5caad8e4961a, user_id=d3f87e06e56e42e78b31f1f5617b2a3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.660011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.669468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:47.684126 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3600/7252] 10.222.0.18 () {58 vars in 1343 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a/users/d3f87e06e56e42e78b31f1f5617b2a3c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:47.688241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.689663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:47.702721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef57211-6101-49c3-b262-3bbf138f400e tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.766000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.767307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.767630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.767970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.769623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c4af3ac13e264b82a9ae5caad8e4961a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.772413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.836501 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3653/7253] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/groups/c4af3ac13e264b82a9ae5caad8e4961a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:47.840641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.849880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:47.856456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cebcd-9c84-4377-823c-180f14b2e9d1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:47.967459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:47.968941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:47.968941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:47.969999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles/62dbc84dd45e42628861dbf2dc9a46a4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:47.974013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_role(role_id=62dbc84dd45e42628861dbf2dc9a46a4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:47.976739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:47.995210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:47.999120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:48.056761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:48.071456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 62dbc84dd45e42628861dbf2dc9a46a4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:48.071753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.073122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.077524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3601/7254] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/roles/62dbc84dd45e42628861dbf2dc9a46a4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:48.081979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:48.089699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:48.167856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888e31f-9179-4ab7-a25b-a2cb66e6c4d4 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:48.245352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8175aa-c3d7-4545-9674-c82ea9d06373 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:48.252005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:48.253372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:48.253676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:48.253954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/32228832ca4e4a18aa60b7134a2dadb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:48.254921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:48.255825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=32228832ca4e4a18aa60b7134a2dadb2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:48.256599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:48.257126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:48.257714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] PATH_INFO: `/v3/users/2166b66a28214ff9802da4f955b5a4c5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:48.258139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:48.260410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2166b66a28214ff9802da4f955b5a4c5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:48.262888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:48.289480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.291106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.337796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2166b66a28214ff9802da4f955b5a4c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.340165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.340947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.347444 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3602/7255] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:48 2022] PATCH /identity/v3/domains/32228832ca4e4a18aa60b7134a2dadb2 => generated 276 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:48.347701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2166b66a28214ff9802da4f955b5a4c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.347701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2166b66a28214ff9802da4f955b5a4c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.348383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2166b66a28214ff9802da4f955b5a4c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.351274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:48.357090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:48.368045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2166b66a28214ff9802da4f955b5a4c5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.395439 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3654/7256] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:47 2022] DELETE /identity/v3/users/2166b66a28214ff9802da4f955b5a4c5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:48.405064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:48.443003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81553-eb89-4862-9f17-34ad7bcec349 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:48.570698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:48.571644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:48.572116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:48.572441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/32228832ca4e4a18aa60b7134a2dadb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:48.604019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=32228832ca4e4a18aa60b7134a2dadb2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:48.605489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:48.635095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.639563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.736693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:48.738206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:48.820919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.853019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.864941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.889605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:48.904507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project 32228832ca4e4a18aa60b7134a2dadb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:48.904897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.905810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.929130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.929936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.930563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '32228832ca4e4a18aa60b7134a2dadb2', 'request_id': 'req-5b3db0d7-3298-444a-ab25-e96f1e737958'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:48.954834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3357d-4573-41ed-b7c6-4cae85ba477f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:48.982113 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3603/7257] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:18:48 2022] DELETE /identity/v3/domains/32228832ca4e4a18aa60b7134a2dadb2 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:48.983171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:48.992043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.058479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:49.135058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3db0d7-3298-444a-ab25-e96f1e737958 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.162209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.163368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.163753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.164038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] PATH_INFO: `/v3/projects/c284c2855bac423280d7e234dee6b7ac` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.172141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c284c2855bac423280d7e234dee6b7ac)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.178949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.180072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.180617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.181013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.181260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.186575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.207170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.211341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.228905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3655/7258] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:49.230150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.232295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.354887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22355189-a7f6-4916-880d-b95c954ddfd7 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.362115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c284c2855bac423280d7e234dee6b7ac', 'request_id': 'req-73152e9b-477a-4533-b435-6ff3aa08a962'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.373007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c284c2855bac423280d7e234dee6b7ac', 'request_id': 'req-73152e9b-477a-4533-b435-6ff3aa08a962'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.389894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c284c2855bac423280d7e234dee6b7ac', 'request_id': 'req-73152e9b-477a-4533-b435-6ff3aa08a962'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.420125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] The token cache is being invalidate because project c284c2855bac423280d7e234dee6b7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:49.420658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.421638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-73152e9b-477a-4533-b435-6ff3aa08a962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.425289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3604/7259] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:48 2022] DELETE /identity/v3/projects/c284c2855bac423280d7e234dee6b7ac => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:49.432927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff798e-7e8c-45b8-89e4-eaccb4601fa2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.433824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff798e-7e8c-45b8-89e4-eaccb4601fa2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.434807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff798e-7e8c-45b8-89e4-eaccb4601fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.459317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-60ff798e-7e8c-45b8-89e4-eaccb4601fa2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:49.460735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-60ff798e-7e8c-45b8-89e4-eaccb4601fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.463426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.464709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.465030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.465676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/d67f029180004708b2c8ece5e7070381/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/80e566784ee142e8b512b7f1ceeecb8b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.469455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d67f029180004708b2c8ece5e7070381, user_id=d3f87e06e56e42e78b31f1f5617b2a3c, role_id=80e566784ee142e8b512b7f1ceeecb8b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.474850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.482778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 80e566784ee142e8b512b7f1ceeecb8b was removed from user d3f87e06e56e42e78b31f1f5617b2a3c on domain d67f029180004708b2c8ece5e7070381. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:49.483331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.484141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.501326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3656/7260] 10.222.0.18 () {58 vars in 1463 bytes} [Sat Jun 4 21:18:49 2022] DELETE /identity/v3/domains/d67f029180004708b2c8ece5e7070381/users/d3f87e06e56e42e78b31f1f5617b2a3c/roles/80e566784ee142e8b512b7f1ceeecb8b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:49.506827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.508635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.516056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:49.555460 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3605/7261] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:49.566374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.567101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.567101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.593466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:49.595232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.616321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f94c-4b31-4a45-92df-b451d56ce77a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.622410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.623312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.623617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.623915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles/80e566784ee142e8b512b7f1ceeecb8b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.625551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_role(role_id=80e566784ee142e8b512b7f1ceeecb8b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.627303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.659850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:49.687629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 80e566784ee142e8b512b7f1ceeecb8b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:49.688397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.689255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.692204 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3657/7262] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:49 2022] DELETE /identity/v3/roles/80e566784ee142e8b512b7f1ceeecb8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:49.697553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.702924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3606/7263] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:49.703172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.704752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.725538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc93f-620b-40b2-b897-0a77552a7792 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.818632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d73b-f15a-488a-8f70-aaf3d88e2204 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.824547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.825730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.826077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.826367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/d67f029180004708b2c8ece5e7070381` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.828068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d67f029180004708b2c8ece5e7070381)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.830813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.835543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.836288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.836728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.837006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.837772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:49.838161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.840717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:49.862912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.867463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.877243 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3607/7264] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:49.878982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.883034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.904701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a6c4-2280-4347-b2b0-63e6af462857 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:49.913277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.913858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:49.925490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3658/7265] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:49 2022] PATCH /identity/v3/domains/d67f029180004708b2c8ece5e7070381 => generated 276 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:49.926619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:49.928844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:49.977427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:49.991382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:49.993687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:49.994143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:49.995195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:49.996535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:49.999197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.037321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7899bc-0ac0-4268-ad37-ff6bdacf1ba9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.045631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.045631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.045951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.046264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/d67f029180004708b2c8ece5e7070381` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.054735 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3608/7266] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:49 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:50.059949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.063321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.064582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d67f029180004708b2c8ece5e7070381)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.066420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.115066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.119847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd67f029180004708b2c8ece5e7070381'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.184182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf957a32-8110-49e8-b7e7-20be91506761 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.195332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.200609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:50.203173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.209281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.227772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project d67f029180004708b2c8ece5e7070381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:50.228125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.229129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.242045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.243213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.249335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd67f029180004708b2c8ece5e7070381', 'request_id': 'req-8555823d-2751-4436-b594-7d261ec0d62b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.258486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3659/7267] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:18:49 2022] DELETE /identity/v3/domains/d67f029180004708b2c8ece5e7070381 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:50.265287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.267346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.267502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.267957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.268220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.268501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.269908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.272708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.318585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3609/7268] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:50 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:50.320957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.323397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.337729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b602a-a6eb-4099-98ad-e5773b891b2b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.345721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.346750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.347042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.347374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.348138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.349927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.366506 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3610/7269] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:50.369838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.383017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e867ce-b073-4386-b053-b51baa73fb7d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.389808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.390549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.390840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.391122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.392863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.394534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.399733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555823d-2751-4436-b594-7d261ec0d62b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.412509 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3611/7270] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:50.414040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.414453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.415226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.415597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.415970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.417645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.419295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.431168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81306e6d-99a7-463a-af48-6d9b3a02ebae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.439014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3660/7271] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:50.439325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.440771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.442021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.442517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] PATH_INFO: `/v3/projects/4c4898ad8df64b71ab6dc8ee3f0611a2/users/5e5a933ba4674df2b1238dfb5a43a178/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.443865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.469989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4898ad8df64b71ab6dc8ee3f0611a2, user_id=5e5a933ba4674df2b1238dfb5a43a178, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.474190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acf26e-631b-4b96-8cd7-16b2d20064db admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.486284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3013-f6aa-43b4-8784-5e611f9ea8c8 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.496017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:50.497028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3612/7272] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:50 2022] PUT /identity/v3/projects/4c4898ad8df64b71ab6dc8ee3f0611a2/users/5e5a933ba4674df2b1238dfb5a43a178/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:50.507715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.508244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.508708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.549508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] MFA Rules not processed for user `5e5a933ba4674df2b1238dfb5a43a178`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:50.551144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.619619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.620664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.621033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.621253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.624484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7a1a8e1780344ee6a8a2a7dfc999547a, user_id=f0a0d671ed2543138221974a0688410f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.627997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.651637 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3661/7273] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:50 2022] PUT /identity/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:50.656470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.675918 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3613/7274] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:50.691854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.693450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.737154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3471-ef16-4005-a9e3-840745a23b84 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.743075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.743765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.744055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.744481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.745519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.746641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.753884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:50.785349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff966-bafe-4bfa-a5c8-35b373e58835 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.801043 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3662/7275] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:18:50 2022] GET /identity/v3/auth/projects => generated 828 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:50.805965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.818195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5df6f-2dba-453a-9560-648e3cc3dfc1 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.825052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.826463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.826719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.827000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.829220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=7a1a8e1780344ee6a8a2a7dfc999547a, user_id=f0a0d671ed2543138221974a0688410f, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.832167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.839576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 6cf06574abcf4310a389a3111ad8c511 was removed from user f0a0d671ed2543138221974a0688410f on project 7a1a8e1780344ee6a8a2a7dfc999547a. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:50.839812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.840444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:50.856408 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3663/7276] 10.222.0.18 () {58 vars in 1466 bytes} [Sat Jun 4 21:18:50 2022] DELETE /identity/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a/users/f0a0d671ed2543138221974a0688410f/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:50.862564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.864007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.868613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.869400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.869693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.869975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.871835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.919087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:50.933447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.935073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.939762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7d57-3e5f-450c-95c0-1eda4041412d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.944529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.944742 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3614/7277] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:50.945952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.946240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.946521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.947287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:50.949465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:50.977917 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3664/7278] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:50 2022] POST /identity/v3/users => generated 323 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:50.979209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.984799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:50.986502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:50.990875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198e7a4-1290-4ed6-9899-f223ee656676 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:50.996211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:50.997076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:50.997815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:50.998110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:50.999011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.000975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.031552 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3615/7279] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:50 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:51.033473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.054825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbe80-8246-4f6f-ab86-bac27342f16d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.098163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab26cae-c974-4cff-9b40-b57cb0fa5ab5 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.102887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.103632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.103960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.104243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.104951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.106871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.111145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:51.112628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.113524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.113812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.114093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] PATH_INFO: `/v3/users/5e5a933ba4674df2b1238dfb5a43a178` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.115436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5a933ba4674df2b1238dfb5a43a178)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.117453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.135980 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3616/7280] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/projects => generated 362 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:51.140051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.167780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5a933ba4674df2b1238dfb5a43a178'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.175086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5a933ba4674df2b1238dfb5a43a178'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.175850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5a933ba4674df2b1238dfb5a43a178'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.176483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5a933ba4674df2b1238dfb5a43a178'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.190738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c1ab1b4f-7134-4a3a-ac31-b71abc5f8629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5a933ba4674df2b1238dfb5a43a178'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.201835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:51.207602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3665/7281] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:50 2022] DELETE /identity/v3/users/5e5a933ba4674df2b1238dfb5a43a178 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:51.210976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ea35-74fe-45a0-8ce5-c23d57829a29 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.212130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.214062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.214362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.232620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:51.233832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.270641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.271227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.271576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.271863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.272719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.274343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.288944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3617/7282] 10.222.0.18 () {60 vars in 1142 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/roles => generated 240 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:51.293066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.294697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.297116 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3666/7283] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:51.307056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3231943-b106-4c2a-a8d4-65ee03e32f68 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.307303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.308659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.311729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.312700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.313056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.313428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/8ddec7ebc4a645a18b32b07d9ff7a74c/users/a203d6cd15e84e57995e9e41cada7597/roles/30bbd3fd803f404fb32e8e07295c589c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.330643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ddec7ebc4a645a18b32b07d9ff7a74c, user_id=a203d6cd15e84e57995e9e41cada7597, role_id=30bbd3fd803f404fb32e8e07295c589c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.333920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.348189 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3618/7284] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:51 2022] PUT /identity/v3/projects/8ddec7ebc4a645a18b32b07d9ff7a74c/users/a203d6cd15e84e57995e9e41cada7597/roles/30bbd3fd803f404fb32e8e07295c589c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:51.352218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.374492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4744ab-e1cd-40ab-a287-024f8e13a65f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.428007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.428672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.428957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.429238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.431608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6884a0-0fe0-4156-a218-8c68bd8c1a92 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.437852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.438788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.439072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.439351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/0f53a26805c944fc83ac81244441fa77/users/a203d6cd15e84e57995e9e41cada7597/roles/30bbd3fd803f404fb32e8e07295c589c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.441801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f53a26805c944fc83ac81244441fa77, user_id=a203d6cd15e84e57995e9e41cada7597, role_id=30bbd3fd803f404fb32e8e07295c589c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.444589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34817f9d-a7e2-49b6-a069-559d56e97a26 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.454879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:51.461073 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3619/7285] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:51 2022] PUT /identity/v3/projects/0f53a26805c944fc83ac81244441fa77/users/a203d6cd15e84e57995e9e41cada7597/roles/30bbd3fd803f404fb32e8e07295c589c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:51.466189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c015-ef15-42fc-b049-6a9ca24e2099 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.466490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c015-ef15-42fc-b049-6a9ca24e2099 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.466853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c015-ef15-42fc-b049-6a9ca24e2099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.494101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a952c015-ef15-42fc-b049-6a9ca24e2099 None None] MFA Rules not processed for user `a203d6cd15e84e57995e9e41cada7597`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:51.495977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a952c015-ef15-42fc-b049-6a9ca24e2099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.499490 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3620/7286] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 21:18:51.502436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.502436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.504969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965a2c-2ae7-4f7f-bae6-ac8710030477 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.505266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965a2c-2ae7-4f7f-bae6-ac8710030477 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.505554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965a2c-2ae7-4f7f-bae6-ac8710030477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.513325 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3667/7287] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:51.518044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-50965a2c-2ae7-4f7f-bae6-ac8710030477 None None] MFA Rules not processed for user `a203d6cd15e84e57995e9e41cada7597`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:51.519083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-50965a2c-2ae7-4f7f-bae6-ac8710030477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.597154 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3621/7288] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 04 21:18:51.601779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.620585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0468d-eaa8-4532-a863-0f547623f058 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.625593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:51.704621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.705386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.705739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.706083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.714981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.717175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.733731 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3668/7289] 10.222.0.18 () {56 vars in 1307 bytes} [Sat Jun 4 21:18:51 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:51.738207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.738512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.738803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.748883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] MFA Rules not processed for user `a203d6cd15e84e57995e9e41cada7597`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:51.750051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.814811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.816731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.820681 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3622/7290] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jun 04 21:18:51.825058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.839636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23dbb3-975e-4c53-85ab-c8efd9bb63d0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.844582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.845458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.845768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.845947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/roles/30bbd3fd803f404fb32e8e07295c589c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.847821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_role(role_id=30bbd3fd803f404fb32e8e07295c589c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.849180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.893898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invalidating the token cache because role 30bbd3fd803f404fb32e8e07295c589c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:51.894242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.894882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:51.899858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3623/7291] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:51 2022] DELETE /identity/v3/roles/30bbd3fd803f404fb32e8e07295c589c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:51.901324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:51.902755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:51.906212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbaae-cacb-41b9-b124-8e5ef36a87d6 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.963465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:51.972018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.973074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.973357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.973692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] PATH_INFO: `/v3/projects/4c4898ad8df64b71ab6dc8ee3f0611a2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.974864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4898ad8df64b71ab6dc8ee3f0611a2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.976825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:51.986936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bf8ee-caf3-40be-b830-21b1e345d7a9 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:51.991784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:51.992683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:51.992973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:51.993247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/0f53a26805c944fc83ac81244441fa77` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:51.996579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f53a26805c944fc83ac81244441fa77)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:51.998649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.033955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:52.040166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4898ad8df64b71ab6dc8ee3f0611a2', 'request_id': 'req-8f3dd226-8c13-43ab-8cdd-f8b176344b13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.049415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4898ad8df64b71ab6dc8ee3f0611a2', 'request_id': 'req-8f3dd226-8c13-43ab-8cdd-f8b176344b13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.056721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4898ad8df64b71ab6dc8ee3f0611a2', 'request_id': 'req-8f3dd226-8c13-43ab-8cdd-f8b176344b13'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.060049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f53a26805c944fc83ac81244441fa77', 'request_id': 'req-4d8cd864-075b-44e5-9e5d-e836214ccd2a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.068663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f53a26805c944fc83ac81244441fa77', 'request_id': 'req-4d8cd864-075b-44e5-9e5d-e836214ccd2a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.074815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f53a26805c944fc83ac81244441fa77', 'request_id': 'req-4d8cd864-075b-44e5-9e5d-e836214ccd2a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.079534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] The token cache is being invalidate because project 4c4898ad8df64b71ab6dc8ee3f0611a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:52.080253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.080959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f3dd226-8c13-43ab-8cdd-f8b176344b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.082800 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3669/7292] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:51 2022] DELETE /identity/v3/projects/4c4898ad8df64b71ab6dc8ee3f0611a2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:52.087680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4a9c-15fa-48c1-8c70-10f529125602 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.088027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4a9c-15fa-48c1-8c70-10f529125602 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.088317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4a9c-15fa-48c1-8c70-10f529125602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.090879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project 0f53a26805c944fc83ac81244441fa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:52.091173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.091872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.094793 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3624/7293] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:51 2022] DELETE /identity/v3/projects/0f53a26805c944fc83ac81244441fa77 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:52.098585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.100090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.108488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bf7c4a9c-15fa-48c1-8c70-10f529125602 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:52.109681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bf7c4a9c-15fa-48c1-8c70-10f529125602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.172172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd864-075b-44e5-9e5d-e836214ccd2a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.176898 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3670/7294] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:52.177075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.178145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.178457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.178680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/0f53a26805c944fc83ac81244441fa77` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.184553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.184788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.185585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.186809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f53a26805c944fc83ac81244441fa77)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.189017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.206924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:52.208323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Could not find project: 0f53a26805c944fc83ac81244441fa77.: keystone.exception.ProjectNotFound: Could not find project: 0f53a26805c944fc83ac81244441fa77. Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 04 21:18:52.209010 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0f53a26805c944fc83ac81244441fa77. Jun 04 21:18:52.210304 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.211056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3625/7295] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:52 2022] DELETE /identity/v3/projects/0f53a26805c944fc83ac81244441fa77 => generated 113 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:18:52.222815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.227079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3671/7296] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:52.231889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.236352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf03e0-ba41-41ae-9715-fb226e905a2c tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.242055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.242940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.243231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.243540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/projects/8ddec7ebc4a645a18b32b07d9ff7a74c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.245028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ddec7ebc4a645a18b32b07d9ff7a74c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.245637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1f1e-1dee-430d-aa96-7b45ca347364 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.247262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.253137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.253879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.254345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.254473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.256459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:52.256936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.258805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.273882 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3672/7297] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:52.278559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.290517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e1a7c-6bbc-4221-b7ce-1d8f2004b79d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.296268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.296968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.297264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.297579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.298380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.300442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.315755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddec7ebc4a645a18b32b07d9ff7a74c', 'request_id': 'req-a4b75eff-45e4-4251-b139-26528a7f87bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.323017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddec7ebc4a645a18b32b07d9ff7a74c', 'request_id': 'req-a4b75eff-45e4-4251-b139-26528a7f87bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.330268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddec7ebc4a645a18b32b07d9ff7a74c', 'request_id': 'req-a4b75eff-45e4-4251-b139-26528a7f87bd'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.333758 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3673/7298] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:52 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:52.336613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:52.338665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.350997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] The token cache is being invalidate because project 8ddec7ebc4a645a18b32b07d9ff7a74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:52.351311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.353158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.355679 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3626/7299] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:52 2022] DELETE /identity/v3/projects/8ddec7ebc4a645a18b32b07d9ff7a74c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:52.361740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.363468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.433049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48febb-85e4-4f0f-92d8-e45167cc97ba admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.439909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.440454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.440859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.441139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.441868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.444330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.450977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75eff-45e4-4251-b139-26528a7f87bd tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.469411 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3674/7300] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:52 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:52.473778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.475706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.490285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f9284-be80-409e-94e8-65244fa13bc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.497303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.498162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.498340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.498627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.500701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.501077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.522721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3675/7301] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:52.524467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.529686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.530635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.530922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.531206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/users/a203d6cd15e84e57995e9e41cada7597` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.532683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a203d6cd15e84e57995e9e41cada7597)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.534805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.538603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d70b4-73fe-43c3-9d40-3c13505219b3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.549594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.550631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.551062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.551188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.552179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.553692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.556719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:52.571976 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3676/7302] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:52.577199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.590657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15442-227a-43ea-bc95-9a5a348d2650 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.596165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.597248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.597565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.597686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a203d6cd15e84e57995e9e41cada7597'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.597887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7/users/f799e8e6063f4f468d861c38bbc0b33c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.598484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a203d6cd15e84e57995e9e41cada7597'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.606462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a203d6cd15e84e57995e9e41cada7597'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.607154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a203d6cd15e84e57995e9e41cada7597'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.615749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f797331b314055a74ecc2ce59b58f7, user_id=f799e8e6063f4f468d861c38bbc0b33c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.618264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691a8cc-fb3b-4f83-a895-c8739f8a8925 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.620502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a203d6cd15e84e57995e9e41cada7597'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:52.634616 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3677/7303] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:52 2022] PUT /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7/users/f799e8e6063f4f468d861c38bbc0b33c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:52.643956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3627/7304] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:52 2022] DELETE /identity/v3/users/a203d6cd15e84e57995e9e41cada7597 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:52.645170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.647501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.653544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.653748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.653930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.688488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:52.692361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] MFA Rules not processed for user `f799e8e6063f4f468d861c38bbc0b33c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:52.694980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.747450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fd434-c580-4f03-b431-b5db01c4859d tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.754155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.755246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.756057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.756057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/3bf3896ecdbf414cb054995d591630b4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.764550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Could not find domain: 3bf3896ecdbf414cb054995d591630b4.: keystone.exception.DomainNotFound: Could not find domain: 3bf3896ecdbf414cb054995d591630b4. Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3bf3896ecdbf414cb054995d591630b4. Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:18:52.775381 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:18:52.776941 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3bf3896ecdbf414cb054995d591630b4. Jun 04 21:18:52.778088 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.779265 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3628/7305] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:52 2022] PATCH /identity/v3/domains/3bf3896ecdbf414cb054995d591630b4 => generated 112 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:18:52.781233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.785843 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3678/7306] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:52.793684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90251f0-b32a-445f-829b-9b372a89020b tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.799101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.799538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.800044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.800336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.800619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.802725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.809687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Could not find domain: fcc7ced9643e4b5ab4005ea72437c65d.: keystone.exception.DomainNotFound: Could not find domain: fcc7ced9643e4b5ab4005ea72437c65d. Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fcc7ced9643e4b5ab4005ea72437c65d. Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:18:52.820053 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:18:52.821299 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fcc7ced9643e4b5ab4005ea72437c65d. Jun 04 21:18:52.822582 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.824517 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3629/7307] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:52 2022] PATCH /identity/v3/domains/fcc7ced9643e4b5ab4005ea72437c65d => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:18:52.828058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.840286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be7631-3ad9-4a15-96b5-6baac2c205e2 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.846839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.848217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.848468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.848754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/32228832ca4e4a18aa60b7134a2dadb2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.857925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Could not find domain: 32228832ca4e4a18aa60b7134a2dadb2.: keystone.exception.DomainNotFound: Could not find domain: 32228832ca4e4a18aa60b7134a2dadb2. Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 32228832ca4e4a18aa60b7134a2dadb2. Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:18:52.869507 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:18:52.870975 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 32228832ca4e4a18aa60b7134a2dadb2. Jun 04 21:18:52.872912 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.875238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3630/7308] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:52 2022] PATCH /identity/v3/domains/32228832ca4e4a18aa60b7134a2dadb2 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:18:52.876197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.894088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c41ec-617e-4453-90f3-b68f69a8c04a tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.899581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a0d671ed2543138221974a0688410f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b509d64c7bc349b19730085a622173f6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.900517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.900817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.901211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] PATH_INFO: `/v3/domains/d67f029180004708b2c8ece5e7070381` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.909774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f444-39bd-44da-ab09-6e1f361e5446 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:52.910050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:18:52.917142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:52.917827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.918110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.918494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Could not find domain: d67f029180004708b2c8ece5e7070381.: keystone.exception.DomainNotFound: Could not find domain: d67f029180004708b2c8ece5e7070381. Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d67f029180004708b2c8ece5e7070381. Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:18:52.921196 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:18:52.926235 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d67f029180004708b2c8ece5e7070381. Jun 04 21:18:52.927781 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:18:52.929707 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3631/7309] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:18:52 2022] PATCH /identity/v3/domains/d67f029180004708b2c8ece5e7070381 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:18:52.929707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:52.930159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:52.932306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:52.934119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9a931-ae5d-437d-8b74-c6b3584a2ff0 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:52.945719 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3679/7310] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:52.962111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:52.962433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:52.963027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:52.965193 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3680/7311] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 21:18:52.972594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:18:52.993142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.003438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aac6b-6c4a-4980-8fd2-8b77a592c5b9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.010301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f799e8e6063f4f468d861c38bbc0b33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85f797331b314055a74ecc2ce59b58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.011502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.011869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.012082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.013395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorizing `identity:get_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.013692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086240-3d33-4df8-9fca-e4512a577041 tempest-TokensV3TestJSON-2116832497 tempest-TokensV3TestJSON-2116832497-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.015992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0ba0-5a86-4531-a79d-17dbcc7eb729 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.018578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3681/7312] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:18:52 2022] GET /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 363 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:53.020278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.021465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.021969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.022478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] PATH_INFO: `/v3/users/b5a73076a3384223a412a8cc0c4d39c4` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.027487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a73076a3384223a412a8cc0c4d39c4)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.029668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.055974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.056297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.057194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.059920 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3682/7313] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:18:53.065300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:18:53.068034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.090654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a73076a3384223a412a8cc0c4d39c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.091447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a73076a3384223a412a8cc0c4d39c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.094965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.101508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a73076a3384223a412a8cc0c4d39c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.102572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a73076a3384223a412a8cc0c4d39c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.107470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e765-3ef6-4408-a4b1-0d6271dc8dc4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.112939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f799e8e6063f4f468d861c38bbc0b33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85f797331b314055a74ecc2ce59b58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.114313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.114706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.115486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.116490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorizing `identity:get_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.118462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab21d1-1165-4d0e-8f3e-83b80dd9a936 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.121261 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3683/7314] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:18:53 2022] GET /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 363 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:53.122600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae73cca4-b9d3-4b9e-b62a-0b7256ef13d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a73076a3384223a412a8cc0c4d39c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.145931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3632/7315] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:52 2022] DELETE /identity/v3/users/b5a73076a3384223a412a8cc0c4d39c4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:53.151036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.151939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.152240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.172577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.172927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.173155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.175242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3633/7316] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:18:53.176745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:53.178196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.183265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:18:53.185980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.206157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:53.212602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:53.263593 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3684/7317] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:53.277336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.279474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.317255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.318869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.372034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc54bd-10c7-4019-a92d-a6a54ec7383c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.384406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.385669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.386057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.386528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.399877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.401566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971fcc7-4c38-465b-b913-d2bab00b35f9 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.402985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdcc94-fd1b-49bd-a6d8-ca8c4b1cda0e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.407482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f799e8e6063f4f468d861c38bbc0b33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85f797331b314055a74ecc2ce59b58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.408385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.408675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.408955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.410213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorizing `identity:get_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.412373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.412834 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3685/7318] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:53.414460 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3634/7319] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:18:53 2022] GET /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 363 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:53.452532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753c0f-bb06-4ae1-ad2f-8aa1c33831ea None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.452906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753c0f-bb06-4ae1-ad2f-8aa1c33831ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.453221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753c0f-bb06-4ae1-ad2f-8aa1c33831ea None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.454849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3686/7320] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:18:53.461016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:18:53.463489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.486320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.500452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061765-b1f2-4595-bc9f-3528bb55e907 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.506984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f799e8e6063f4f468d861c38bbc0b33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85f797331b314055a74ecc2ce59b58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.507985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.508271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.508817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.510224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorizing `identity:get_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.512210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.519695 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3635/7321] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:18:53 2022] GET /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 363 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:53.554382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.554660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.555206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.556682 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3687/7322] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:18:53.579161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Authenticating service token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:18:53.605786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.620960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c656dc-2f46-4ddd-b318-a7a6173b2f5c tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.627695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f799e8e6063f4f468d861c38bbc0b33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85f797331b314055a74ecc2ce59b58f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.630999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.631707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.632002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.634352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorizing `identity:get_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.638132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.647263 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3636/7323] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:18:53 2022] GET /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 363 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:53.678739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.680944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.719997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5849b-040a-4339-9576-c8a792ef8b5b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.727985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.730653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.730983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.731267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] PATH_INFO: `/v3/users/f799e8e6063f4f468d861c38bbc0b33c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.736673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f799e8e6063f4f468d861c38bbc0b33c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.750362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.873868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f799e8e6063f4f468d861c38bbc0b33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.875669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:53.879340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:53.889324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f799e8e6063f4f468d861c38bbc0b33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.890020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f799e8e6063f4f468d861c38bbc0b33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.893946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f799e8e6063f4f468d861c38bbc0b33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.905270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31334a26-84de-41d9-a68c-41f00507cf42 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:53.918512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:53.919460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.919812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.920092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] PATH_INFO: `/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.922151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1a8e1780344ee6a8a2a7dfc999547a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:53.924121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:53.931453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9f531336-f391-4d88-8338-f7c602235068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f799e8e6063f4f468d861c38bbc0b33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:53.955996 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3688/7324] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:53 2022] DELETE /identity/v3/users/f799e8e6063f4f468d861c38bbc0b33c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:53.961599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:53.961751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:53.962216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:53.994774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:53.996198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.024159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1a8e1780344ee6a8a2a7dfc999547a', 'request_id': 'req-8e79b9e2-29f7-45a6-be87-175358b2527b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.034323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1a8e1780344ee6a8a2a7dfc999547a', 'request_id': 'req-8e79b9e2-29f7-45a6-be87-175358b2527b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.041567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1a8e1780344ee6a8a2a7dfc999547a', 'request_id': 'req-8e79b9e2-29f7-45a6-be87-175358b2527b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.065511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:54.073874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] The token cache is being invalidate because project 7a1a8e1780344ee6a8a2a7dfc999547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:54.074175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.077402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.080931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3637/7325] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:53 2022] DELETE /identity/v3/projects/7a1a8e1780344ee6a8a2a7dfc999547a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:54.084980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:54.086864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.098546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3689/7326] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:54.109485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:54.111453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.116021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:54.177803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b9e2-29f7-45a6-be87-175358b2527b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:54.186532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:54.187996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.188193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e749cab-cd6c-4560-9606-cca9e1fa6b86 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:54.188618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.189196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] PATH_INFO: `/v3/users/f0a0d671ed2543138221974a0688410f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.190753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a0d671ed2543138221974a0688410f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:54.193028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:54.193690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:54.194391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.194874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.195075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.207994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:54.209814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:54.238940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3690/7327] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:18:54.273317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a0d671ed2543138221974a0688410f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.274692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a0d671ed2543138221974a0688410f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.289891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a0d671ed2543138221974a0688410f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.291839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a0d671ed2543138221974a0688410f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.318441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a0d671ed2543138221974a0688410f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.345614 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3638/7328] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:54 2022] DELETE /identity/v3/users/f0a0d671ed2543138221974a0688410f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:54.595162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:54.596746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.626777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb6256-2797-44bd-bd71-80a3dfa7da62 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:54.717082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:54.719871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.720676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.721191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] PATH_INFO: `/v3/projects/85f797331b314055a74ecc2ce59b58f7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.722580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f797331b314055a74ecc2ce59b58f7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:54.725797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:54.805039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:54.807433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.807621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f797331b314055a74ecc2ce59b58f7', 'request_id': 'req-ae08232b-b2b2-4e4f-9021-35a85d1aa322'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.817361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f797331b314055a74ecc2ce59b58f7', 'request_id': 'req-ae08232b-b2b2-4e4f-9021-35a85d1aa322'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.826844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f797331b314055a74ecc2ce59b58f7', 'request_id': 'req-ae08232b-b2b2-4e4f-9021-35a85d1aa322'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.842073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc22009-e393-418f-8a5d-f31f49495e8b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:54.848221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] The token cache is being invalidate because project 85f797331b314055a74ecc2ce59b58f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:54.848474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.850492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ae08232b-b2b2-4e4f-9021-35a85d1aa322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.852761 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3691/7329] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:54 2022] DELETE /identity/v3/projects/85f797331b314055a74ecc2ce59b58f7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:54.859369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd87-fd81-4a4b-b19a-33e9331b0e7e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.859737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd87-fd81-4a4b-b19a-33e9331b0e7e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.860027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cdd87-fd81-4a4b-b19a-33e9331b0e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.884329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d40cdd87-fd81-4a4b-b19a-33e9331b0e7e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:54.885605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d40cdd87-fd81-4a4b-b19a-33e9331b0e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.903342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:54.920812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:54.921809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.922164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.922511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] PATH_INFO: `/v3/projects/b509d64c7bc349b19730085a622173f6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.923853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b509d64c7bc349b19730085a622173f6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:54.926048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:54.958356 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3692/7330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:54.966868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:54.967154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:54.967432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:54.976674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:54.984328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b509d64c7bc349b19730085a622173f6', 'request_id': 'req-571ec209-8d77-4c11-9c67-652faae33ef6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:54.990178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:54.991791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:54.993149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b509d64c7bc349b19730085a622173f6', 'request_id': 'req-571ec209-8d77-4c11-9c67-652faae33ef6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.002119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b509d64c7bc349b19730085a622173f6', 'request_id': 'req-571ec209-8d77-4c11-9c67-652faae33ef6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.019595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] The token cache is being invalidate because project b509d64c7bc349b19730085a622173f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:55.019852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.020526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.022208 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3639/7331] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:54 2022] DELETE /identity/v3/projects/b509d64c7bc349b19730085a622173f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:55.026660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.028316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:55.082881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3693/7332] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:55.088208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.100253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f55c5-2111-4e06-a1bc-c464d65bfad3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.106142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.106962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.121502 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ec209-8d77-4c11-9c67-652faae33ef6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.123115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.124122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.124656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:55.124914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.126586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.127429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.128734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.129045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.129298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] PATH_INFO: `/v3/users/d3f87e06e56e42e78b31f1f5617b2a3c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.130563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f87e06e56e42e78b31f1f5617b2a3c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.133300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.145173 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3694/7333] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:55.150619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.163637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f40f7-8de6-426e-9c8f-3d6bd6f0f908 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.169559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.170243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.170539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.170813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.171561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.173513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.210238 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3695/7334] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:55 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:55.214417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.221285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.222609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.232262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.233161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.247879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f87e06e56e42e78b31f1f5617b2a3c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.262891 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3640/7335] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:55 2022] DELETE /identity/v3/users/d3f87e06e56e42e78b31f1f5617b2a3c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:55.286570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2d981-1d36-457f-aa03-9cecfb235053 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.321659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:55.361559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.362320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.362609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.362890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.363627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.365702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.393969 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3696/7336] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:55 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:55.398517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.400664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:55.415260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47976-2478-4302-ae7a-2c78168f3fda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.420661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.421357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.421807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.422178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.422946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.424705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.436903 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3641/7337] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:55.441069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.457260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067b40-aadf-44e8-b840-232867a02368 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.464333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.465081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.465363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.465677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.466495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.468217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f75e12-60da-446b-bd3d-e00abcc810c7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.481689 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3697/7338] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:55.486234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.499267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fe299-8d0f-4ca7-88a0-63586c28d3b9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.506721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.507569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.507938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.508220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] PATH_INFO: `/v3/projects/8a055601f7214d1694d42450176f93e8/users/73b9eaafedde46579958bb30e21c0777/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.536949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a055601f7214d1694d42450176f93e8, user_id=73b9eaafedde46579958bb30e21c0777, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.541504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.557851 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3642/7339] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:55 2022] PUT /identity/v3/projects/8a055601f7214d1694d42450176f93e8/users/73b9eaafedde46579958bb30e21c0777/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:55.571279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.571738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.571950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.607601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] MFA Rules not processed for user `73b9eaafedde46579958bb30e21c0777`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:55.609380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:55.643950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.646180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:55.678901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:55.705964 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3698/7340] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:55.746874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:55.760484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351157ba-ecc9-4d79-92a2-380e97af7038 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.765945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.767496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.767496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.767792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] PATH_INFO: `/v3/projects/4d12f133a1094f30a8dd379fe54de6db` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.769067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d12f133a1094f30a8dd379fe54de6db)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.771079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.856025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376afb-11cc-43e6-9f44-299c8e5fd6ea None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:55.870601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d12f133a1094f30a8dd379fe54de6db', 'request_id': 'req-403e5467-91c6-4390-b2cf-a0f6673c8773'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.880435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d12f133a1094f30a8dd379fe54de6db', 'request_id': 'req-403e5467-91c6-4390-b2cf-a0f6673c8773'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.888800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d12f133a1094f30a8dd379fe54de6db', 'request_id': 'req-403e5467-91c6-4390-b2cf-a0f6673c8773'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.907110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] The token cache is being invalidate because project 4d12f133a1094f30a8dd379fe54de6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:55.907537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.908480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-403e5467-91c6-4390-b2cf-a0f6673c8773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:55.911756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3643/7341] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:55 2022] DELETE /identity/v3/projects/4d12f133a1094f30a8dd379fe54de6db => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:55.919870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9023-f8ef-4aa3-af3c-95071b16e610 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.920282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9023-f8ef-4aa3-af3c-95071b16e610 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.920705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9023-f8ef-4aa3-af3c-95071b16e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.922148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:55.941753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-669a9023-f8ef-4aa3-af3c-95071b16e610 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:55.943051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-669a9023-f8ef-4aa3-af3c-95071b16e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:55.943683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:55.944578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.944999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.945278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] PATH_INFO: `/v3/users/73b9eaafedde46579958bb30e21c0777` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.946703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b9eaafedde46579958bb30e21c0777)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:55.949005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:55.953920 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3644/7342] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:55.962197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:55.963236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:55.963236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:55.993360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:55.995473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.005908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3645/7343] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:56.010630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.022423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86861da-9fb3-4d3a-9ce1-41e5df57060b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.023482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b9eaafedde46579958bb30e21c0777'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:56.028687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.029445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.029971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.030291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.031073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:56.031405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.033090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b9eaafedde46579958bb30e21c0777'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:56.033410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.033873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b9eaafedde46579958bb30e21c0777'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:56.034501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b9eaafedde46579958bb30e21c0777'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:56.049525 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3646/7344] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:56.051642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e77ca8ba-a719-4781-8a50-c27480908534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b9eaafedde46579958bb30e21c0777'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:56.054631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.056868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.069383 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3699/7345] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:55 2022] DELETE /identity/v3/users/73b9eaafedde46579958bb30e21c0777 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:56.073950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.074158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.074510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.076509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2f4d1-fc59-48e8-a8c0-5762800e67bc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.095336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:56.096822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.148158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.148974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.149399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.149636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.150541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.152904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.177854 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3700/7346] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:56.189365 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3647/7347] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:56.190521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.190684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.192097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.195770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:56.274449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd2f56-3a4d-4117-8546-2d0836009a82 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.279821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0b0a4-f3db-4bf4-aa5b-8ecd80fd705a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.280187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.281063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.281394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.281699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.282623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.284982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.309123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:56.316308 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3648/7348] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:56 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:56.321021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.334091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94193457-b185-4f1f-b586-67f628a4a5f3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.339549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.340684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.340684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.340946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.341665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.343991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.347475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.348300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.348688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.349066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.357986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3649/7349] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:56.362546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.370215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.372018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.380054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a30e6-4095-419f-b495-07a6cca03b42 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.387265 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3701/7350] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:56.397382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.398335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.398674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.399068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.400523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.403190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fb494-7892-4e0c-9f12-1e6ee39d17fb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.423427 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3650/7351] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:18:56.424988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.443400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf7282-24cc-4f69-9bc5-a3f2fe1e9c96 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.449428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.451138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.451318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.451793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] PATH_INFO: `/v3/projects/4e38e3f89e374d028d715780aaf0bf34/users/84731196a4c844518ada75f16b0066cb/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.474243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e38e3f89e374d028d715780aaf0bf34, user_id=84731196a4c844518ada75f16b0066cb, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.478652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.500045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3702/7352] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:56 2022] PUT /identity/v3/projects/4e38e3f89e374d028d715780aaf0bf34/users/84731196a4c844518ada75f16b0066cb/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:56.513247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.513566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.513902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.545319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] MFA Rules not processed for user `84731196a4c844518ada75f16b0066cb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:56.546820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.652364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3651/7353] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:56.669700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.672771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.779428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.779855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf752c-6598-4f23-a85f-8c77f2b2b6c7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.781569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:56.784519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.786131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.786477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.787128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.802982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.805190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.819297 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3703/7354] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:56.896775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353833e-1582-4b30-a3fb-6eeffeb55dfe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.904822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.905777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.906089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.906546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] PATH_INFO: `/v3/projects/8a055601f7214d1694d42450176f93e8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.912338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a055601f7214d1694d42450176f93e8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.915651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.919042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:56.950083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:56.962871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aefe6-bc8c-4e93-9a7a-418ec44accf4 service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:56.968516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:56.969295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:56.969604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:56.969857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] PATH_INFO: `/v3/users/84731196a4c844518ada75f16b0066cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:56.971200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84731196a4c844518ada75f16b0066cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:56.973545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:56.993243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a055601f7214d1694d42450176f93e8', 'request_id': 'req-b3434ccb-13c1-42cd-9cb0-4d0313231031'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.005200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a055601f7214d1694d42450176f93e8', 'request_id': 'req-b3434ccb-13c1-42cd-9cb0-4d0313231031'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.013218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a055601f7214d1694d42450176f93e8', 'request_id': 'req-b3434ccb-13c1-42cd-9cb0-4d0313231031'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.031749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] The token cache is being invalidate because project 8a055601f7214d1694d42450176f93e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:57.032537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.033356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3434ccb-13c1-42cd-9cb0-4d0313231031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.035669 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3652/7355] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:56 2022] DELETE /identity/v3/projects/8a055601f7214d1694d42450176f93e8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:57.039384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84731196a4c844518ada75f16b0066cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.040977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7483-12df-4552-855d-67bf5b468743 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.041303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7483-12df-4552-855d-67bf5b468743 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.041739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed7483-12df-4552-855d-67bf5b468743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.052299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84731196a4c844518ada75f16b0066cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.052984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84731196a4c844518ada75f16b0066cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.053804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84731196a4c844518ada75f16b0066cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.068216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e1ed7483-12df-4552-855d-67bf5b468743 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:57.069576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e1ed7483-12df-4552-855d-67bf5b468743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.091840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e24c7afe-1069-451c-8e50-4edab64fb4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84731196a4c844518ada75f16b0066cb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.110122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3704/7356] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:18:56 2022] DELETE /identity/v3/users/84731196a4c844518ada75f16b0066cb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:18:57.114859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.115336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.116283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.136006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:57.137312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.151809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:57.157700 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3653/7357] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:57.166861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.167335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.167698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.192938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:57.194177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.224517 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3705/7358] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:57.236804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.238562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.281526 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3654/7359] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:57.286880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.299213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc94e-67c4-4449-8441-88613d2062a4 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.304940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.305831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.306174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.306631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.308371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:57.308684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.310315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.318011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaa752-c956-4934-80e3-c40276fc6a99 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.325181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.325885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.326341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.326623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.331547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3655/7360] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:18:57.334214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.341398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.343229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.346086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91198061-bbdb-4fa4-95cd-ec23ca6979ce admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.352632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.353625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.354119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.354650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.356566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.360098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.362562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3706/7361] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:57.391416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:57.420118 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3656/7362] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:57.424417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.438926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9c6ee-db4a-44af-a384-a71a88fe203e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.524091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.524984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.525417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.525874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.527566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.529558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.556661 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3707/7363] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:57.560827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.576551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1e41-8805-412f-a2c7-6fcf576ac238 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.583270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.583968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.584249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.585028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.585491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.587705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.601779 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3657/7364] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:57.605408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.620684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752444a0-1b58-4318-9ce7-ed31f28e6338 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.627400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.628526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.628672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.629569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.630101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.631912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.646109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3708/7365] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:57.650214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.666945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df18c-f17d-42ff-bfbf-3480578c0cf3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.674511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.674987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.675591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.675732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] PATH_INFO: `/v3/projects/ed013dca03534a42a3a99593e56d0162/users/6343f086d9584796aba71988b14570f0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.696678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed013dca03534a42a3a99593e56d0162, user_id=6343f086d9584796aba71988b14570f0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.700831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3df643-c9e7-4054-9686-7bc50d62c5b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.718552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.721146 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3658/7366] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:57 2022] PUT /identity/v3/projects/ed013dca03534a42a3a99593e56d0162/users/6343f086d9584796aba71988b14570f0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:57.724571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.735577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.736766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.737075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.740984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a7aa9-db16-4c25-8e4f-b3d5a8421f50 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.776048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:57.777814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:57.796815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:57.820194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:57.821364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.822007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.822357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] PATH_INFO: `/v3/projects/4e38e3f89e374d028d715780aaf0bf34` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.823678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e38e3f89e374d028d715780aaf0bf34)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:57.825800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:57.858794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3659/7367] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:57.869598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:57.897611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e38e3f89e374d028d715780aaf0bf34', 'request_id': 'req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.905843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e38e3f89e374d028d715780aaf0bf34', 'request_id': 'req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.913998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e38e3f89e374d028d715780aaf0bf34', 'request_id': 'req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.931091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] The token cache is being invalidate because project 4e38e3f89e374d028d715780aaf0bf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:18:57.931380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.932148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc7bec0a-aeae-4b70-ae3f-d743d52e7f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:18:57.935166 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3709/7368] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:18:57 2022] DELETE /identity/v3/projects/4e38e3f89e374d028d715780aaf0bf34 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:57.941887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7303-f6da-4422-adca-6cc43cad2012 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:57.942302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7303-f6da-4422-adca-6cc43cad2012 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:57.942931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad7303-f6da-4422-adca-6cc43cad2012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:57.956174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a4f1-7718-4d82-be0d-3cec2bec3240 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:57.968728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e4ad7303-f6da-4422-adca-6cc43cad2012 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:57.970478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e4ad7303-f6da-4422-adca-6cc43cad2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:58.030851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d970b0-2612-4497-a157-035a218895da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.031713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d970b0-2612-4497-a157-035a218895da service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.032142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d970b0-2612-4497-a157-035a218895da service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.032477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d970b0-2612-4497-a157-035a218895da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.034681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-23d970b0-2612-4497-a157-035a218895da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:58.056326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3710/7369] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:58.064325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.064574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.064920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.077182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:58.092522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:58.094191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:58.105641 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3711/7370] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:18:58.109972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.120614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebebf1-e43d-4c2e-a8d3-d0e335dff167 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.125747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.126544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.126836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.127119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.127928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:18:58.128359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.129610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d970b0-2612-4497-a157-035a218895da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.130482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.131493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d970b0-2612-4497-a157-035a218895da service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.146993 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3660/7371] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:18:58.148466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3712/7372] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:18:58.153415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d970b0-2612-4497-a157-035a218895da service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.169242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d970b0-2612-4497-a157-035a218895da service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.176499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.177325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.177660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.178598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.178710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.181635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.220931 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3661/7373] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:58.225633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.238840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789a4c-b074-4b0b-9d4a-116e0f38fca0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.302691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:58.319870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.320877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.321229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.321582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.322563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.324662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.354352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3713/7374] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:18:58.355607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.369120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca069-b244-474b-b9d4-9c3e6ca33c44 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.381203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.382707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.383171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.383956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.385081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.388074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.403674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3662/7375] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:58.407007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.423672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b37e5a-8d7d-4a1e-b423-a1473f0c4009 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.432106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.433203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.433584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.433959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.434818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.441679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31438883-2ed7-450f-b4fd-5f98ffc52fa4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.460695 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3714/7376] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:58.464981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.478381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e274377-fc7f-4d29-9c75-06dca38ba17f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.489612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.490563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.490996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.491298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] PATH_INFO: `/v3/projects/ffd81900c7b3450698351afc4aa73f8e/users/dfe6c67740a343fa9ae3d68669cbd584/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.511769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd81900c7b3450698351afc4aa73f8e, user_id=dfe6c67740a343fa9ae3d68669cbd584, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.512941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.513462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.514216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.514915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9290cf-3ea2-4f82-9e6c-f2b875a9a737 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.539636 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3663/7377] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:58 2022] PUT /identity/v3/projects/ffd81900c7b3450698351afc4aa73f8e/users/dfe6c67740a343fa9ae3d68669cbd584/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:58.542872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] MFA Rules not processed for user `bff665dac5de4530ab70f20ba2da386d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:58.544910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:58.545071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.545403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.549037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.594390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] MFA Rules not processed for user `dfe6c67740a343fa9ae3d68669cbd584`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:58.595688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:58.635352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3715/7378] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:58.713899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3664/7379] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:58.715464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.812488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b86c2-f432-44a3-b00f-d7a1563f3640 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.820809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.821524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.821809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.822200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.823434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.825453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.859111 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3716/7380] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:58.863722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:58.878936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb748-4c54-4d1f-8f34-e17c0b125aa0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:58.981945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:58.982628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:58.982917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:58.983221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:58.984059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:58.986466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:58.996221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:59.026336 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3665/7381] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:18:58 2022] POST /identity/v3/users => generated 310 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:18:59.030914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:59.042597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818036-1098-4533-ac82-2480ca86fefa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:59.052105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:59.052760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.053042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.053914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.054226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:59.055897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:59.070446 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3717/7382] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:59.074562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:59.087114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81424c-e9f9-48e1-931e-6f5875f30efb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:59.095103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:59.096165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.097055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.097055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] PATH_INFO: `/v3/projects/6ae152376bcc49aa882dbe4becab7eec/users/bcb634e74e164c4facdd92ae16452631/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.118368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae152376bcc49aa882dbe4becab7eec, user_id=bcb634e74e164c4facdd92ae16452631, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:59.122861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:59.142840 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3666/7383] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:59 2022] PUT /identity/v3/projects/6ae152376bcc49aa882dbe4becab7eec/users/bcb634e74e164c4facdd92ae16452631/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:59.146906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:59.169794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887615b6-4c2d-4bb7-a4ed-b2691333ee85 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:59.250618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:59.274967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:59.276761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.276761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.276761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.277727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:59.279768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1fea0-133b-40fb-b88f-f0a616cd516d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:59.294600 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3718/7384] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:18:59.299231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:59.314040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b596a3-a86e-417e-975d-8565444c8059 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:59.326756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:59.328746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.329041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.331882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] PATH_INFO: `/v3/projects/6ae152376bcc49aa882dbe4becab7eec/users/bcb634e74e164c4facdd92ae16452631/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.336579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae152376bcc49aa882dbe4becab7eec, user_id=bcb634e74e164c4facdd92ae16452631, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:59.344445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:59.368657 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3667/7385] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:18:59 2022] PUT /identity/v3/projects/6ae152376bcc49aa882dbe4becab7eec/users/bcb634e74e164c4facdd92ae16452631/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:18:59.382300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.382300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.382300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.423497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] MFA Rules not processed for user `bcb634e74e164c4facdd92ae16452631`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:18:59.426558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:59.543492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3719/7386] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:18:59.655257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:18:59.658262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:18:59.767929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeeb3c-2d45-4c1e-98c2-8b385eca2373 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:18:59.781299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:18:59.781299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:18:59.781299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:18:59.781299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:18:59.880536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:18:59.882542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f67b16-dda6-45d7-8db0-7a702e03ddc6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:18:59.896235 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3668/7387] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:18:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:01.061531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:01.063059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:01.181297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093d0d-9085-4c8b-8d30-7b609002f842 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:01.198355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:01.199190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:01.199593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:01.200972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:01.218243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:01.220108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:01.238961 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3720/7388] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:05.348416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5bfa-9313-4bf1-a203-c79d35fd5931 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:05.349493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5bfa-9313-4bf1-a203-c79d35fd5931 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:05.350092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5bfa-9313-4bf1-a203-c79d35fd5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:05.388213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1c9f5bfa-9313-4bf1-a203-c79d35fd5931 None None] MFA Rules not processed for user `6343f086d9584796aba71988b14570f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:05.389917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c9f5bfa-9313-4bf1-a203-c79d35fd5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:05.497018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:05.511672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3669/7389] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:05.529540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:05.545626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13773a1e-2e8e-4508-8eca-91b85ec1aa73 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:05.559412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:05.560274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:05.560833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:05.561684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:05.582178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:05.586000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:05.599257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3721/7390] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:07.507916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267259ac-2fce-4b28-b312-b0cc09449cc9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:07.508477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267259ac-2fce-4b28-b312-b0cc09449cc9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:07.508708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267259ac-2fce-4b28-b312-b0cc09449cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:07.535684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-267259ac-2fce-4b28-b312-b0cc09449cc9 None None] MFA Rules not processed for user `6343f086d9584796aba71988b14570f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:07.537426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-267259ac-2fce-4b28-b312-b0cc09449cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:07.546260 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3670/7391] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:11.069820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:11.128376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:11.157288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20a5fd-96d3-476e-ac69-ce3124e40363 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:11.166184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:11.167125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:11.167471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:11.167847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] PATH_INFO: `/v3/users/dfe6c67740a343fa9ae3d68669cbd584` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:11.169484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe6c67740a343fa9ae3d68669cbd584)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:11.172536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:11.239595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe6c67740a343fa9ae3d68669cbd584'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:11.253329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe6c67740a343fa9ae3d68669cbd584'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:11.254387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe6c67740a343fa9ae3d68669cbd584'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:11.255928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe6c67740a343fa9ae3d68669cbd584'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:11.280778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe6c67740a343fa9ae3d68669cbd584'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:11.300180 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3722/7392] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:19:11 2022] DELETE /identity/v3/users/dfe6c67740a343fa9ae3d68669cbd584 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:11.305605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:11.306252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:11.306366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:11.325232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:11.338521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:11.450863 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3671/7393] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:11.467424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:11.468968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:11.554014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d9992-d388-4b2a-8f0e-e07e7bc9956a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:11.559997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:11.560715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:11.561004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:11.561338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:11.577721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:11.579645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:11.591432 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3723/7394] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:11.695239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:11.698414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:11.820409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e0315-6563-4a4f-988e-89a27cefdee2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:11.829394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:11.831067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:11.831570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:11.832052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:11.834438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:11.853704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:11.856685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:11.882507 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3672/7395] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:11.921112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:11.923978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:11.956455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76616a6-044a-497b-b0fa-a48d8635736a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:11.968685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:11.971016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:11.971537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:11.973073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] PATH_INFO: `/v3/projects/ffd81900c7b3450698351afc4aa73f8e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:11.974790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd81900c7b3450698351afc4aa73f8e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:11.978986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:12.094169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd81900c7b3450698351afc4aa73f8e', 'request_id': 'req-42f4c72e-3e40-45d8-8be5-5d0b5c815890'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.105240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd81900c7b3450698351afc4aa73f8e', 'request_id': 'req-42f4c72e-3e40-45d8-8be5-5d0b5c815890'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.111948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:12.114641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd81900c7b3450698351afc4aa73f8e', 'request_id': 'req-42f4c72e-3e40-45d8-8be5-5d0b5c815890'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.163632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] The token cache is being invalidate because project ffd81900c7b3450698351afc4aa73f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:19:12.163944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.166330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.174384 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3724/7396] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:19:11 2022] DELETE /identity/v3/projects/ffd81900c7b3450698351afc4aa73f8e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:12.179188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:12.195794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b596-1f60-493e-baef-b5bcafc05e80 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:12.275174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:12.276162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:12.276446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:12.277361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] PATH_INFO: `/v3/users/bcb634e74e164c4facdd92ae16452631` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:12.278747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb634e74e164c4facdd92ae16452631)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:12.281478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:12.300848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:12.360396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb634e74e164c4facdd92ae16452631'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.361569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb634e74e164c4facdd92ae16452631'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.388763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb634e74e164c4facdd92ae16452631'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.389719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb634e74e164c4facdd92ae16452631'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.411793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0fedef6e-1212-4e02-8637-255b0c0efca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb634e74e164c4facdd92ae16452631'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.438301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3673/7397] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:19:12 2022] DELETE /identity/v3/users/bcb634e74e164c4facdd92ae16452631 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:12.774210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:12.776509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:12.806432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-3e40-45d8-8be5-5d0b5c815890 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:12.898022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:12.899123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:12.899682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:12.900357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] PATH_INFO: `/v3/projects/6ae152376bcc49aa882dbe4becab7eec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:12.902366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae152376bcc49aa882dbe4becab7eec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:12.905181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:12.976109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae152376bcc49aa882dbe4becab7eec', 'request_id': 'req-5d8457f7-c3ef-478e-8143-e78de02f5b8f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.987526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae152376bcc49aa882dbe4becab7eec', 'request_id': 'req-5d8457f7-c3ef-478e-8143-e78de02f5b8f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:12.997769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae152376bcc49aa882dbe4becab7eec', 'request_id': 'req-5d8457f7-c3ef-478e-8143-e78de02f5b8f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:13.027599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] The token cache is being invalidate because project 6ae152376bcc49aa882dbe4becab7eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:19:13.028030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:13.028883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5d8457f7-c3ef-478e-8143-e78de02f5b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:13.030835 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3725/7398] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:19:12 2022] DELETE /identity/v3/projects/6ae152376bcc49aa882dbe4becab7eec => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:13.036983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.037348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.037580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.080261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:13.081867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:13.183741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3674/7399] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:13.187185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.189123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.189913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.219119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:13.220697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:13.230829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3726/7400] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:13.235601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.251085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124c34-98f0-4f0b-96a4-c05e20c7bf37 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.258732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.260359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.260754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.261130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.262512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:19:13.263188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.266219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.285993 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3675/7401] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:19:13.287660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.301350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bad462-9ff2-4b2c-92bd-7dedd484da07 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.309848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.310945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.311710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.312422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.313604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.316438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.378155 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3727/7402] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:13.384704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.408244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028e694-3d7a-4d14-9fa5-afd7e5bf5f06 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.525916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.526484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.526774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.527080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.528234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.531482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.566070 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3676/7403] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:13.567332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.598451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ee9f-60d2-41f9-8125-ef52950b6308 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.606083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.608278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.609144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.609434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.611087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.612791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.625357 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3728/7404] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:19:13.630432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.642277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af52e70-0f4f-4a3c-8429-400112d9bcee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.648150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.648850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.649137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.649412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.650209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.652096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7e99d-7ccc-4906-a864-531c6ae24a54 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.662195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:13.672069 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3677/7405] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:19:13.676742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.692208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8dba2-b236-4ebd-bd7b-3636db5a9d2e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.697933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.699314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.699795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.700208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] PATH_INFO: `/v3/projects/0481484eda3646e9b2737925645a6e1c/users/f8c12c1a3e3e405bb45825810267373d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.720078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0481484eda3646e9b2737925645a6e1c, user_id=f8c12c1a3e3e405bb45825810267373d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.722933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:13.739577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3729/7406] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:19:13 2022] PUT /identity/v3/projects/0481484eda3646e9b2737925645a6e1c/users/f8c12c1a3e3e405bb45825810267373d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:13.750981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.751276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.751543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.781159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] MFA Rules not processed for user `f8c12c1a3e3e405bb45825810267373d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:13.782547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:13.880015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3678/7407] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:13.889255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:13.910069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:13.983545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc761e7-09f4-4c88-b64e-394b152cc6b3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:13.989756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:13.990512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:13.990798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:13.991074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:13.991810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:13.994311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.034816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3730/7408] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:19:13 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:14.039352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.053360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac1fe5-2f45-4240-b64f-bd2e7e8155d7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.116025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.117020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.117317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.117685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.118714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.121154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.143744 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3679/7409] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:19:14 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:19:14.147786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.159649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9f7af-7477-43f7-8373-8e06b4d76f55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.165315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.166677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.166963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.167240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.168019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.169654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.182637 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3731/7410] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:19:14.188247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.200813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742dcc7-d0ad-452f-8441-80def88be1ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.207142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.208095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.208384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.208665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] PATH_INFO: `/v3/projects/6a36da98d50447a599954a53b1441e5c/users/235e0a1c55964fe9909d2b60307a3aee/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.225650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a36da98d50447a599954a53b1441e5c, user_id=235e0a1c55964fe9909d2b60307a3aee, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.228602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.244012 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3680/7411] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:19:14 2022] PUT /identity/v3/projects/6a36da98d50447a599954a53b1441e5c/users/235e0a1c55964fe9909d2b60307a3aee/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:14.249610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.268636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818f3d-1948-4f6f-8f14-1a41acc7456e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.339438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.340229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.340510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.340783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.341511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.343125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7766268-8d77-4fe4-b92a-fb0f8a106774 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.353617 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3732/7412] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:19:14.358901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.372717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d09b-85a3-4380-b8a1-0125863dfd70 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.378637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.379841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.380294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.380838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] PATH_INFO: `/v3/projects/6a36da98d50447a599954a53b1441e5c/users/235e0a1c55964fe9909d2b60307a3aee/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.384632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a36da98d50447a599954a53b1441e5c, user_id=235e0a1c55964fe9909d2b60307a3aee, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.388955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.403184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3681/7413] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:19:14 2022] PUT /identity/v3/projects/6a36da98d50447a599954a53b1441e5c/users/235e0a1c55964fe9909d2b60307a3aee/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:14.420999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.421519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.421890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.454534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] MFA Rules not processed for user `235e0a1c55964fe9909d2b60307a3aee`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:14.456232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:14.530262 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3733/7414] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:14.542478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:14.544370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:14.604088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:14.620523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15fcaa-6df3-4dbe-8804-94b716886b1d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:14.624844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:14.625506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:14.625800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:14.626145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:14.636247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:14.637725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:14.648320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3682/7415] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:19:20.722005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:20.738445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c3717-aa83-4b59-84d5-d69aa82531df None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:20.753307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235e0a1c55964fe9909d2b60307a3aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a36da98d50447a599954a53b1441e5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:20.754652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:20.754652 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:20.755286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:20.757031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:19:20.757031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:20.759656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:20.763523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:20.779142 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3734/7416] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:19:20.783737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:20.794427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d762e-388f-4e29-8ce4-8140e9927137 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:20.800242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235e0a1c55964fe9909d2b60307a3aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a36da98d50447a599954a53b1441e5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:20.800874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:20.801151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:20.801445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:20.802867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:20.805035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:20.852483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:20.860676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3683/7417] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:19:20 2022] POST /identity/v3/projects => generated 348 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:20.872912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32cad8-279a-4095-9f4a-00feb5b70d8d tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:20.936169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235e0a1c55964fe9909d2b60307a3aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a36da98d50447a599954a53b1441e5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:20.936991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:20.937237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:20.937488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:20.938257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:19:20.938561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:20.940371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:20.960008 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3735/7418] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:19:21.370617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:21.382970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bde-618f-4725-9f9f-b3400fa0a5b5 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:21.389147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '235e0a1c55964fe9909d2b60307a3aee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a36da98d50447a599954a53b1441e5c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:21.390070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:21.390413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:21.390762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] PATH_INFO: `/v3/projects/2d6b9d51f1ae47758f3a8621406a789a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:21.392334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d6b9d51f1ae47758f3a8621406a789a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:21.394246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:21.445212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6b9d51f1ae47758f3a8621406a789a', 'request_id': 'req-407bae20-7d46-4433-9cf2-33c9027b738a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:21.456048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6b9d51f1ae47758f3a8621406a789a', 'request_id': 'req-407bae20-7d46-4433-9cf2-33c9027b738a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:21.462760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6b9d51f1ae47758f3a8621406a789a', 'request_id': 'req-407bae20-7d46-4433-9cf2-33c9027b738a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:21.478220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] The token cache is being invalidate because project 2d6b9d51f1ae47758f3a8621406a789a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:19:21.478508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:21.479321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-407bae20-7d46-4433-9cf2-33c9027b738a tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:21.481180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3684/7419] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:19:21 2022] DELETE /identity/v3/projects/2d6b9d51f1ae47758f3a8621406a789a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:21.492239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:21.494257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:21.558231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c0d75-61c5-481b-849b-92647dee83e2 tempest-RoutersAdminTest-989553967 tempest-RoutersAdminTest-989553967-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:21.611570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:21.612156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:21.612444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:21.612721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:21.614718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:21.676017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:21.677464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:21.682294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:21.688050 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3736/7420] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:27.288206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7e21-f26b-4c5d-bac3-add40f7e8737 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:27.288674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7e21-f26b-4c5d-bac3-add40f7e8737 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:27.288963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb7e21-f26b-4c5d-bac3-add40f7e8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:27.309611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66eb7e21-f26b-4c5d-bac3-add40f7e8737 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:27.311051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66eb7e21-f26b-4c5d-bac3-add40f7e8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:27.383763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3685/7421] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:27.408556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:27.410102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:27.492718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe5fb-3d4a-4db7-8a1d-da3e6eb0b4e7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:27.500030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:27.500030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:27.500030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:27.500030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:27.509898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:27.511715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d5202-2a05-4447-a565-ad5c977eb0fa service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:27.521833 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3737/7422] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:19:32.611424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:32.611989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:32.612192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:32.631318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:32.632583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:32.680327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:32.694390 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3686/7423] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:33.010805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:33.011328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:33.011328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:33.030598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] MFA Rules not processed for user `59e619953f32406891051e0e029c1670`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:33.031875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:33.091350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3738/7424] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:33.610394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:33.624699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18c5e2-ab43-4b0f-902e-563eb41acd72 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:33.629525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:33.630213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:33.630497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:33.630769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:33.632909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:33.645792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:33.647242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:33.657649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3687/7425] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:43.083121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=57 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:43.652247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:47.288781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:47.306904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460d9e-3b90-4650-9295-6d8972681702 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:47.310649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:47.311314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:47.311630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:47.311929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:47.313723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:47.403647 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:47.405797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00bc6-ba9c-4389-a609-229559dce49e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:47.418080 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3739/7426] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:19:52.718539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:52.720313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:52.800782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6ee86-1625-47a8-83e1-974f5a062cf3 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:52.806171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:52.807079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:52.807365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:52.807644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] PATH_INFO: `/v3/users/f8c12c1a3e3e405bb45825810267373d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:52.808852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c12c1a3e3e405bb45825810267373d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:52.810792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:52.861959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c12c1a3e3e405bb45825810267373d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:52.862612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c12c1a3e3e405bb45825810267373d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:52.870861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c12c1a3e3e405bb45825810267373d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:52.871490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c12c1a3e3e405bb45825810267373d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:52.882954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c12c1a3e3e405bb45825810267373d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:52.897523 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3688/7427] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:19:52 2022] DELETE /identity/v3/users/f8c12c1a3e3e405bb45825810267373d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:52.902509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:52.902971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:52.903252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:52.921067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:52.922299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:52.993380 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3740/7428] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:53.003473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:53.005092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:53.069232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0874-4f86-45a3-bc80-6c1d3767ef22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:53.073928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:53.074576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:53.074863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:53.075142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:53.085333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:53.086778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:53.096724 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3689/7429] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:19:53.402608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:53.404241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:53.418968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bc1b7-d5af-47c7-9d6f-d39461327867 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:53.423986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:53.424872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:53.425161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:53.425439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] PATH_INFO: `/v3/projects/0481484eda3646e9b2737925645a6e1c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:53.426643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0481484eda3646e9b2737925645a6e1c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:53.428656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:53.477507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0481484eda3646e9b2737925645a6e1c', 'request_id': 'req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.484297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0481484eda3646e9b2737925645a6e1c', 'request_id': 'req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.489793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0481484eda3646e9b2737925645a6e1c', 'request_id': 'req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.504835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] The token cache is being invalidate because project 0481484eda3646e9b2737925645a6e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:19:53.505120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.505810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.507469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3741/7430] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:19:53 2022] DELETE /identity/v3/projects/0481484eda3646e9b2737925645a6e1c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:53.512482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:53.523957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f7a80-741a-4e07-b35d-fa9ea7e639b4 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:53.543533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:53.592780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:53.593679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:53.593962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:53.594238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] PATH_INFO: `/v3/users/235e0a1c55964fe9909d2b60307a3aee` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:53.601842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=235e0a1c55964fe9909d2b60307a3aee)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:53.604337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:53.656518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235e0a1c55964fe9909d2b60307a3aee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.657181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235e0a1c55964fe9909d2b60307a3aee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.664130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235e0a1c55964fe9909d2b60307a3aee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.664817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235e0a1c55964fe9909d2b60307a3aee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.680006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6c6494c6-6bda-4387-9d88-8ae73decf24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235e0a1c55964fe9909d2b60307a3aee'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:53.698737 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3690/7431] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:19:53 2022] DELETE /identity/v3/users/235e0a1c55964fe9909d2b60307a3aee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:19:53.881886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:53.884013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:53.900699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317cdb-b78b-4fda-84d5-33f7ca79b0ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:53.914391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:53.960538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:53.961417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:53.961700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:53.961977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] PATH_INFO: `/v3/projects/6a36da98d50447a599954a53b1441e5c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:53.963455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a36da98d50447a599954a53b1441e5c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:53.965592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.023572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a36da98d50447a599954a53b1441e5c', 'request_id': 'req-9547bfae-bf66-40a9-b943-482717c830d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:54.030364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a36da98d50447a599954a53b1441e5c', 'request_id': 'req-9547bfae-bf66-40a9-b943-482717c830d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:54.036096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a36da98d50447a599954a53b1441e5c', 'request_id': 'req-9547bfae-bf66-40a9-b943-482717c830d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:54.050188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] The token cache is being invalidate because project 6a36da98d50447a599954a53b1441e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:19:54.050477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:54.051107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9547bfae-bf66-40a9-b943-482717c830d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:19:54.052756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3742/7432] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:19:53 2022] DELETE /identity/v3/projects/6a36da98d50447a599954a53b1441e5c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:54.057788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.058252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.058388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.077124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:54.078378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:54.149344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3691/7433] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:54.157301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.157595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.157875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.178051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:54.179267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:54.189357 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3743/7434] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:54.195471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.205862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc4a9-25f1-475e-92d5-84d0e5840a2f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.212248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.213230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.213499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.213772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.214521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:19:54.214827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.216485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.228565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3692/7435] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:19:54.232808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.242497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfbe0d-fcf1-4f92-aeb3-ea679df23ac0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.250876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.251644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.251974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.252302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.253829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.256331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.288652 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3744/7436] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:19:54 2022] POST /identity/v3/projects => generated 397 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:54.294373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.305703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41720ac-60bd-4bfc-b32a-90f3274de000 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.332807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:54.368921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.369601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.369879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.370153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.370862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.372814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.397127 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3693/7437] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:19:54 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:19:54.401657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.412118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7d3f4-5391-465e-867f-dd55d0466d78 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.417336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.417992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.418275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.418521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.419292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.420902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.432072 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3745/7438] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:19:54.436749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.453431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915d5e-a139-4df3-be34-a62c5f37b0cf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.461358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.462318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.462708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.462985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.463769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.465353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10254fc1-c016-4b3a-a3a3-be6c974bfbfc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.475930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3694/7439] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:19:54.480288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.491145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6690b-7e8e-4458-af1b-f059283fb38e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.496993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.497877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.498153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.498435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] PATH_INFO: `/v3/projects/f24ca527cf764793ab5c1a39cf1558da/users/ebce6b7692864001ab3a2ab1270f824f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.513435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24ca527cf764793ab5c1a39cf1558da, user_id=ebce6b7692864001ab3a2ab1270f824f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.516493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.532042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3746/7440] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:19:54 2022] PUT /identity/v3/projects/f24ca527cf764793ab5c1a39cf1558da/users/ebce6b7692864001ab3a2ab1270f824f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:19:54.543051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40cbd-725d-4254-abfb-abc2b47e723a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.543457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40cbd-725d-4254-abfb-abc2b47e723a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.543860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40cbd-725d-4254-abfb-abc2b47e723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.573945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8fb40cbd-725d-4254-abfb-abc2b47e723a None None] MFA Rules not processed for user `ebce6b7692864001ab3a2ab1270f824f`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:19:54.575164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fb40cbd-725d-4254-abfb-abc2b47e723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:54.644302 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3695/7441] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:19:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:19:54.654852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:19:54.656906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:19:54.705773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:54.720566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f31014-d337-45ee-b312-56cd0a0f6ee7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:19:54.724393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:19:54.725040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:19:54.725321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:19:54.725593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:19:54.734150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:19:54.735610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52fea5-a080-4f4f-b726-5e602e67744c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:19:54.744455 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3747/7442] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:19:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:04.640670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:04.692699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:04.692699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:04.692699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:04.711183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] MFA Rules not processed for user `6343f086d9584796aba71988b14570f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:04.712366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:04.740297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:04.774261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3696/7443] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:06.022335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:06.023766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:06.024289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:06.053340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:06.054724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:06.172525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:06.198112 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3748/7444] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:06.207641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:06.210246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:06.315577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e978c5-2c51-409c-ba3b-157938657fcb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:06.320865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:06.322282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:06.322714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:06.323310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] PATH_INFO: `/v3/users/ebce6b7692864001ab3a2ab1270f824f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:06.325338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebce6b7692864001ab3a2ab1270f824f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:06.328093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:06.350152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9bcc-2ac6-4826-984c-2f9d5f0cc859 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:06.360420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:06.360420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:06.360420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:06.360420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:06.371820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:06.373872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cfa3e-8e4c-49a3-aca1-332f7b11e829 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:06.384136 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3749/7445] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:20:06.461052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebce6b7692864001ab3a2ab1270f824f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:06.463829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebce6b7692864001ab3a2ab1270f824f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:06.492678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebce6b7692864001ab3a2ab1270f824f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:06.493856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebce6b7692864001ab3a2ab1270f824f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:06.521511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebce6b7692864001ab3a2ab1270f824f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:06.548865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3697/7446] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:20:06 2022] DELETE /identity/v3/users/ebce6b7692864001ab3a2ab1270f824f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:06.553481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:06.553794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:06.554078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:06.575519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:06.576774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:06.682296 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3750/7447] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:06.692935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:06.694562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:06.737010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:06.787953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5be9-a6a1-458f-8883-db53cb43926c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:06.793435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:06.796289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:06.796289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:06.796289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:06.808250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:06.810059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a90f6-2f4f-4684-b617-b58e6f7b4ab6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:06.833469 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3698/7448] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:07.065459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.067262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:07.088695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60dc37-42c2-4bc6-86df-a70bb846f3e7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.094634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.095692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.096061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.096410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] PATH_INFO: `/v3/projects/f24ca527cf764793ab5c1a39cf1558da` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.099473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24ca527cf764793ab5c1a39cf1558da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.105366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.170575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:07.219672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24ca527cf764793ab5c1a39cf1558da', 'request_id': 'req-7da58c61-efbb-4cb8-b942-670b861b601b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:07.231298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24ca527cf764793ab5c1a39cf1558da', 'request_id': 'req-7da58c61-efbb-4cb8-b942-670b861b601b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:07.250936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24ca527cf764793ab5c1a39cf1558da', 'request_id': 'req-7da58c61-efbb-4cb8-b942-670b861b601b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:07.271627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] The token cache is being invalidate because project f24ca527cf764793ab5c1a39cf1558da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:20:07.271923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:07.273165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7da58c61-efbb-4cb8-b942-670b861b601b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:07.276887 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3751/7449] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:20:07 2022] DELETE /identity/v3/projects/f24ca527cf764793ab5c1a39cf1558da => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:07.281693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.282202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.282290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.336609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:07.337990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:07.434672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3699/7450] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:07.442391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.442680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.442961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.466015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:07.467235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:07.481114 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3752/7451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:07.485233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.503100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dee16-2e32-4ea7-894f-3087a01c8930 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.511020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.511755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.512042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.512324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.513420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:20:07.513735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.515400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.545790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3700/7452] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:20:07.550641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.568522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bde29-9de9-43af-b157-367a4c3d3378 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.586812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.588846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.589136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.589415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.590130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.592094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.643486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3753/7453] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:20:07 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:20:07.648053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.663834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a922-75fc-421b-8b38-b998422b6ca6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.749172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.749894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.750184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.751138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.752015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.753988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.787597 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3701/7454] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:20:07 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:20:07.789291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.804673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d78ac-b643-47b5-b81c-ea57a5be8b4b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.809783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.810580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.811113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.811492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.812368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.814365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.832257 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3754/7455] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:20:07.833860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.851565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47843e1b-03d1-4234-bec4-4c0af324bf88 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.856948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.857659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.857958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.858369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.859267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.861449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac4349-de41-4892-9c6f-7c22b5e80dd6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:07.885117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:07.886154 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3702/7456] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:20:07.904193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ca3f-b811-460c-9328-81d33c8e54d0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:07.909662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:07.911751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:07.912289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:07.912925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] PATH_INFO: `/v3/projects/2ea371199b1c4e63b1dd4d0be21d6e67/users/762bc2365f994703be8b842c60459a01/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:07.965881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea371199b1c4e63b1dd4d0be21d6e67, user_id=762bc2365f994703be8b842c60459a01, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:07.969051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:08.004664 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3755/7457] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:20:07 2022] PUT /identity/v3/projects/2ea371199b1c4e63b1dd4d0be21d6e67/users/762bc2365f994703be8b842c60459a01/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:08.007867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:08.008192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:08.008475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:08.053371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] MFA Rules not processed for user `762bc2365f994703be8b842c60459a01`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:08.055235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:08.089814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:08.155482 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3703/7458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:08.164343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:08.166337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:08.246484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be97a-cefe-40c7-8497-8836df5c4d55 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:08.254907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:08.255951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:08.256319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:08.256742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:08.267411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:08.269074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:08.278781 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3756/7459] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:18.147916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=17 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:18.274419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:23.744339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:23.746368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:23.858681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a7513-2f76-478c-8d5d-a186779311db None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:23.865390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:23.865390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:23.865980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:23.866144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:23.868497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:23.885029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:23.886676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7f89-1c6c-4219-a236-7b4d5f9db330 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:23.901301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3704/7460] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:25.284074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:25.367758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3acac5-160c-415a-b00d-ceffc7ead158 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:25.372422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:25.373482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:25.373765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:25.374037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] PATH_INFO: `/v3/users/762bc2365f994703be8b842c60459a01` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:25.375315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762bc2365f994703be8b842c60459a01)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:25.377294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:25.440484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762bc2365f994703be8b842c60459a01'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:25.449709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762bc2365f994703be8b842c60459a01'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:25.450436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762bc2365f994703be8b842c60459a01'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:25.451048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762bc2365f994703be8b842c60459a01'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:25.464032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762bc2365f994703be8b842c60459a01'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:25.482967 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3757/7461] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:20:25 2022] DELETE /identity/v3/users/762bc2365f994703be8b842c60459a01 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:25.488101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:25.488974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:25.489571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:25.509402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:25.510967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:25.596947 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3705/7462] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:25.611395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:25.612867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:25.701299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ab80-f8f6-462a-8f4d-5069ffdb0387 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:25.706616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:25.707580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:25.707913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:25.708330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:25.721917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:25.724373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95a07d-85bb-4d4e-ae27-d00489fe4bdd service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:25.738121 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3758/7463] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:25.934211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:25.935727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:25.950774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747b784-6238-4bfc-9d04-53691d422750 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:25.956704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:25.957718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:25.957974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:25.958384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] PATH_INFO: `/v3/projects/2ea371199b1c4e63b1dd4d0be21d6e67` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:25.959807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea371199b1c4e63b1dd4d0be21d6e67)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:25.962567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.022913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea371199b1c4e63b1dd4d0be21d6e67', 'request_id': 'req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:26.029660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea371199b1c4e63b1dd4d0be21d6e67', 'request_id': 'req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:26.036148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea371199b1c4e63b1dd4d0be21d6e67', 'request_id': 'req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:26.052085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] The token cache is being invalidate because project 2ea371199b1c4e63b1dd4d0be21d6e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:20:26.052382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:26.053122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5441dbdb-3ba6-48cf-b022-8a2ab8e3afb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:26.055073 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3706/7464] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:20:25 2022] DELETE /identity/v3/projects/2ea371199b1c4e63b1dd4d0be21d6e67 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:26.060818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.061164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.061400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.083613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:26.085212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:26.109241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:26.185707 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3759/7465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:20:26.197460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.197835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.198152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.223151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:26.224435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:26.234030 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3707/7466] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:26.240793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.252315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae518-b297-4b3a-b1d5-8f43086dbd58 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.257681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.258359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.258827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.259107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.260520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:20:26.260875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.262753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.277864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3760/7467] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:20:26.282351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.292940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca550c1-da6c-42e1-a91a-8a27ac2d9949 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.298836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.299653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.299940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.300257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.300956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.303073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.307208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:26.340981 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3708/7468] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:20:26 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:20:26.342373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.356777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3b01-c230-4702-b057-0bfb192153d6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.448968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.449759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.450608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.450608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.451995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.454245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.478605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3761/7469] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:20:26 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:20:26.483490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.496461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7612b-2e3c-4f90-b523-50568a712094 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.503589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.504756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.505326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.505884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.506651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.508456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.521660 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3709/7470] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:20:26.526735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.539303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef80e0-be2c-4ffa-bd50-7103ab8c50eb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.546216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.547003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.547572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.547816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.548740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.550601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8fa0d-1d95-4159-ae88-f9a82325e625 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.567205 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3762/7471] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:20:26.576113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.595299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3309b3-8d2b-49ca-9288-36922cfb42df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.600424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.601334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.601616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.601896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] PATH_INFO: `/v3/projects/b153ebc3f6794d2a987ab41166012c5f/users/da910603f8914fee873ddfe7f44df1e6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.620234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b153ebc3f6794d2a987ab41166012c5f, user_id=da910603f8914fee873ddfe7f44df1e6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.623423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.639274 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3710/7472] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:20:26 2022] PUT /identity/v3/projects/b153ebc3f6794d2a987ab41166012c5f/users/da910603f8914fee873ddfe7f44df1e6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:26.650809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ca8e-e109-45c4-85d4-f970d0e04273 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.651082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ca8e-e109-45c4-85d4-f970d0e04273 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.651390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593ca8e-e109-45c4-85d4-f970d0e04273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.682394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7593ca8e-e109-45c4-85d4-f970d0e04273 None None] MFA Rules not processed for user `da910603f8914fee873ddfe7f44df1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:26.683788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7593ca8e-e109-45c4-85d4-f970d0e04273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:26.769573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3763/7473] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:26.778162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:26.780519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:26.851875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afc950-9dba-4312-89de-30bc874ca4e6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:26.857464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:26.858184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:26.858499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:26.858747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:26.867939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:26.869501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:26.878836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3711/7474] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:30.609503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:30.609974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:30.610549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:30.638024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:30.638024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:30.654049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:30.715066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3764/7475] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:30.768881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:30.770781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:30.865206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21234a8c-622d-40cb-9f29-b43da73db879 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:30.872023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:30.872604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:30.872604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:30.872949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:30.886758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:30.889077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:30.902712 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3712/7476] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:20:40.703785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=17 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:40.896867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:41.143689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:41.145622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:41.237940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568a775-7e3e-452c-a8a6-dd94ab7dd43d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:41.246433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:41.249434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:41.249434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:41.249434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:41.252169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:41.272271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:41.274399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6cc0b-1eab-4942-b789-6460ba961818 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:41.288740 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3765/7477] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:41.965085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.035319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b19a-7622-4e2b-a6cc-35ebc95abf2b service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.040238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.041129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.041415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.041696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] PATH_INFO: `/v3/users/da910603f8914fee873ddfe7f44df1e6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.042904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da910603f8914fee873ddfe7f44df1e6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.044926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.096323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da910603f8914fee873ddfe7f44df1e6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.096970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da910603f8914fee873ddfe7f44df1e6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.105034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da910603f8914fee873ddfe7f44df1e6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.105683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da910603f8914fee873ddfe7f44df1e6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.117484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da910603f8914fee873ddfe7f44df1e6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.132839 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3713/7478] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:20:41 2022] DELETE /identity/v3/users/da910603f8914fee873ddfe7f44df1e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:42.137437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.137860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.137963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.157990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:42.159205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:42.224298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3766/7479] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:42.231729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.233209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:42.295667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6530-7702-402d-b8ae-4180c47c9460 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.299747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.300403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.300683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.300959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.310751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.312241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2594d-89a2-4631-876d-6f53b4a11d13 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.322314 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3714/7480] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:42.549935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.551420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:42.565260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f74b4-11ce-403d-8536-206ef4b016de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.570865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.571942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.572220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.572497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] PATH_INFO: `/v3/projects/b153ebc3f6794d2a987ab41166012c5f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.573701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b153ebc3f6794d2a987ab41166012c5f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.575748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.623326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b153ebc3f6794d2a987ab41166012c5f', 'request_id': 'req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.629537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b153ebc3f6794d2a987ab41166012c5f', 'request_id': 'req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.635175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b153ebc3f6794d2a987ab41166012c5f', 'request_id': 'req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.649305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] The token cache is being invalidate because project b153ebc3f6794d2a987ab41166012c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:20:42.649646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.650340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d7bccfa5-c7b1-4d6d-9c99-d8717849f75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:20:42.652433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3767/7481] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:20:42 2022] DELETE /identity/v3/projects/b153ebc3f6794d2a987ab41166012c5f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:20:42.657420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.657714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.657996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.676331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:42.677549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:42.694877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:42.745845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3715/7482] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:20:42.753654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.753946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.754235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.774839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:42.776307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:42.785406 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3768/7483] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:42.790078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.800355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df366848-797d-43ee-be0f-c7a902c52a1a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.805634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.806832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.807125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.807402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.808181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:20:42.808484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.810098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.823221 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3716/7484] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:20:42.827139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.837033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f2cf2-a352-4c4b-938f-9005ba80bbc9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.842231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.842889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.843173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.843450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.844178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.846103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.849434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:42.879603 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3769/7485] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:20:42 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:20:42.883738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.894501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c44e2-f50a-49c1-bb9e-9dff8f6287b2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:42.951980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:42.952674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:42.952960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:42.953275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:42.953969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:42.955976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:42.978403 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3717/7486] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:20:42 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:20:42.983145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:42.994384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dedba0-b970-46ae-a6e2-8273035c22dc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:43.000161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:43.000829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:43.001119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:43.001395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:43.002135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:43.003790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:43.014938 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3770/7487] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:20:43.019455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:43.030189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbda70d-ae06-430a-a46e-4fd439b1e7eb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:43.036069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:43.036733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:43.037052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:43.037330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:43.038064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:43.040006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22c319-6332-477d-93a7-a0e18673d81f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:43.050203 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3718/7488] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:20:43.054616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:43.066210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b1371-b9f3-42ee-95fa-65b0cb66b117 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:43.072003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:43.072887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:43.073169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:43.073446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] PATH_INFO: `/v3/projects/aaed3659e32e41a3a4ca695e168dd764/users/39ac7a8a1fea4f9fa0199bf0f882d9c0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:43.089204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed3659e32e41a3a4ca695e168dd764, user_id=39ac7a8a1fea4f9fa0199bf0f882d9c0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:43.091906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:43.107094 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3771/7489] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:20:43 2022] PUT /identity/v3/projects/aaed3659e32e41a3a4ca695e168dd764/users/39ac7a8a1fea4f9fa0199bf0f882d9c0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:20:43.117390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909954ba-fa4b-46e4-adb9-8ad915c37495 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:43.117660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909954ba-fa4b-46e4-adb9-8ad915c37495 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:43.117959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909954ba-fa4b-46e4-adb9-8ad915c37495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:43.145654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-909954ba-fa4b-46e4-adb9-8ad915c37495 None None] MFA Rules not processed for user `39ac7a8a1fea4f9fa0199bf0f882d9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:43.146877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-909954ba-fa4b-46e4-adb9-8ad915c37495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:43.211185 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3719/7490] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:43.221469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:43.223418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:43.285756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc5896-45eb-4d11-a401-4785bcf6e81b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:43.290423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:43.291105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:43.291367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:43.291680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:43.301070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:43.302535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:43.312100 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3772/7491] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:20:47.787368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:47.787997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:47.787997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:47.811321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:20:47.814728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:47.844157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:47.896733 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3720/7492] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:20:47.910986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:47.912994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:47.995061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6c959-9e3b-42c4-aae9-42aa6aefac8b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:48.001370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:48.002083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:48.002373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:48.002659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:48.013719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:48.015618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:48.025047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3773/7493] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:20:57.888738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=17 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:58.021968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:58.795996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:20:58.797801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:58.887481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8ab7-c2ee-48d6-b06a-98cb5de25017 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:20:58.893229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:20:58.893838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:20:58.894099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:20:58.894374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:20:58.896211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:20:58.911206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:20:58.913164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aadff6f-bd10-4dcf-9f4e-1f58040b1384 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:20:58.927463 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3721/7494] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:00.835646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:00.837426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:00.868764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354d2e-667d-4044-baf0-002e16179df0 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:00.876082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:00.877012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:00.877447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:00.877901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:00.880529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:00.903250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:00.906184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:00.924957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3774/7495] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:21:08.920740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=32 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:10.913030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:10.954229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:10.954816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:10.954816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:10.974935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] MFA Rules not processed for user `6343f086d9584796aba71988b14570f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:10.976739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:11.059153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3722/7496] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:11.558027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:11.559679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:11.574686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e6651-6a97-40c4-a327-ce77a1e6089d service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:11.578648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:11.579317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:11.579645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:11.579930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:11.581870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:11.597862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:11.599675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb19f-5285-4076-8272-ee32023c7203 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:11.611103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3775/7497] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:12.119733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:12.231021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05d91-8117-4f3e-8cb3-0aa6a35c477e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:12.236476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:12.237593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.237880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.238332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] PATH_INFO: `/v3/users/39ac7a8a1fea4f9fa0199bf0f882d9c0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.240395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ac7a8a1fea4f9fa0199bf0f882d9c0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:12.242987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:12.293586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ac7a8a1fea4f9fa0199bf0f882d9c0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.294167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ac7a8a1fea4f9fa0199bf0f882d9c0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.301493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ac7a8a1fea4f9fa0199bf0f882d9c0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.301953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ac7a8a1fea4f9fa0199bf0f882d9c0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.315087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ac7a8a1fea4f9fa0199bf0f882d9c0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.328943 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3723/7498] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:12 2022] DELETE /identity/v3/users/39ac7a8a1fea4f9fa0199bf0f882d9c0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:12.333500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.334001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.334001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.352441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:12.353671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:12.425938 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3776/7499] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:12.436997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:12.438684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:12.469115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:12.505037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f958a-bb95-47c1-90a4-2e535e4c7ecb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:12.509030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:12.509802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.510213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.510473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.521417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:12.523153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5c36-0638-43d7-a090-477997f97ccf service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:12.533313 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3724/7500] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:12.713019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:12.714872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:12.727842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f32ee7-6172-4c1f-87de-6771b0f0ec80 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:12.733298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:12.734258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.734718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.735083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] PATH_INFO: `/v3/projects/aaed3659e32e41a3a4ca695e168dd764` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.736452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaed3659e32e41a3a4ca695e168dd764)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:12.738901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:12.789215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaed3659e32e41a3a4ca695e168dd764', 'request_id': 'req-8e3b986d-e8f0-4544-ac34-ef3554652adb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.795637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaed3659e32e41a3a4ca695e168dd764', 'request_id': 'req-8e3b986d-e8f0-4544-ac34-ef3554652adb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.802866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaed3659e32e41a3a4ca695e168dd764', 'request_id': 'req-8e3b986d-e8f0-4544-ac34-ef3554652adb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.817278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] The token cache is being invalidate because project aaed3659e32e41a3a4ca695e168dd764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:12.817497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.818121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8e3b986d-e8f0-4544-ac34-ef3554652adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:12.819775 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3777/7501] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:12 2022] DELETE /identity/v3/projects/aaed3659e32e41a3a4ca695e168dd764 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:12.824933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.825228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.825515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.845398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:12.846618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:12.913273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3725/7502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:12.921010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.921310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.921590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.940662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:12.941883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:12.950491 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3778/7503] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:12.954844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:12.966228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b1645-bd1f-4ff4-b4fc-499dc947394e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:12.971893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:12.972572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:12.972855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:12.973129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:12.973860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:12.974182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:12.975809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:12.988571 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3726/7504] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:12.993227 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.003632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb57506-0ea7-4ce8-9017-4b7c7c104eab None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.009574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.010245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.010533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.010806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.011498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.013479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.047044 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3779/7505] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:12 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:13.048935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.060079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a63d-291d-4da8-a49a-72f744e29402 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.124325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.125315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.125462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.125632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.126433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.128550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.152404 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3727/7506] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:13 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:13.156810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.168283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582c388-6756-4d6b-a34d-0ab3ca60e8ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.173371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.174052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.174342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.174625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.175363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.177016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.189716 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3780/7507] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:13.194701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.208046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630f6b-d4a8-4112-a584-83f32881cb74 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.213868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.214558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.214968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.215254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.216037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.217873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a04bd-d779-45f7-8a05-0fc53944110c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.233104 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3728/7508] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:13.237199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.255900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c2b6-11e8-490d-b68c-1b94867d70a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.262713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.263929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.267767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.268161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] PATH_INFO: `/v3/projects/e8f6c051f8f84034a8f8e98cd209488e/users/cc07de8013124cfbb98f6ddf3d9ffab1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.286358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f6c051f8f84034a8f8e98cd209488e, user_id=cc07de8013124cfbb98f6ddf3d9ffab1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.289763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.304707 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3781/7509] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:13 2022] PUT /identity/v3/projects/e8f6c051f8f84034a8f8e98cd209488e/users/cc07de8013124cfbb98f6ddf3d9ffab1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:13.315485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.315950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.316135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.344227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] MFA Rules not processed for user `cc07de8013124cfbb98f6ddf3d9ffab1`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:13.345519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:13.369428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:13.424524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3729/7510] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:13.434504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:13.436675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:13.447702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:13.499787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef69a2-0436-4a18-a464-787e705a6998 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:13.504057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:13.505858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:13.506151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:13.506437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:13.516223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:13.517698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:13.527017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3782/7511] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:22.113517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:22.114978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:22.224490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7649455-633d-4c68-9d55-da0ede6ea64e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:22.231283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:22.232232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:22.232742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:22.233160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:22.236581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:22.368309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:22.370029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:22.398238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3730/7512] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:23.523039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=23 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:30.636899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:30.648731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e86123-2d53-412f-bee8-ca7ea1c876db service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:30.652726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:30.653521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:30.653914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:30.654295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:30.656492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:30.741968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:30.743451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:30.754884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3783/7513] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:32.379583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=65 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:32.741883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:32.760668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f704f3-6d99-460f-b400-65f3fecb3c8c service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:32.766237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:32.766933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:32.767219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:32.767490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:32.769567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:32.873346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:32.875062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:32.891924 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3731/7514] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:35.547168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:35.549482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:35.577640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d625945-5033-4d4a-ac16-5e4549a2fb27 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:35.585859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:35.586854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:35.587210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:35.587585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] PATH_INFO: `/v3/users/bff665dac5de4530ab70f20ba2da386d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:35.589263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff665dac5de4530ab70f20ba2da386d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:35.592012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:35.677298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff665dac5de4530ab70f20ba2da386d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:35.686381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff665dac5de4530ab70f20ba2da386d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:35.687186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff665dac5de4530ab70f20ba2da386d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:35.687834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff665dac5de4530ab70f20ba2da386d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:35.702766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3e8ce828-0c10-4585-b98d-2da0bfb2c4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff665dac5de4530ab70f20ba2da386d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:35.718328 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3784/7515] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:35 2022] DELETE /identity/v3/users/bff665dac5de4530ab70f20ba2da386d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:35.914230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:35.931449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662633-6f04-4647-9f93-6d28a212fc71 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.035380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.036908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.037429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.037807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] PATH_INFO: `/v3/projects/d7752a37a5984bc99d2acfcc327fc14e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.039192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7752a37a5984bc99d2acfcc327fc14e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.041438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.139107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7752a37a5984bc99d2acfcc327fc14e', 'request_id': 'req-b35e694b-7f1f-4394-b719-2c5b17e57bab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:36.153041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7752a37a5984bc99d2acfcc327fc14e', 'request_id': 'req-b35e694b-7f1f-4394-b719-2c5b17e57bab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:36.171103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7752a37a5984bc99d2acfcc327fc14e', 'request_id': 'req-b35e694b-7f1f-4394-b719-2c5b17e57bab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:36.222966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] The token cache is being invalidate because project d7752a37a5984bc99d2acfcc327fc14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:36.223261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:36.224137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b35e694b-7f1f-4394-b719-2c5b17e57bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:36.232715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3732/7516] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:35 2022] DELETE /identity/v3/projects/d7752a37a5984bc99d2acfcc327fc14e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:36.234347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.234639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.234921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.270289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:36.271821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:36.373550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.374155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.374625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.377975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3785/7517] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:36.398022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:36.400048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:36.410487 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3733/7518] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:36.415101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.425706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bc376-3cb3-49e6-a0ef-4b14721b0d78 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.432112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.434267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.434267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.434267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.434582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:36.435128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.436970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.438822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:36.456122 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3786/7519] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:36.457487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.468123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039708f-2c90-4f21-869d-ef0a538027fd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.473857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.474793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.475082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.475419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.476233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.478274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.502354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:36.513970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3734/7520] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:36 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:36.515713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.526409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdded4-38c1-4d40-b62d-bd1e9897e5ce admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.600140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.601087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.602594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.602594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.602594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.605089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.640827 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3787/7521] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:36 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:36.642180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.654063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7bae6-595e-45c7-a958-436a6bd0eb99 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.660972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.662054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.662436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.662785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.664035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.665804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.678229 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3735/7522] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:36.683050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.693967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f486-f2d9-48e6-b055-6cb4fecfec79 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.702063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.703085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.703085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.703424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.704390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.706096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b500da-7a40-4310-a0d2-f22256d7ab7f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.717725 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3788/7523] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:36.722785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:36.737865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb8ab7-f2c2-4247-a077-f6a04808a682 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:36.749343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:36.750275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.750742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.751023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] PATH_INFO: `/v3/projects/6b053f7e1156469292107896abbb12c1/users/ff3fef25e666454595f7fe721669a956/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.770010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b053f7e1156469292107896abbb12c1, user_id=ff3fef25e666454595f7fe721669a956, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:36.772806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:36.804569 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3736/7524] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:36 2022] PUT /identity/v3/projects/6b053f7e1156469292107896abbb12c1/users/ff3fef25e666454595f7fe721669a956/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:36.814922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:36.817329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:36.817446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:36.851814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] MFA Rules not processed for user `ff3fef25e666454595f7fe721669a956`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:36.853515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:37.003211 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3789/7525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:37.004532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.106137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca847e-102b-4042-85b7-6eb01d08b24e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.110849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.111791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.112103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.112399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.113084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.115136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.152010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3737/7526] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:37 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:37.153856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.168708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08583-6112-4428-8e3f-c5a02e542f7b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.262392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.263112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.263398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.263982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.264825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.267283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.276708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:37.308683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3790/7527] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:37 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:37.312389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.325431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522019b-b8bf-4c98-be39-9363071dbd60 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.333462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.334568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.335688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.336132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.337984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.339873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.367884 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3738/7528] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:37.372497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.388011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20787aa9-79ed-4ef2-9c8d-fe1a098ec3aa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.393580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.394616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.394960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.395297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] PATH_INFO: `/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b/users/8d31a221810b47f4af6f6828fe34d6b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.419216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b63a5e364c4b1ebfdaac3b2fa7106b, user_id=8d31a221810b47f4af6f6828fe34d6b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.422646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.442385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3791/7529] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:37 2022] PUT /identity/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b/users/8d31a221810b47f4af6f6828fe34d6b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:37.444962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.456961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b166a-3afe-4645-b8da-c4975cc3b112 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.524457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.525154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.525447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.525747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.526468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.528137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e53063-4e0e-4d39-bf4b-37bdddb26160 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.539332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3739/7530] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:37.543422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.564312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471025dc-7ba9-42eb-9e60-0aa8d3d8e867 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.586194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.587475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.588017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.588309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] PATH_INFO: `/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b/users/8d31a221810b47f4af6f6828fe34d6b9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.590749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b63a5e364c4b1ebfdaac3b2fa7106b, user_id=8d31a221810b47f4af6f6828fe34d6b9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.593527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.617781 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3792/7531] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:37 2022] PUT /identity/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b/users/8d31a221810b47f4af6f6828fe34d6b9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:37.621913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.622437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.622862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.666387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] MFA Rules not processed for user `8d31a221810b47f4af6f6828fe34d6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:37.667659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:37.699804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:37.760978 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3740/7532] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:37.761898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.781905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623458c4-6c26-49a3-ade6-d4259bc713b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.798742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.801212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.801212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.801212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects/6b053f7e1156469292107896abbb12c1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.801811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:get_project(project_id=6b053f7e1156469292107896abbb12c1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.810101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.815160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3793/7533] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:21:37 2022] GET /identity/v3/projects/6b053f7e1156469292107896abbb12c1 => generated 389 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:37.816435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.826792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90df7f-43d3-497e-8cf1-6b107194727f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:37.838843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:37.839145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:37.839650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:37.839932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:37.840645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:37.842715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:37.892271 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3741/7534] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:21:37 2022] POST /identity/v3/projects => generated 339 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:37.896554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:37.911084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca607-f1b8-41dd-85a1-4d8e6451f3cd tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.003421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.004132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.004814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.004814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.005449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.007795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.035809 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3794/7535] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:21:37 2022] GET /identity/v3/projects => generated 5463 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:38.040378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.051736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696ed4-2cd3-4752-b34c-1ff1a22a6403 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.057497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.058498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.058843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.059241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects/6b053f7e1156469292107896abbb12c1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.060735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:get_project(project_id=6b053f7e1156469292107896abbb12c1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.063189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.065265 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3742/7536] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects/6b053f7e1156469292107896abbb12c1 => generated 389 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:38.069488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.083351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea38d-aec4-41bf-8f8e-77748f8457fe tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.089947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.091324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.091324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.091643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects/054e68a9fd5e4bdfa8fe2b0b739656ae` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.092782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:get_project(project_id=054e68a9fd5e4bdfa8fe2b0b739656ae)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.095296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.096855 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3795/7537] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects/054e68a9fd5e4bdfa8fe2b0b739656ae => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:38.102548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.113386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3493d-42cd-4260-9784-79c9252568f9 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.118450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.119139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.119426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.119751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.120489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.122642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.145937 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3743/7538] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects => generated 5463 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:38.148607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.176952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7102a9-9245-4eaf-97a0-fd342fedddeb tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.188265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.188874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.189162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.189445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.190949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:38.191263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.193390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.221260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3796/7539] 10.222.0.18 () {58 vars in 1165 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects?domain_id=default => generated 5132 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:38.225175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.244249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed61df-5782-4b4a-b970-e1b3fe628b87 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.249560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.250242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.250527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.250807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.251571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.253793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.277702 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3744/7540] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects => generated 5463 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:38.279238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.290715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994ca1-8ccb-4af3-a0ab-da3f73a62ac3 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.295966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.297388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.297388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.297388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.297968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:38.298277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.300208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.334553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3797/7541] 10.222.0.18 () {58 vars in 1165 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects?domain_id=default => generated 5132 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:38.337422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.351295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd6c1b-2005-4b23-a59e-ae638af3e87b tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.357668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.364588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.364863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.365130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.365918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.369065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.403946 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3745/7542] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects => generated 5463 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:38.408883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.422440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df54a7-e8a3-4886-bb1f-c99e9086aee7 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.428941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.429774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.430123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.430391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.431150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1045676596) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:38.431459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.433380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.448608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3798/7543] 10.222.0.18 () {58 vars in 1231 bytes} [Sat Jun 4 21:21:38 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1045676596 => generated 537 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:38.454368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.466520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d63b0-12d5-4406-8d63-8d881566092d tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.472379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d31a221810b47f4af6f6828fe34d6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.473311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.473817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.474109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] PATH_INFO: `/v3/projects/054e68a9fd5e4bdfa8fe2b0b739656ae` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.477910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=054e68a9fd5e4bdfa8fe2b0b739656ae)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.479759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.546156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054e68a9fd5e4bdfa8fe2b0b739656ae', 'request_id': 'req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.554632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054e68a9fd5e4bdfa8fe2b0b739656ae', 'request_id': 'req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.562069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054e68a9fd5e4bdfa8fe2b0b739656ae', 'request_id': 'req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.582631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] The token cache is being invalidate because project 054e68a9fd5e4bdfa8fe2b0b739656ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:38.583137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.584118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1fc3b44-0ab1-4953-892d-e7c63bfbae1a tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.586852 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3746/7544] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:38 2022] DELETE /identity/v3/projects/054e68a9fd5e4bdfa8fe2b0b739656ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:38.591001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:38.593753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:38.709045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35c1c-5ffe-44a9-834e-5a880221ad96 tempest-ListProjectsStaticTestJSON-969680429 tempest-ListProjectsStaticTestJSON-969680429-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:38.716928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:38.804953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:38.806030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.806326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.807597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] PATH_INFO: `/v3/users/ff3fef25e666454595f7fe721669a956` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:38.809430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3fef25e666454595f7fe721669a956)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:38.812842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:38.905501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3fef25e666454595f7fe721669a956'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.917689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3fef25e666454595f7fe721669a956'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.918598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3fef25e666454595f7fe721669a956'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.919240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3fef25e666454595f7fe721669a956'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.962854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3fef25e666454595f7fe721669a956'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:38.987552 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3799/7545] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:38 2022] DELETE /identity/v3/users/ff3fef25e666454595f7fe721669a956 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:38.991825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:38.992122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:38.992408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:39.014427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:39.015062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:39.064842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:39.102738 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3747/7546] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:39.115473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:39.118918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:39.187689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba6064-5f47-4eaf-a34a-7e7ba1659efd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:39.192633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:39.193318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:39.193606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:39.193887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:39.204150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:39.205673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:39.216157 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3800/7547] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:39.735062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:39.739048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:39.752782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee5f1a-61e5-4d77-b62b-c1039163c167 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:39.768930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:39.770018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:39.770301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:39.770582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] PATH_INFO: `/v3/projects/6b053f7e1156469292107896abbb12c1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:39.771882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b053f7e1156469292107896abbb12c1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:39.774291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:39.849282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b053f7e1156469292107896abbb12c1', 'request_id': 'req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:39.856905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b053f7e1156469292107896abbb12c1', 'request_id': 'req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:39.864601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b053f7e1156469292107896abbb12c1', 'request_id': 'req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:39.884166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] The token cache is being invalidate because project 6b053f7e1156469292107896abbb12c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:39.884486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:39.885268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:39.887207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3748/7548] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:39 2022] DELETE /identity/v3/projects/6b053f7e1156469292107896abbb12c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:39.891485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:39.903275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987401d0-1bda-4682-8723-10e056cbf73c service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:39.935799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:39.981630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:39.982565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:39.982915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:39.983259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] PATH_INFO: `/v3/users/8d31a221810b47f4af6f6828fe34d6b9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:39.988945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31a221810b47f4af6f6828fe34d6b9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:39.990992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:40.068550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31a221810b47f4af6f6828fe34d6b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.081746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31a221810b47f4af6f6828fe34d6b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.082582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31a221810b47f4af6f6828fe34d6b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.083267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31a221810b47f4af6f6828fe34d6b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.096770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7914bb3f-9a59-43b0-9aae-e9ccc4d9aacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31a221810b47f4af6f6828fe34d6b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.120987 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3801/7549] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:39 2022] DELETE /identity/v3/users/8d31a221810b47f4af6f6828fe34d6b9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:40.590689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:40.592315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:40.615419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8a372-b1ab-44f3-ae6b-7025a6ed7313 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:40.698900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:40.700697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:40.700697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:40.700910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] PATH_INFO: `/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:40.702543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b63a5e364c4b1ebfdaac3b2fa7106b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:40.705200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:40.768241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'request_id': 'req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.775897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'request_id': 'req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.786093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b63a5e364c4b1ebfdaac3b2fa7106b', 'request_id': 'req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.788935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:40.808495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] The token cache is being invalidate because project 91b63a5e364c4b1ebfdaac3b2fa7106b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:40.808808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.809992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cb3dc7f6-43ad-4734-85f9-b2e4a38a3da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:40.815547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3749/7550] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:40 2022] DELETE /identity/v3/projects/91b63a5e364c4b1ebfdaac3b2fa7106b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:40.819205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:40.819801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:40.820360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:40.842801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:40.844062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:40.935307 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3802/7551] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:40.942839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:40.943133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:40.943410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:40.967049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:40.968658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:40.980115 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3750/7552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:40.984646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:40.996462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0842e-a32c-4f0e-b7b3-37d1e9276170 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.002710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.003869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.004313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.004755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.005646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:41.006094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.008220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.024990 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3803/7553] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:21:41.029487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.047340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4304b-d0ec-440a-9457-7a56066c4cab None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.056152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.056849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.057923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.057923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.058125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.060180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.094144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3751/7554] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:41 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:41.095374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.110014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b3bb-c2e7-4cd9-9a9c-ef8fe907ccb7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.152852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:41.185105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.185887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.186245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.186594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.187361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.189470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.214720 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3804/7555] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:41 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:41.219100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.231404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4f03-96c4-431a-97d3-f1ec4a826c60 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.237365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.238577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.238577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.238786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.239758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.242016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.256000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3752/7556] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:41.257461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.269073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f47c5d-f30f-438a-9df4-05ba75af0f82 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.274912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.275648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.275941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.277176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.278449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.280752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba62b-2c1f-430b-a5b7-8c5a95d18b74 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.299124 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3805/7557] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:41.303245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.314631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240d306-549d-41c4-8a43-b28e3077ca83 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.320455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.321386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.322228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.322228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] PATH_INFO: `/v3/projects/c52f44a63abe459fa0b2be5c2f2485f6/users/5b3b65fc88904cebb714ec24f5a56d63/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.367764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52f44a63abe459fa0b2be5c2f2485f6, user_id=5b3b65fc88904cebb714ec24f5a56d63, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.375992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.400328 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3753/7558] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:41 2022] PUT /identity/v3/projects/c52f44a63abe459fa0b2be5c2f2485f6/users/5b3b65fc88904cebb714ec24f5a56d63/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:41.410910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.411216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.411500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.441777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] MFA Rules not processed for user `5b3b65fc88904cebb714ec24f5a56d63`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:41.443120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:41.538007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3806/7559] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:41.542545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.614712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d538-ea08-440a-b518-88fff1c94f55 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.621305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.622149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.622437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.622722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.623625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.625841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.683989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3754/7560] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:41 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:41.687329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.703275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a6bee-1378-438c-8979-907da6567821 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.823412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.824277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.824563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.824840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.825535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.827473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.852495 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3807/7561] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:41 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:41.856827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.868959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1642-f5a9-4bf9-8edc-0dd95347c2d8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.875244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.876229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.876692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.876849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.878874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.880795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.895582 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3755/7562] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:41.899173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.915646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b726c1-ec7d-4187-8a78-a2118daa4c05 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:41.924948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:41.925827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:41.926154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:41.926466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] PATH_INFO: `/v3/projects/f97353952d9a41a98e6829f89bb96b1c/users/b57c544cfc764ff9a48924c4b0acf689/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:41.954957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97353952d9a41a98e6829f89bb96b1c, user_id=b57c544cfc764ff9a48924c4b0acf689, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:41.957710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:41.978767 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3808/7563] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:41 2022] PUT /identity/v3/projects/f97353952d9a41a98e6829f89bb96b1c/users/b57c544cfc764ff9a48924c4b0acf689/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:41.983096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:41.995110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d8305-c7af-4586-901d-480aa4977515 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.073602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.074656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.075147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.075671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.076613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.078435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c49933-1485-4b12-991d-a7c9a5b11935 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.081764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:42.093814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3756/7564] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:42.099096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.114991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2ac7c-644b-4b71-832b-1496a86302de admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.122196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.123007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.123340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.123637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] PATH_INFO: `/v3/projects/f97353952d9a41a98e6829f89bb96b1c/users/b57c544cfc764ff9a48924c4b0acf689/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.125746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97353952d9a41a98e6829f89bb96b1c, user_id=b57c544cfc764ff9a48924c4b0acf689, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.128520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.132363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:42.144022 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3809/7565] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:42 2022] PUT /identity/v3/projects/f97353952d9a41a98e6829f89bb96b1c/users/b57c544cfc764ff9a48924c4b0acf689/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:42.155565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.156114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.156630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.188483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] MFA Rules not processed for user `b57c544cfc764ff9a48924c4b0acf689`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:42.190726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:42.299192 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3757/7566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:42.305699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.335953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90642-297a-4317-890a-60f8a50a1995 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.341881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.342660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.343019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.343374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.344381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.348833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.381087 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3810/7567] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:21:42 2022] POST /identity/v3/domains => generated 276 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:42.385831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.402581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd342c-2329-49ae-97ca-74df6a0e2082 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.520196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.520945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.521268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.521559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.523450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.527158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.579279 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3758/7568] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:42 2022] POST /identity/v3/users => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:42.580587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.592987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6bd52-c0d2-46aa-b474-cbc2fe332e41 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.599064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.599777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.600051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.600395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.601109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.603414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.637385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3811/7569] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:42 2022] POST /identity/v3/users => generated 324 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:42.642964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.653575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1adb5-5a8c-48cc-b7c2-d59781e51c2c tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.658810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.659771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.660039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.660320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users/604c61851a3f4826b6d5fa23b775af0d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.676683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:get_user(user_id=604c61851a3f4826b6d5fa23b775af0d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.678902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.684847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3759/7570] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:21:42 2022] GET /identity/v3/users/604c61851a3f4826b6d5fa23b775af0d => generated 347 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:42.686362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.697430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1128c1-2102-49ba-8303-021ab3298853 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.702198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.703012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.703289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.703582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.704440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Adding query filter params (domain_id=86762cd03e3849a8aeae97c79f2adc64) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:42.704741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.706834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.719731 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3812/7571] 10.222.0.18 () {58 vars in 1206 bytes} [Sat Jun 4 21:21:42 2022] GET /identity/v3/users?domain_id=86762cd03e3849a8aeae97c79f2adc64 => generated 484 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:42.724915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.735341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344ac59-851a-4eeb-acce-6cea3aad5f61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.740006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.740750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.741085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.741547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.742436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.744293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.774441 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3760/7572] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:42 2022] GET /identity/v3/users => generated 7734 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:42.779712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.791306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0040ff2-0f22-4b6a-9afd-0e54d2ff1aed tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.797374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.798038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.798992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.799286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.800131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Adding query filter params (name=tempest-test_user-493488627) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:42.800436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.803243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.850213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3813/7573] 10.222.0.18 () {58 vars in 1186 bytes} [Sat Jun 4 21:21:42 2022] GET /identity/v3/users?name=tempest-test_user-493488627 => generated 474 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:42.855006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.868191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5a12-6cc9-4384-b3ea-cc3323320a5a tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.875424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.876400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.876754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.877137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.878148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:42.878527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.880513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:42.907419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3761/7574] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:21:42 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:42.908918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:42.920183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39d0ca-f83d-4add-8f6f-e7dc18a3aca0 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:42.926260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:42.940012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:42.940123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:42.940332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users/f1c5115aac484f87a669765d46527418` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:42.970970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f1c5115aac484f87a669765d46527418)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:42.975253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:43.052802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c5115aac484f87a669765d46527418'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.064113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c5115aac484f87a669765d46527418'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.065304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c5115aac484f87a669765d46527418'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.066209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c5115aac484f87a669765d46527418'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.081820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c5115aac484f87a669765d46527418'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.101708 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3814/7575] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:42 2022] DELETE /identity/v3/users/f1c5115aac484f87a669765d46527418 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:43.105537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:43.108337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:43.123639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaebe29-bcc2-45e5-a55f-3311b22aa947 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:43.155489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:43.213087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:43.213905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:43.214265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:43.214652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/users/604c61851a3f4826b6d5fa23b775af0d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:43.215981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:delete_user(user_id=604c61851a3f4826b6d5fa23b775af0d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:43.218079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:43.270874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604c61851a3f4826b6d5fa23b775af0d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.271715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604c61851a3f4826b6d5fa23b775af0d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.289007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604c61851a3f4826b6d5fa23b775af0d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.289901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604c61851a3f4826b6d5fa23b775af0d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.305215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604c61851a3f4826b6d5fa23b775af0d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.323201 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3762/7576] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:43 2022] DELETE /identity/v3/users/604c61851a3f4826b6d5fa23b775af0d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:43.327171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:43.349325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead01af-91e4-45de-b578-a0053660f837 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:43.419088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:43.420181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:43.420460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:43.420754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/domains/86762cd03e3849a8aeae97c79f2adc64` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:43.422080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=86762cd03e3849a8aeae97c79f2adc64)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:43.423812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:43.426407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:43.451186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.452335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.480895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.481586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.487022 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3815/7577] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:21:43 2022] PATCH /identity/v3/domains/86762cd03e3849a8aeae97c79f2adc64 => generated 277 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:21:43.488310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:43.490565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:43.504464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1c74-7189-49e7-b64e-0aa967a38a35 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:43.594679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57c544cfc764ff9a48924c4b0acf689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97353952d9a41a98e6829f89bb96b1c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:43.595776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:43.596127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:43.596468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] PATH_INFO: `/v3/domains/86762cd03e3849a8aeae97c79f2adc64` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:43.610267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=86762cd03e3849a8aeae97c79f2adc64)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:43.612089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:43.639653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.643949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.681856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:43.772147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.782631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.793133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.832575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] The token cache is being invalidate because project 86762cd03e3849a8aeae97c79f2adc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:43.833646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.834441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.844756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.848271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.849869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-60e439e9-a1c4-43c4-a99f-96ad173debd4 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '86762cd03e3849a8aeae97c79f2adc64', 'request_id': 'req-60e439e9-a1c4-43c4-a99f-96ad173debd4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:43.862650 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3763/7578] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:21:43 2022] DELETE /identity/v3/domains/86762cd03e3849a8aeae97c79f2adc64 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:43.866673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:43.868816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:43.983701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a41fe-bc2b-46a8-abe5-050df8891a61 tempest-UsersV3TestJSON-999816692 tempest-UsersV3TestJSON-999816692-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:44.083239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:44.084607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:44.084944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:44.085226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] PATH_INFO: `/v3/users/5b3b65fc88904cebb714ec24f5a56d63` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:44.087203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3b65fc88904cebb714ec24f5a56d63)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:44.089551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:44.208750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3b65fc88904cebb714ec24f5a56d63'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:44.222847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3b65fc88904cebb714ec24f5a56d63'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:44.223628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3b65fc88904cebb714ec24f5a56d63'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:44.224255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3b65fc88904cebb714ec24f5a56d63'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:44.250113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3b65fc88904cebb714ec24f5a56d63'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:44.252027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:44.278537 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3816/7579] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:43 2022] DELETE /identity/v3/users/5b3b65fc88904cebb714ec24f5a56d63 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:44.282870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:44.283167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:44.283455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:44.304621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:44.306156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:44.405942 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3764/7580] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:44.422853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:44.424536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:44.539303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c610-3157-41a2-a3c7-5277a6a43049 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:44.544283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:44.545547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:44.545547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:44.545746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:44.558301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:44.559829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:44.572712 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3817/7581] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:44.948913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:44.950501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:44.981227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1c9a-272c-4095-9243-9f221778314a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:44.987450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:44.988465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:44.988899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:44.989395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] PATH_INFO: `/v3/projects/c52f44a63abe459fa0b2be5c2f2485f6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:44.990772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52f44a63abe459fa0b2be5c2f2485f6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:44.993747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:45.081941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52f44a63abe459fa0b2be5c2f2485f6', 'request_id': 'req-b689759c-b687-47c6-ac91-818f7dadc1ae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.088918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52f44a63abe459fa0b2be5c2f2485f6', 'request_id': 'req-b689759c-b687-47c6-ac91-818f7dadc1ae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.095676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52f44a63abe459fa0b2be5c2f2485f6', 'request_id': 'req-b689759c-b687-47c6-ac91-818f7dadc1ae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.115616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] The token cache is being invalidate because project c52f44a63abe459fa0b2be5c2f2485f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:45.116263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.116897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.118525 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3765/7582] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:44 2022] DELETE /identity/v3/projects/c52f44a63abe459fa0b2be5c2f2485f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:45.122695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:45.133626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf29aa-cea1-4099-8932-5165633df537 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:45.206936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:45.207862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:45.208142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:45.208423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] PATH_INFO: `/v3/users/b57c544cfc764ff9a48924c4b0acf689` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:45.210330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57c544cfc764ff9a48924c4b0acf689)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:45.213349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:45.278414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57c544cfc764ff9a48924c4b0acf689'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.292820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57c544cfc764ff9a48924c4b0acf689'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.293575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57c544cfc764ff9a48924c4b0acf689'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.294207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57c544cfc764ff9a48924c4b0acf689'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.314776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a427b411-e9da-40b0-b67d-c2da96e1d3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57c544cfc764ff9a48924c4b0acf689'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.337459 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3818/7583] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:45 2022] DELETE /identity/v3/users/b57c544cfc764ff9a48924c4b0acf689 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:45.709261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:45.711095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:45.728364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689759c-b687-47c6-ac91-818f7dadc1ae admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:45.733168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:45.811064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:45.812114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:45.812322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:45.812780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] PATH_INFO: `/v3/projects/f97353952d9a41a98e6829f89bb96b1c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:45.814277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97353952d9a41a98e6829f89bb96b1c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:45.815952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:45.892302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97353952d9a41a98e6829f89bb96b1c', 'request_id': 'req-53123541-d58b-43cb-b373-8283020ec710'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.904735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97353952d9a41a98e6829f89bb96b1c', 'request_id': 'req-53123541-d58b-43cb-b373-8283020ec710'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.911232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97353952d9a41a98e6829f89bb96b1c', 'request_id': 'req-53123541-d58b-43cb-b373-8283020ec710'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.927728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] The token cache is being invalidate because project f97353952d9a41a98e6829f89bb96b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:45.928038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.929464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-53123541-d58b-43cb-b373-8283020ec710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:45.934833 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3766/7584] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:45 2022] DELETE /identity/v3/projects/f97353952d9a41a98e6829f89bb96b1c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:45.939539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:45.939845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:45.940184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:45.968619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:45.969899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:45.980149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:46.042451 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3819/7585] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:46.050755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.051222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.051429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.072151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:46.073793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:46.082744 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3767/7586] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:46.087352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.097850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98942db-a402-4338-98ac-d6005499dc32 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.102751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.103429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.103750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.104023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.104752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:46.105055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.106791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.121983 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3820/7587] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:46.126213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.139939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc6ca-7877-46c2-bc03-1c9c53c217f0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.152788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.153882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.153882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.154122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.154830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.158947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.188312 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3768/7588] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:46.192553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.204495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb47bc-f718-4a0f-b761-03c3bfdd90a1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.273087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.274066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.274356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.274691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.275496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.277508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.302263 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3821/7589] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:46.303767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.315089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062e914-bfb7-4b90-ae90-b41bce46d60e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.320397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.321093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.321382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.321661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.322405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.324809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.338798 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3769/7590] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:46.340347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.352630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946193d3-1c6c-4b6a-9831-971ca351b281 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.357369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.362148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.362148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.362148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.362148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.362148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a75e-b4ca-4349-b8aa-0b3d7066c771 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.372950 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3822/7591] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:46.377889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.395452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7df50-4a8d-4b8b-9ca5-72b001b7cc9a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.401517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.402476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.402966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.403215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] PATH_INFO: `/v3/projects/0eec3d13b876482e82978aeee9ff9b35/users/772d87e83edf4cd7bafb133e3049859e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.427749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eec3d13b876482e82978aeee9ff9b35, user_id=772d87e83edf4cd7bafb133e3049859e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.431077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.455225 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3770/7592] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:46 2022] PUT /identity/v3/projects/0eec3d13b876482e82978aeee9ff9b35/users/772d87e83edf4cd7bafb133e3049859e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:46.468090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.468492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.468824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.504676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] MFA Rules not processed for user `772d87e83edf4cd7bafb133e3049859e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:46.506027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:46.628960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3823/7593] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:46.634234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.680049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:46.722840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd585-f57f-4207-83aa-c8042c098d4e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.737026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.737963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.738327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.738607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.739315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.742188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.788935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3771/7594] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:46.795024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:46.825508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccc45a-4627-4e40-90fc-8d09bc61d203 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:46.841540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:46.953884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:46.955285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:46.955813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:46.956397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:46.957880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:46.961878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:46.996290 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3824/7595] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:46 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:46.999146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.021634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43ac2c-5c53-4781-b58a-cc3409b9d51c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.031667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.032846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.033354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.033918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.034820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.036837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.062713 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3772/7596] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:47.066601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.082261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87db10-2db2-4922-8fc5-8ed76b5e9395 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.090041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.091242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.091906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.092539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] PATH_INFO: `/v3/projects/6282dc6a093549ccbcb32dcf366b73da/users/6870209213aa4adcaea4337793dc5341/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.112913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6282dc6a093549ccbcb32dcf366b73da, user_id=6870209213aa4adcaea4337793dc5341, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.116529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.145433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3825/7597] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:47 2022] PUT /identity/v3/projects/6282dc6a093549ccbcb32dcf366b73da/users/6870209213aa4adcaea4337793dc5341/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:47.147085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.160643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ff76-eb46-43d5-9d7a-4b6f45df2a97 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.245548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.246239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.246679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.246955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.248874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.252750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5cb64-0f17-4737-853d-883bc6a341d8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.269683 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3773/7598] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:47.269990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.288632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2cfdf-c7b2-4fd6-8018-06b37f304561 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.294461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.295637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.295992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.305215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] PATH_INFO: `/v3/projects/6282dc6a093549ccbcb32dcf366b73da/users/6870209213aa4adcaea4337793dc5341/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.308716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6282dc6a093549ccbcb32dcf366b73da, user_id=6870209213aa4adcaea4337793dc5341, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.322296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.336006 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3826/7599] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:47 2022] PUT /identity/v3/projects/6282dc6a093549ccbcb32dcf366b73da/users/6870209213aa4adcaea4337793dc5341/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:47.432324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.432618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.432897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.469643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] MFA Rules not processed for user `6870209213aa4adcaea4337793dc5341`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:47.470939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:47.583061 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3774/7600] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:47.589469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.601442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065d91-50ba-459a-a2d3-0550d74541e3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.606218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.606957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.607244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.607604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.608289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.612851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.661210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3827/7601] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:47 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:47.665520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.683332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb485e45-7c37-495c-bfbd-84ce6d8ad91d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.724838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:47.779479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.780436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.780725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.781008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-819064486` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.782505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=094bc5ab1b8643e1a7596d20f81640e1, value=tempest-tag-819064486)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.784907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.852264 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-819064486. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:21:47.852264 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:21:47.852264 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:21:47.861096 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3775/7602] 10.222.0.18 () {60 vars in 1329 bytes} [Sat Jun 4 21:21:47 2022] PUT /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-819064486 => generated 0 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jun 04 21:21:47.865270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.885241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71e4a-66fe-4ed8-a3cc-e8dbd9a08780 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.890063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.891321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.891646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.891927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-819064486` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.905627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=094bc5ab1b8643e1a7596d20f81640e1, value=tempest-tag-819064486)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.907970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:47.920940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3828/7603] 10.222.0.18 () {58 vars in 1310 bytes} [Sat Jun 4 21:21:47 2022] GET /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-819064486 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:47.925241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:47.937142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc8645-5c35-42ad-a29a-483f433b0bb5 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:47.942301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:47.943234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:47.943550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:47.943957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:47.946281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=094bc5ab1b8643e1a7596d20f81640e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:47.952717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.014085 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3776/7604] 10.222.0.18 () {60 vars in 1264 bytes} [Sat Jun 4 21:21:47 2022] PUT /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags => generated 141 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:48.018467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.030310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651efb7-0329-4aaa-9884-0905a5004404 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.037354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.039029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.039420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.040075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.058879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=094bc5ab1b8643e1a7596d20f81640e1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.061143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.075572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3829/7605] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:21:48 2022] GET /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags => generated 141 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:48.079597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.091088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8884-25f8-4940-9763-e6b752fa5b0f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.096346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.097264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.097544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.097859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-1563332889` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.099065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=094bc5ab1b8643e1a7596d20f81640e1, value=tempest-tag-1563332889)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.101583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.176402 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1563332889. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:21:48.176402 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:21:48.176402 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:21:48.185540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3777/7606] 10.222.0.18 () {58 vars in 1316 bytes} [Sat Jun 4 21:21:48 2022] DELETE /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-1563332889 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:48.188727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.220416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f464f45-fa5a-483d-93af-2185e4dbd248 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.231398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.232659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.233211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.233573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-1563332889` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.251662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=094bc5ab1b8643e1a7596d20f81640e1, value=tempest-tag-1563332889)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.254044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Could not find project tag: tempest-tag-1563332889.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1563332889. Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jun 04 21:21:48.291805 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1563332889. Jun 04 21:21:48.293408 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:48.294385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3830/7607] 10.222.0.18 () {58 vars in 1313 bytes} [Sat Jun 4 21:21:48 2022] GET /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags/tempest-tag-1563332889 => generated 107 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:21:48.299406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.323988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718366fd-202e-4354-835e-b921f19e19ca tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.334099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.336381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.336685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.336972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.338846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=094bc5ab1b8643e1a7596d20f81640e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.341355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.430351 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3778/7608] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:21:48 2022] DELETE /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:48.434885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.450766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a89f-c9a3-4f0f-872b-bb889f0c4da9 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.456929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.457813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.458083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.458562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.474362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=094bc5ab1b8643e1a7596d20f81640e1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.477938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.496336 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3831/7609] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:21:48 2022] GET /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1/tags => generated 66 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 04 21:21:48.500801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.516423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3249f-940b-48a1-9339-360078c29ef8 tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:48.524326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6870209213aa4adcaea4337793dc5341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6282dc6a093549ccbcb32dcf366b73da', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:48.525228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:48.525513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:48.525835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] PATH_INFO: `/v3/projects/094bc5ab1b8643e1a7596d20f81640e1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:48.527114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorizing `identity:delete_project(project_id=094bc5ab1b8643e1a7596d20f81640e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:48.530581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:48.590050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:48.630529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094bc5ab1b8643e1a7596d20f81640e1', 'request_id': 'req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:48.638666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094bc5ab1b8643e1a7596d20f81640e1', 'request_id': 'req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:48.646313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094bc5ab1b8643e1a7596d20f81640e1', 'request_id': 'req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:48.666968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] The token cache is being invalidate because project 094bc5ab1b8643e1a7596d20f81640e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:48.667468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:48.669008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-77eb4665-0a4d-4b8b-bbbf-d2ac24d7635f tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:48.671321 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3779/7610] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:48 2022] DELETE /identity/v3/projects/094bc5ab1b8643e1a7596d20f81640e1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:48.676189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:48.678740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:48.706068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:48.770797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb367d-a088-4f9e-833f-c3909bcb9d0d tempest-IdentityV3ProjectTagsTest-571465866 tempest-IdentityV3ProjectTagsTest-571465866-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:49.049937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:49.050939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:49.051232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:49.051557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] PATH_INFO: `/v3/users/772d87e83edf4cd7bafb133e3049859e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:49.052956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=772d87e83edf4cd7bafb133e3049859e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:49.055617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:49.126764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772d87e83edf4cd7bafb133e3049859e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:49.135341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772d87e83edf4cd7bafb133e3049859e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:49.136563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772d87e83edf4cd7bafb133e3049859e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:49.137316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772d87e83edf4cd7bafb133e3049859e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:49.155032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772d87e83edf4cd7bafb133e3049859e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:49.191061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3832/7611] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:48 2022] DELETE /identity/v3/users/772d87e83edf4cd7bafb133e3049859e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:49.193059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:49.193527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:49.193651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:49.221198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:49.222711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:49.316166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3780/7612] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:49.329856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:49.331665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:49.400708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:49.426717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91d75-7774-45f7-b11a-32b43fceae2a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:49.431334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:49.432025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:49.432309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:49.432577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:49.442662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:49.444363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:49.456345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3833/7613] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:49.891485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:49.893440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:49.931681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f364e18-8fd2-4f51-b195-fed2c082b1b0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:49.950408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:49.952689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:49.953546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:49.953825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] PATH_INFO: `/v3/projects/0eec3d13b876482e82978aeee9ff9b35` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:49.955157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eec3d13b876482e82978aeee9ff9b35)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:49.958247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:50.014585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eec3d13b876482e82978aeee9ff9b35', 'request_id': 'req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.021878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eec3d13b876482e82978aeee9ff9b35', 'request_id': 'req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.039734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eec3d13b876482e82978aeee9ff9b35', 'request_id': 'req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.058052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] The token cache is being invalidate because project 0eec3d13b876482e82978aeee9ff9b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:50.058348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.063956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.063956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3781/7614] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:49 2022] DELETE /identity/v3/projects/0eec3d13b876482e82978aeee9ff9b35 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:50.065030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:50.075451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464ba4-2df5-441e-8c0d-3ae3db23e81c service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:50.148682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:50.150479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.150479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.150479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] PATH_INFO: `/v3/users/6870209213aa4adcaea4337793dc5341` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.151342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6870209213aa4adcaea4337793dc5341)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:50.153816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:50.226835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6870209213aa4adcaea4337793dc5341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.238231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6870209213aa4adcaea4337793dc5341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.239047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6870209213aa4adcaea4337793dc5341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.239737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6870209213aa4adcaea4337793dc5341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.259740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba84acfc-3251-4444-bc46-b49e4471f927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6870209213aa4adcaea4337793dc5341'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.281103 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3834/7615] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:50 2022] DELETE /identity/v3/users/6870209213aa4adcaea4337793dc5341 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:50.590384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:50.591924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:50.605816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e48-b0f0-4842-80f0-ca4abfc91b07 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:50.646601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:50.676251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:50.677514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.677821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.678186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] PATH_INFO: `/v3/projects/6282dc6a093549ccbcb32dcf366b73da` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.679610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6282dc6a093549ccbcb32dcf366b73da)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:50.681555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:50.729402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6282dc6a093549ccbcb32dcf366b73da', 'request_id': 'req-86399636-4ea0-4cd8-accf-b23c3d6a3520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.735551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6282dc6a093549ccbcb32dcf366b73da', 'request_id': 'req-86399636-4ea0-4cd8-accf-b23c3d6a3520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.741119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6282dc6a093549ccbcb32dcf366b73da', 'request_id': 'req-86399636-4ea0-4cd8-accf-b23c3d6a3520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.755447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] The token cache is being invalidate because project 6282dc6a093549ccbcb32dcf366b73da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:50.755770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.756550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86399636-4ea0-4cd8-accf-b23c3d6a3520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:50.758525 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3782/7616] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:50 2022] DELETE /identity/v3/projects/6282dc6a093549ccbcb32dcf366b73da => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:50.763680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.764207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.764342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.785197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:50.786442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:50.843805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:50.860958 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3835/7617] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:50.862852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.863143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.863424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.885004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:50.886168 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:50.895261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3783/7618] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:50.899907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:50.911032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbad25-f23e-4c48-ba63-3008a3ef8a1d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:50.916693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:50.917410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.917854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.918135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.918876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:50.919186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:50.920885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:50.937791 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3836/7619] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:50.942143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:50.958326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c8b46-1ac5-4e13-9cba-5ae01b0611e3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:50.965467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:50.966258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:50.967258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:50.967659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:50.968445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:50.970705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.002125 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3784/7620] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:50 2022] POST /identity/v3/projects => generated 395 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:51.006461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.017963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1d744-c5b6-42af-bb9f-a1e033b57953 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.091874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.092570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.092854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.093130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.093831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.095823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.117239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3837/7621] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:51 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:51.121351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.131853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c5e69-bdc8-4f74-bbb5-5d9cd64454c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.136691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.137362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.137647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.137923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.138797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.140811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.151764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3785/7622] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:51.156311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.167739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79427037-7fb1-4909-8f65-9c284ef10b1d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.173472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.174159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.174437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.174705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.175432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.177062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69e55-6b75-4f29-9050-4fb152dbce35 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.188009 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3838/7623] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:51.192996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.204442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ae07e-54c3-4432-bdf1-df3a5cd6579d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.209753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.211173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.211173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.211349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] PATH_INFO: `/v3/projects/d26d8d2585334781b534ceac3e67ed33/users/455d2a95b24d44f7823fdb7decf8c54c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.230731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26d8d2585334781b534ceac3e67ed33, user_id=455d2a95b24d44f7823fdb7decf8c54c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.234001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.250240 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3786/7624] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:51 2022] PUT /identity/v3/projects/d26d8d2585334781b534ceac3e67ed33/users/455d2a95b24d44f7823fdb7decf8c54c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:51.263851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.264295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.264681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.297728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] MFA Rules not processed for user `455d2a95b24d44f7823fdb7decf8c54c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:51.299381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:51.417368 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3839/7625] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:51.422125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.535352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35427c81-15c9-47ac-a25d-c3f49b79e800 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.541860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.542713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.543101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.543527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.544440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.546951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.551196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:51.599137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3787/7626] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:51 2022] POST /identity/v3/projects => generated 397 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:51.600595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.614022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f6f31-4540-4b05-b88f-6ebe4da2bdd3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.672151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:51.680248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.681026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.681533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.682134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.682945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.685233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.707718 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3840/7627] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:51 2022] POST /identity/v3/users => generated 305 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:51.712050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.724853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687c3fc-9f16-41b0-b5e5-2d2efbbffbe9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.732448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.733367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.733654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.733927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.734674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.736368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.749384 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3788/7628] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:51.754369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.766462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65535384-1e72-4b75-99b0-2983f2ef1948 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.771261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.772555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.772839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.773122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] PATH_INFO: `/v3/projects/bfe7fffb973948049bb01b98dc795dad/users/871c84ca4ea64354b2f9385e86fe8095/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.798175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7fffb973948049bb01b98dc795dad, user_id=871c84ca4ea64354b2f9385e86fe8095, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.802527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.823566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3841/7629] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:51 2022] PUT /identity/v3/projects/bfe7fffb973948049bb01b98dc795dad/users/871c84ca4ea64354b2f9385e86fe8095/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:51.827058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.844096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba875c4-cc86-475f-875d-97cf6b41cde4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.925287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.926041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.926332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.926860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.927579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.930534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3485d9d-6339-4d94-beb1-c29445656b3c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.951643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3789/7630] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:51.954273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:51.967132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8297c-a868-4034-bb41-b48500ad4ad4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:51.971993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:51.972921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:51.973201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:51.973476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] PATH_INFO: `/v3/projects/bfe7fffb973948049bb01b98dc795dad/users/871c84ca4ea64354b2f9385e86fe8095/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:51.976195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7fffb973948049bb01b98dc795dad, user_id=871c84ca4ea64354b2f9385e86fe8095, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:51.978841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:51.990277 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3842/7631] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:51 2022] PUT /identity/v3/projects/bfe7fffb973948049bb01b98dc795dad/users/871c84ca4ea64354b2f9385e86fe8095/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:52.001021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.001423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.001771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.030922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] MFA Rules not processed for user `871c84ca4ea64354b2f9385e86fe8095`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:52.032282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:52.108182 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3790/7632] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:52.113245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.187629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343b7ff-0d30-45ba-9235-c4faec6ac2b2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.192028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455d2a95b24d44f7823fdb7decf8c54c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd26d8d2585334781b534ceac3e67ed33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.192697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.192982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.193264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.194159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jun 04 21:21:52.200342 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 04 21:21:52.201321 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.201898 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3843/7633] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/projects => generated 136 bytes in 89 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:21:52.206766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.216278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f30e-3611-4093-96e4-258979f8b808 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.221217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.221891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.222182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.222463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.223161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.225228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invalid input for field 'name': '' is too short Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: On instance['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: On instance['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: '' Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise error Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application '' Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.250923 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:21:52.252457 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application '' Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.253444 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3791/7634] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/projects => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:21:52.258184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.269989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed58e13-608e-4588-b7d3-0461acdf5220 tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.275221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.275939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.276220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.276496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.277171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.279014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: On instance['name']: Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise error Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:21:52.285034 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.286108 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application On instance['name']: Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.287274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3844/7635] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/projects => generated 412 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 04 21:21:52.291736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.302541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65880170-6ff1-4e14-9d77-7cbc1f07e19b tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.308189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.309130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.309407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.309664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects/b53bb1594a144d0fa74ba6c7333fc597` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.318017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b53bb1594a144d0fa74ba6c7333fc597)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.320033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Could not find project: b53bb1594a144d0fa74ba6c7333fc597.: keystone.exception.ProjectNotFound: Could not find project: b53bb1594a144d0fa74ba6c7333fc597. Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 04 21:21:52.335771 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b53bb1594a144d0fa74ba6c7333fc597. Jun 04 21:21:52.336700 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.337269 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3792/7636] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:52 2022] DELETE /identity/v3/projects/b53bb1594a144d0fa74ba6c7333fc597 => generated 113 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:21:52.341994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.353313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148b5bc-6ab1-48ed-9a7f-b999fc2b7f44 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.357396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455d2a95b24d44f7823fdb7decf8c54c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd26d8d2585334781b534ceac3e67ed33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.358054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.358348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.358754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.359545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] RBAC: Authorizing `identity:list_projects()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jun 04 21:21:52.367393 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._list_projects() Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 04 21:21:52.368255 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:21:52.369143 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3845/7637] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:21:52 2022] GET /identity/v3/projects => generated 135 bytes in 27 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:21:52.375435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.387464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.389326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:52.391490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8beb8bd-221b-42dd-82b0-db94d64230bc tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.396318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.398585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.398585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.398585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.398824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.401374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.443982 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3793/7638] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/projects => generated 358 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:52.449679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.461035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fd91e-ed33-4ee1-b15a-dfcbccebdc8e tempest-ProjectsNegativeStaticTestJSON-228104309 tempest-ProjectsNegativeStaticTestJSON-228104309-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.472999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:52.531902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.532772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.533064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.533400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.534402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432c403-6630-4cf4-ac8e-bd71ea91eb6e tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.536556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:52.541460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.542526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.543128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.544171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.545868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.548754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.554248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:52.576246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.sql.core [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-489267967' for key 'project.ixu_project_name_domain_id'") Jun 04 21:21:52.576246 ncdv-master-1 devstack@keystone.service[97804]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 21:21:52.576246 ncdv-master-1 devstack@keystone.service[97804]: [parameters: {'id': '22ced7f1f4284a09b416a72f50d6b157', 'name': 'tempest-project-dup-489267967', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 21:21:52.576246 ncdv-master-1 devstack@keystone.service[97804]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97804) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489267967, project id 22ced7f1f4284a09b416a72f50d6b157.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489267967, project id 22ced7f1f4284a09b416a72f50d6b157. Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application conn.query(q) Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:21:52.588462 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result.read() Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-489267967' for key 'project.ixu_project_name_domain_id'") Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 21:21:52.589341 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application yield resource Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application next(self.gen) Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise self.value Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 21:21:52.590319 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application session.commit() Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.session.flush() Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application compat.raise_( Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 21:21:52.591314 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 21:21:52.592328 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application conn.query(q) Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application result.read() Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:21:52.593245 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-489267967' for key 'project.ixu_project_name_domain_id'") Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [parameters: {'id': '22ced7f1f4284a09b416a72f50d6b157', 'name': 'tempest-project-dup-489267967', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.600902 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-489267967 at domain ID default. Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:21:52.602805 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-489267967, project id 22ced7f1f4284a09b416a72f50d6b157. Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3794/7639] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/projects => generated 284 bytes in 146 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 04 21:21:52.607875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.613268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabf858-a9c9-4b2f-a49d-fb35ad93af58 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.619465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871c84ca4ea64354b2f9385e86fe8095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe7fffb973948049bb01b98dc795dad', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.620535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.620868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.621102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] PATH_INFO: `/v3/projects/fde8f2e093574b78ac2f54c2af413b32` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.622536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fde8f2e093574b78ac2f54c2af413b32)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.624999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.633762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.635414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.648236 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3846/7640] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:52.689230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde8f2e093574b78ac2f54c2af413b32', 'request_id': 'req-fa05f33f-46bc-4115-8769-363d1fa9ce99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.696276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde8f2e093574b78ac2f54c2af413b32', 'request_id': 'req-fa05f33f-46bc-4115-8769-363d1fa9ce99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.702448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde8f2e093574b78ac2f54c2af413b32', 'request_id': 'req-fa05f33f-46bc-4115-8769-363d1fa9ce99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.718741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] The token cache is being invalidate because project fde8f2e093574b78ac2f54c2af413b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:52.719116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.719949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa05f33f-46bc-4115-8769-363d1fa9ce99 tempest-ProjectsNegativeStaticTestJSON-2068339906 tempest-ProjectsNegativeStaticTestJSON-2068339906-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.722111 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3795/7641] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:52 2022] DELETE /identity/v3/projects/fde8f2e093574b78ac2f54c2af413b32 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:52.727095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:52.738765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00531824-8a64-4104-a76e-2cb42d210484 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:52.808788 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:52.809472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.809688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.809961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] PATH_INFO: `/v3/users/455d2a95b24d44f7823fdb7decf8c54c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.811358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455d2a95b24d44f7823fdb7decf8c54c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:52.813593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:52.871781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455d2a95b24d44f7823fdb7decf8c54c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.879143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455d2a95b24d44f7823fdb7decf8c54c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.879860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455d2a95b24d44f7823fdb7decf8c54c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.880546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455d2a95b24d44f7823fdb7decf8c54c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.896593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455d2a95b24d44f7823fdb7decf8c54c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:52.916273 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3847/7642] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:52 2022] DELETE /identity/v3/users/455d2a95b24d44f7823fdb7decf8c54c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:52.919025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:52.919261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:52.919592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:52.939651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:52.941218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:53.023273 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3796/7643] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:53.034772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:53.038162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:53.087709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:53.118624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abbfe2-0171-45fa-8934-9a004dcc0b20 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:53.122447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:53.123183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:53.123488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:53.123782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:53.133880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:53.135575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:53.149066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3848/7644] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:53.690318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:53.693046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:53.726448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db820e-6f25-4a33-838f-911622fa0658 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:53.733309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:53.734344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:53.734698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:53.735054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] PATH_INFO: `/v3/users/59e619953f32406891051e0e029c1670` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:53.736795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e619953f32406891051e0e029c1670)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:53.739630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:53.781397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:53.810059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e619953f32406891051e0e029c1670'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:53.810787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e619953f32406891051e0e029c1670'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:53.818123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e619953f32406891051e0e029c1670'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:53.818878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e619953f32406891051e0e029c1670'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:53.835794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e619953f32406891051e0e029c1670'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:53.852166 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3797/7645] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:53 2022] DELETE /identity/v3/users/59e619953f32406891051e0e029c1670 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:53.966003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:53.968571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:53.994618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760cf7b-89be-40fa-8c9f-4b0c1851c6e1 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.106272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.108592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.108592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.108772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] PATH_INFO: `/v3/projects/d26d8d2585334781b534ceac3e67ed33` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.111527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26d8d2585334781b534ceac3e67ed33)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.112688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.132681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.135054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:54.164730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21cb93-2f29-485e-969e-609b02a5800b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.171998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.173848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.174153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.174440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] PATH_INFO: `/v3/projects/82e56305a8994e3ca45920448336ba18` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.193147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e56305a8994e3ca45920448336ba18)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.195912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.200799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26d8d2585334781b534ceac3e67ed33', 'request_id': 'req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.213039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26d8d2585334781b534ceac3e67ed33', 'request_id': 'req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.227091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26d8d2585334781b534ceac3e67ed33', 'request_id': 'req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.253156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] The token cache is being invalidate because project d26d8d2585334781b534ceac3e67ed33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:54.255057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.256439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.264473 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3849/7646] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:53 2022] DELETE /identity/v3/projects/d26d8d2585334781b534ceac3e67ed33 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:54.266957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.269971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:54.292479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e56305a8994e3ca45920448336ba18', 'request_id': 'req-a010cfa7-2b7e-45cb-ad63-87c8749e862d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.302342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e56305a8994e3ca45920448336ba18', 'request_id': 'req-a010cfa7-2b7e-45cb-ad63-87c8749e862d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.313434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e56305a8994e3ca45920448336ba18', 'request_id': 'req-a010cfa7-2b7e-45cb-ad63-87c8749e862d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.338172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] The token cache is being invalidate because project 82e56305a8994e3ca45920448336ba18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:54.339109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.340053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a010cfa7-2b7e-45cb-ad63-87c8749e862d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.343131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3798/7647] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:54 2022] DELETE /identity/v3/projects/82e56305a8994e3ca45920448336ba18 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:54.351729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74dc4-b8fd-4690-98e9-854ee3931694 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.352574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74dc4-b8fd-4690-98e9-854ee3931694 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.352901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f74dc4-b8fd-4690-98e9-854ee3931694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.404189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbed8f-bf54-4d36-80e2-74be6cdd152d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.409115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-83f74dc4-b8fd-4690-98e9-854ee3931694 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:54.412689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-83f74dc4-b8fd-4690-98e9-854ee3931694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:54.415628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:54.498142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.499945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.500561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.501152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] PATH_INFO: `/v3/users/871c84ca4ea64354b2f9385e86fe8095` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.504314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=871c84ca4ea64354b2f9385e86fe8095)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.507781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.520266 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3799/7648] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:54.525765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.525765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.526049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.563947 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:54.566183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:54.580836 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3800/7649] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:54.583074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.593980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871c84ca4ea64354b2f9385e86fe8095'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.605609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e634c89-bdbb-4003-b40f-8280dce50314 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.608232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871c84ca4ea64354b2f9385e86fe8095'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.610089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871c84ca4ea64354b2f9385e86fe8095'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.611044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871c84ca4ea64354b2f9385e86fe8095'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.611721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.612509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.613015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.613124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.615013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:54.615334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.618973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.634094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871c84ca4ea64354b2f9385e86fe8095'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:54.641919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3801/7650] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:21:54.649039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.652341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:54.654853 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3850/7651] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:54 2022] DELETE /identity/v3/users/871c84ca4ea64354b2f9385e86fe8095 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:54.668855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:54.675406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e28f0-d355-44a5-92fe-a5ecd4077100 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.771293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.772065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.772434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.773055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.773541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.776279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.827838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.841292 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3802/7652] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:54 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:54.845431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ffb21-6b1c-4c0d-be6b-2abe1a0e8acd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.938712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.939275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.939702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.940135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.940876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.942834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:54.972247 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3851/7653] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:54 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:54.976551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:54.989793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2a0e-3066-4b90-81ce-4da4bb38abe2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:54.995750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:54.996464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:54.996792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:54.997080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:54.998669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:54.999992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.012995 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3803/7654] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:55.018440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.033215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f9996-0ef8-494e-845c-8bed68cf4300 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.040164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.041017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.041375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.041721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.042542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.044281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5e4ba-4eba-467e-b1d0-7d6ad0ec2f1b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.060163 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3852/7655] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:55.062735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.075308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d33ba0-f5ed-4d40-afa2-1b08dd264974 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.081040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.081726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.082291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.082463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] PATH_INFO: `/v3/projects/2f43b1f083d049aa82d0799b0b3b57e0/users/7dcc41caaba74278a8a07e8ae14e88a0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.099955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f43b1f083d049aa82d0799b0b3b57e0, user_id=7dcc41caaba74278a8a07e8ae14e88a0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.102799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.119102 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3804/7656] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:55 2022] PUT /identity/v3/projects/2f43b1f083d049aa82d0799b0b3b57e0/users/7dcc41caaba74278a8a07e8ae14e88a0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:55.125523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.125896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.126184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.160638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:55.163398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.172192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:55.193222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.199066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.302013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3853/7657] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:55.315843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.317738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.331638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81364de5-ec0f-4cbc-9ce4-6c0174cc58ba admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.337021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.338989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.338989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.338989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] PATH_INFO: `/v3/projects/bfe7fffb973948049bb01b98dc795dad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.340157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe7fffb973948049bb01b98dc795dad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.342519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.404639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe7fffb973948049bb01b98dc795dad', 'request_id': 'req-a2608e18-8ae3-4017-a985-c84f190b4fa6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:55.413604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe7fffb973948049bb01b98dc795dad', 'request_id': 'req-a2608e18-8ae3-4017-a985-c84f190b4fa6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:55.419608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:55.425677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe7fffb973948049bb01b98dc795dad', 'request_id': 'req-a2608e18-8ae3-4017-a985-c84f190b4fa6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:55.435261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31907db1-266a-46b0-966c-9b05776453a4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.448162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] The token cache is being invalidate because project bfe7fffb973948049bb01b98dc795dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:21:55.448455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:55.449109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-a2608e18-8ae3-4017-a985-c84f190b4fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:55.455709 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3805/7658] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:55 2022] DELETE /identity/v3/projects/bfe7fffb973948049bb01b98dc795dad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:55.469068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d556-7806-4859-887c-a3df751a7e24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.470778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d556-7806-4859-887c-a3df751a7e24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.471359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d556-7806-4859-887c-a3df751a7e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.511653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-72c2d556-7806-4859-887c-a3df751a7e24 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:55.512880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-72c2d556-7806-4859-887c-a3df751a7e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.582663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.583535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.584007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.585634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.590734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.656631 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3806/7659] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:55.665466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.665785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.670349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.698072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:55.698586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.699370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:55.700231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.713744 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3854/7660] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:21:55.715778 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3807/7661] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:55.718038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.733431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68415672-39c3-4b62-b436-4875315d6fcf service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.738811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.739525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.739846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.740123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.741388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:21:55.741825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.743492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.761088 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3855/7662] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:21:55.762275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.774157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca7e30-a2ea-4550-bd18-d3135cbb9faa None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.779727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.780510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.780911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.781293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.781960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.784054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.818526 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3808/7663] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:55 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:55.820284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.826443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:55.833172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf816a-ee25-4d5b-8ad7-077e87778bb3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.900410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.901874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.902199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.902490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.903553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.905441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.930623 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3856/7664] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:55 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:55.935725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.948880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222185c-9088-410f-935d-ce76c84a7c2d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.955176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.956238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.956667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:55.957042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:55.957897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:55.959754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:55.978445 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3809/7665] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:55.980073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:55.992638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8135e-cdad-46e5-b2d9-75b86baac9db admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:55.998643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:55.999632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:55.999976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.000265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] PATH_INFO: `/v3/projects/17c38ead46934a9a84d5fd4e998e72e3/users/ab9747a6051046dc937bab56c41f7bcc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.018611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c38ead46934a9a84d5fd4e998e72e3, user_id=ab9747a6051046dc937bab56c41f7bcc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.022480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.042678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3857/7666] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:55 2022] PUT /identity/v3/projects/17c38ead46934a9a84d5fd4e998e72e3/users/ab9747a6051046dc937bab56c41f7bcc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:56.048211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.078822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666633c-4f18-4633-b9eb-6e4cd73340ee admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.180542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.181375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.181665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.182514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.185202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.191666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79853c-c383-462c-9d0a-ef32125d6c2c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.216655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3810/7667] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:56.221014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.232858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe67723-da89-4e35-9d66-0c00f09f187a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.244664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.246198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.247478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.248021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] PATH_INFO: `/v3/projects/17c38ead46934a9a84d5fd4e998e72e3/users/ab9747a6051046dc937bab56c41f7bcc/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.250173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c38ead46934a9a84d5fd4e998e72e3, user_id=ab9747a6051046dc937bab56c41f7bcc, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.254125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.270935 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3858/7668] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:56 2022] PUT /identity/v3/projects/17c38ead46934a9a84d5fd4e998e72e3/users/ab9747a6051046dc937bab56c41f7bcc/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:21:56.284933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.285667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.286195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.349618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] MFA Rules not processed for user `ab9747a6051046dc937bab56c41f7bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:56.351534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:56.453422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:56.552150 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3811/7669] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:56.557715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.636396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074d63-51de-46c4-a648-bb8be7393389 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.652771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.653724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.654022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.654304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.655038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.657338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.704826 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3859/7670] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:21:56 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:21:56.707575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.722801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d069f-0bc9-49d6-9a93-bdb9165c9982 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.845757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.847265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.847806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.848397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.849308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.851826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.891945 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3812/7671] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:21:56 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:21:56.898345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.914342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbd69-af88-433e-a178-3c9a82c14735 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.919640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.920393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.920675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.923860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.923860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.925429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:56.951557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3860/7672] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:21:56.954120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:56.969990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74fb3a-9134-4925-a768-42c4153fb578 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:56.977729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:56.978589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:56.978953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:56.979362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:56.981075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:56.983172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62df9-15c4-4ffa-93a1-87dcc190ca05 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:57.003472 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3813/7673] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:21:57.004229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:57.020884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d81fd-59f3-4aec-9c7f-b2137accb7d2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:57.031315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:57.032757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:57.033052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:57.034431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] PATH_INFO: `/v3/projects/d67bc2cd2bc840349e63599e5f75b9b3/users/cf3202b35b6c4001abeb11d02acaf868/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:57.061662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67bc2cd2bc840349e63599e5f75b9b3, user_id=cf3202b35b6c4001abeb11d02acaf868, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:57.066840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:57.092483 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3861/7674] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:21:57 2022] PUT /identity/v3/projects/d67bc2cd2bc840349e63599e5f75b9b3/users/cf3202b35b6c4001abeb11d02acaf868/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:57.104965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:57.105298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:57.105622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:57.165783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] MFA Rules not processed for user `cf3202b35b6c4001abeb11d02acaf868`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:57.168138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:57.284983 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3814/7675] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:21:57.294256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:57.296920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:57.305993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:57.399767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0fc4c-38d1-4f25-9838-9d14a5f91786 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:57.409250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:57.410896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:57.411015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:57.411654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:57.552692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:57.555103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670d1b9-ac4f-412c-9e88-d7da18d615f6 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:57.582148 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3862/7676] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:58.564745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:58.641640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:58.680989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fdc7a-f3d4-4a5c-85f2-433939383555 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:58.686742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:58.687886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:58.688707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:58.689001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] PATH_INFO: `/v3/users/ab9747a6051046dc937bab56c41f7bcc` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:58.691291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9747a6051046dc937bab56c41f7bcc)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:58.692935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:58.791470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9747a6051046dc937bab56c41f7bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:58.794906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9747a6051046dc937bab56c41f7bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:58.810513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9747a6051046dc937bab56c41f7bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:58.811940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9747a6051046dc937bab56c41f7bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:58.832676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9747a6051046dc937bab56c41f7bcc'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:21:58.859794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3815/7677] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:21:58 2022] DELETE /identity/v3/users/ab9747a6051046dc937bab56c41f7bcc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:21:58.864886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:58.865481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:58.865563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:58.887724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:21:58.889125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:58.986796 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3863/7678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:21:59.013797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:59.014273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:21:59.129552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aad8-2b70-48bc-b77d-e031f65176a1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:21:59.134507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:21:59.135384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:21:59.135726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:21:59.135917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:21:59.150594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:21:59.152955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:21:59.165130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3816/7679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:21:59.997638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:21:59.999701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:00.020812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ac31-dbe9-4b58-bc6c-6babce2cfd18 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:00.041607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:00.042523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:00.042806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:00.043413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] PATH_INFO: `/v3/projects/17c38ead46934a9a84d5fd4e998e72e3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:00.044769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c38ead46934a9a84d5fd4e998e72e3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:00.046760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:00.165571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c38ead46934a9a84d5fd4e998e72e3', 'request_id': 'req-43a0d869-4985-46f0-9ea0-a6ef2bd62190'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.169541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:00.186722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c38ead46934a9a84d5fd4e998e72e3', 'request_id': 'req-43a0d869-4985-46f0-9ea0-a6ef2bd62190'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.208175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c38ead46934a9a84d5fd4e998e72e3', 'request_id': 'req-43a0d869-4985-46f0-9ea0-a6ef2bd62190'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.260343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] The token cache is being invalidate because project 17c38ead46934a9a84d5fd4e998e72e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:00.260638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.262833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.268329 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3864/7680] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:21:59 2022] DELETE /identity/v3/projects/17c38ead46934a9a84d5fd4e998e72e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:00.269448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:00.280922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322278-c44c-4a0b-ab74-06f6358859ba service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:00.475214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:00.494879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:00.508641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:00.509319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:00.509790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] PATH_INFO: `/v3/users/cf3202b35b6c4001abeb11d02acaf868` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:00.512166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3202b35b6c4001abeb11d02acaf868)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:00.514541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:00.643031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3202b35b6c4001abeb11d02acaf868'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.643660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3202b35b6c4001abeb11d02acaf868'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.653704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3202b35b6c4001abeb11d02acaf868'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.659386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3202b35b6c4001abeb11d02acaf868'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.689045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7baeebd0-9058-42fe-a17c-099502be2f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3202b35b6c4001abeb11d02acaf868'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:00.726004 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3817/7681] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:00 2022] DELETE /identity/v3/users/cf3202b35b6c4001abeb11d02acaf868 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:01.479731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:01.481275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:01.520360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d869-4985-46f0-9ea0-a6ef2bd62190 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:01.680203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:01.681363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:01.681824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:01.682254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] PATH_INFO: `/v3/projects/d67bc2cd2bc840349e63599e5f75b9b3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:01.683765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67bc2cd2bc840349e63599e5f75b9b3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:01.687094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:01.782315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67bc2cd2bc840349e63599e5f75b9b3', 'request_id': 'req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:01.795046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67bc2cd2bc840349e63599e5f75b9b3', 'request_id': 'req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:01.811774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67bc2cd2bc840349e63599e5f75b9b3', 'request_id': 'req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:01.835475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] The token cache is being invalidate because project d67bc2cd2bc840349e63599e5f75b9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:01.835898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:01.836640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef006cd2-2cd5-42b3-bd0e-8ce75119d35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:01.840220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3865/7682] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:01 2022] DELETE /identity/v3/projects/d67bc2cd2bc840349e63599e5f75b9b3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:01.845760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:01.846399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:01.846982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:01.893670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:01.897463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:02.063409 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3818/7683] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:22:02.072014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af6b-d551-42be-b728-711a993b2476 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.072310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af6b-d551-42be-b728-711a993b2476 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.072597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af6b-d551-42be-b728-711a993b2476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.095102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f964af6b-d551-42be-b728-711a993b2476 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:02.096591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f964af6b-d551-42be-b728-711a993b2476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:02.111978 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3866/7684] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:02.115067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.128549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e937-b3c9-4912-9668-78a449ad1820 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.137455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.140731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.141311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.144081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.145093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:02.146475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.150616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.179798 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3819/7685] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:02.184688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964af6b-d551-42be-b728-711a993b2476 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.201036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964af6b-d551-42be-b728-711a993b2476 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.211090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.211949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.212496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.212795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.213725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.215923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.260547 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3867/7686] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:02 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:02.264884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.284951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e6f4-47b0-49dd-9ec4-943a3ade42cc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.381152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.381945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.382236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.382534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.384013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.387213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.398390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:02.427777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.428259 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3820/7687] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:02 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:02.444492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5378d-3261-46fc-96f1-57c53cdc6c51 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.459310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.460377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.461976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.462279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.463211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.466152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.483548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3868/7688] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:02.487720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.498878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acbae9-4377-4ea8-8280-6429ada210e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.508826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.509821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.510114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.510394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] PATH_INFO: `/v3/projects/ae46f330816b435c87bf66dc7ef07132/users/d77e511cb1134a9997c2f3fce85780fe/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.539485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae46f330816b435c87bf66dc7ef07132, user_id=d77e511cb1134a9997c2f3fce85780fe, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.543130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.568044 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3821/7689] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:02 2022] PUT /identity/v3/projects/ae46f330816b435c87bf66dc7ef07132/users/d77e511cb1134a9997c2f3fce85780fe/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:02.569517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.585221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c12c40-34bd-4214-a8e0-847a4ea4ba13 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.640882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:02.710646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.711346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.711665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.711947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.713037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.718741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193162e-fb6a-443c-ab08-44a61a62e796 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.748333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3869/7690] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:02.752108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:02.774160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b107-f943-4ee4-9a9e-96b1e348b076 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:02.780576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:02.782864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.789002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.789438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] PATH_INFO: `/v3/projects/ae46f330816b435c87bf66dc7ef07132/users/d77e511cb1134a9997c2f3fce85780fe/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.792631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae46f330816b435c87bf66dc7ef07132, user_id=d77e511cb1134a9997c2f3fce85780fe, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:02.800520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10067ce-6ae9-4e8f-ace9-4185df1a7eea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:02.837623 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3822/7691] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:02 2022] PUT /identity/v3/projects/ae46f330816b435c87bf66dc7ef07132/users/d77e511cb1134a9997c2f3fce85780fe/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:02.848967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.849461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.850033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.890552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] MFA Rules not processed for user `d77e511cb1134a9997c2f3fce85780fe`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:02.892260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:02.919673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:02.920687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:02.920969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:02.959482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] MFA Rules not processed for user `7dcc41caaba74278a8a07e8ae14e88a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:02.961119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:03.033978 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3870/7692] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:03.039578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.065426 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3823/7693] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:22:03.072219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.074581 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:03.145451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62e58c-1e14-45aa-830b-39290acc9016 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.152667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.153428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.153869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.154290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.155001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.158278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.214499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9a859-e25e-4658-8c50-f198f9438693 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.221460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3871/7694] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:03 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:03.226526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.294939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:03.317480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.320425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.320999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.321980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:03.323072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.330865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.334448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.367534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e77d6-55aa-4f15-9c30-4f2affba13cc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.374380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.375331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.375842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.376309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.377246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.391978 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3824/7695] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:03 2022] POST /identity/v3/projects => generated 379 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:03.394565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.395733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.430789 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3872/7696] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:03 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:03.433900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.445184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad14e2-7e04-43df-ac3f-91deba5455d9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.506802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95482415-4012-43c0-ae7c-6c7111f0080d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.514425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.516222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.516820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.517448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.518662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.520876 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.546589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.547451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.547768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.548897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.555158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3825/7697] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:03 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:03.556612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.556774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.566493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.572316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e339a4e-61f6-4a6c-88ee-fc87bd6b5e45 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.579256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.580783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.581177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.581558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.582487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.585556 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3873/7698] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:03.585966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.589730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.607157 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3826/7699] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:03.608847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.627487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433318a-ea06-4853-adee-295364713b9e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.630301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892fc50-6780-422a-8508-ff3737868510 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.632953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.633633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.633920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.634238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.634953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.637141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.654738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.655421 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3874/7700] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:03.656467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.658323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.658659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.659053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] PATH_INFO: `/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87/users/8f8535f5cdd64aeeabbd81b1a5617c67/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.668468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba55aa-7059-48a4-bd94-f733762e5d18 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.674164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.675495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.675495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.675847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] PATH_INFO: `/v3/projects/1c332c4ba66145028e35c8ac8f075c29/users/c50c7f7c576e4c3d8af8a5351de5298d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.694684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac70a17e4e734dccb1d7c9a2bf18bb87, user_id=8f8535f5cdd64aeeabbd81b1a5617c67, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.694931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c332c4ba66145028e35c8ac8f075c29, user_id=c50c7f7c576e4c3d8af8a5351de5298d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.697701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.698495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b78d7-168c-47bc-a6ec-f71ee4981494 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.724344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3875/7701] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:03 2022] PUT /identity/v3/projects/1c332c4ba66145028e35c8ac8f075c29/users/c50c7f7c576e4c3d8af8a5351de5298d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:03.735674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.735940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.736222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.752607 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3827/7702] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:03 2022] PUT /identity/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87/users/8f8535f5cdd64aeeabbd81b1a5617c67/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:03.758868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.777293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] MFA Rules not processed for user `c50c7f7c576e4c3d8af8a5351de5298d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:03.780961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:03.853662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb79eb-e2f8-4a13-9b4b-b9c9bf540807 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.860061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.861074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.861395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.861781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.862652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.864431 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3876/7703] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:03.864755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.879928 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3828/7704] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:03.885477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.886423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:03.888922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:03.902839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75621666-6290-40ec-96f3-a7121ab04498 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:03.915090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:03.916071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:03.916403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:03.916724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] PATH_INFO: `/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87/users/8f8535f5cdd64aeeabbd81b1a5617c67/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:03.920199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac70a17e4e734dccb1d7c9a2bf18bb87, user_id=8f8535f5cdd64aeeabbd81b1a5617c67, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:03.923221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:03.940946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3877/7705] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:03 2022] PUT /identity/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87/users/8f8535f5cdd64aeeabbd81b1a5617c67/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:03.968045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:04.025161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58fdc4-c658-4f85-bf02-c11e2517b276 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:04.120485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:04.121602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:04.122230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:04.122569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:04.249372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:04.266030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815ffaa-5b37-4e60-b67a-51d350a55171 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:04.316283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3829/7706] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:22:05.864369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:05.871091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:06.044033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900afb91-41e8-4a20-b77b-6a7359e7a101 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:06.057374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:06.058833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:06.059295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:06.059795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] PATH_INFO: `/v3/users/d77e511cb1134a9997c2f3fce85780fe` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:06.062356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77e511cb1134a9997c2f3fce85780fe)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:06.067705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:06.183983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77e511cb1134a9997c2f3fce85780fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:06.233325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77e511cb1134a9997c2f3fce85780fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:06.235536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77e511cb1134a9997c2f3fce85780fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:06.238070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77e511cb1134a9997c2f3fce85780fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:06.276441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77e511cb1134a9997c2f3fce85780fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:06.327578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3878/7707] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:05 2022] DELETE /identity/v3/users/d77e511cb1134a9997c2f3fce85780fe => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:06.332416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fe805-3918-4700-b93c-8486abf8228a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:06.332906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fe805-3918-4700-b93c-8486abf8228a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:06.334013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fe805-3918-4700-b93c-8486abf8228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:06.373650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-884fe805-3918-4700-b93c-8486abf8228a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:06.373650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-884fe805-3918-4700-b93c-8486abf8228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:06.578415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3830/7708] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:06.629365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:06.631816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:06.813126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f861c-42d2-43ca-927a-822c55ebeef3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:06.824632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:06.825393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:06.826095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:06.826372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:06.855852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:06.858809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:06.873437 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3879/7709] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:07.855046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fe805-3918-4700-b93c-8486abf8228a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:07.856547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-884fe805-3918-4700-b93c-8486abf8228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:07.874121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fe805-3918-4700-b93c-8486abf8228a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:07.882297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:07.884659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:07.885382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:07.886038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] PATH_INFO: `/v3/projects/ae46f330816b435c87bf66dc7ef07132` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:07.899251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae46f330816b435c87bf66dc7ef07132)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:07.903328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:08.018067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:08.058696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae46f330816b435c87bf66dc7ef07132', 'request_id': 'req-348c887f-0ace-4a42-a4c3-884606a31eaf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.066958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae46f330816b435c87bf66dc7ef07132', 'request_id': 'req-348c887f-0ace-4a42-a4c3-884606a31eaf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.077786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae46f330816b435c87bf66dc7ef07132', 'request_id': 'req-348c887f-0ace-4a42-a4c3-884606a31eaf'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.103746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] The token cache is being invalidate because project ae46f330816b435c87bf66dc7ef07132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:08.104719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.105093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.114221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:08.114875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3831/7710] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:07 2022] DELETE /identity/v3/projects/ae46f330816b435c87bf66dc7ef07132 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:08.137745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2676b7-4eb4-41e6-9a8a-2516d5a107c1 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:08.199099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:08.278786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:08.280426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:08.280705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:08.281148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] PATH_INFO: `/v3/users/c50c7f7c576e4c3d8af8a5351de5298d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:08.285670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50c7f7c576e4c3d8af8a5351de5298d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:08.295837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:08.467450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50c7f7c576e4c3d8af8a5351de5298d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.504912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50c7f7c576e4c3d8af8a5351de5298d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.508346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50c7f7c576e4c3d8af8a5351de5298d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.509851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50c7f7c576e4c3d8af8a5351de5298d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.542287 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a1978984-8b7e-4937-9f37-65a1a4f6be0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50c7f7c576e4c3d8af8a5351de5298d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:08.578599 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3880/7711] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:08 2022] DELETE /identity/v3/users/c50c7f7c576e4c3d8af8a5351de5298d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:09.780739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:09.783008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:09.808282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c887f-0ace-4a42-a4c3-884606a31eaf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:09.941386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:09.942241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:09.942453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:09.942736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] PATH_INFO: `/v3/projects/1c332c4ba66145028e35c8ac8f075c29` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:09.946711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c332c4ba66145028e35c8ac8f075c29)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:09.948700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:10.060496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c332c4ba66145028e35c8ac8f075c29', 'request_id': 'req-ce518651-d761-46a9-ba12-8fdca85c3005'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:10.071141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c332c4ba66145028e35c8ac8f075c29', 'request_id': 'req-ce518651-d761-46a9-ba12-8fdca85c3005'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:10.088753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c332c4ba66145028e35c8ac8f075c29', 'request_id': 'req-ce518651-d761-46a9-ba12-8fdca85c3005'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:10.117132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] The token cache is being invalidate because project 1c332c4ba66145028e35c8ac8f075c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:10.117478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:10.118323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ce518651-d761-46a9-ba12-8fdca85c3005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:10.125421 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3832/7712] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:09 2022] DELETE /identity/v3/projects/1c332c4ba66145028e35c8ac8f075c29 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:10.126233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.127107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.128028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.161622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:10.163534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:10.407271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.407846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.408013 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3881/7713] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:10.408508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.454242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:10.455675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:10.479454 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3833/7714] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:10.485307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:10.501778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14008344-b8c1-45d5-869e-e09b9ae5dc4b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:10.518969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:10.522148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.523075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.523579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.524667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:10.525708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:10.529091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:10.555079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3882/7715] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:10.560282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:10.574453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39865d9f-dc8d-40bb-9633-6a631cda5976 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:10.590162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:10.591808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.592433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.592868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.593759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:10.597915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:10.660622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3834/7716] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:10 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:10.665412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:10.680938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bef2d-3eae-4b67-87eb-54d2b6277637 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:10.754202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:10.821473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:10.822232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.822684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.823371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.824524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:10.829868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:10.885896 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3883/7717] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:10 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:10.887211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:10.918667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fa9a9-cb0d-4e6a-add6-0e6a71391c90 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:10.930702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:10.931811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.932247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.932721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.934370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:10.943327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:10.967862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3835/7718] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:10.971035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:10.988641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118e7f1-6e37-41af-9654-947878ac97b9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:10.995907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:10.996861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:10.997151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:10.997430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:10.998332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:11.000109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39921-41bc-4ab0-b076-f5bd9c6d5fa7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:11.014633 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3884/7719] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:11.018515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:11.030405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b05a3-17a9-4e24-b63e-7f6b0e3df8a4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:11.038938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:11.041036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:11.042711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:11.043009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] PATH_INFO: `/v3/projects/52a1cdeb63a6467381c95516fc0d7db9/users/a407a47802544c4291831d8209b38e2e/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:11.055654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:11.086506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1cdeb63a6467381c95516fc0d7db9, user_id=a407a47802544c4291831d8209b38e2e, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:11.095796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:11.152335 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3836/7720] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:11 2022] PUT /identity/v3/projects/52a1cdeb63a6467381c95516fc0d7db9/users/a407a47802544c4291831d8209b38e2e/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:11.156324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:11.156802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:11.157295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:11.257265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] MFA Rules not processed for user `a407a47802544c4291831d8209b38e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:11.262162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:11.540489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:11.541474 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3885/7721] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:11.713597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42527-9d17-46a6-bcf0-0e89909d8aa3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:11.723311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:11.724119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:11.724741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:11.725283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:11.726892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:11.730941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:11.802939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:11.806431 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3837/7722] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:11 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:11.828500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c432-4744-4931-ab53-821dbbad3bd0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:11.998532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.000210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.000513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.000799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.002232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.004315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.051754 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3886/7723] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:11 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:12.054669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:12.070147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5101a9-ffe7-4dba-8dc7-d0e9f7269308 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:12.076040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.076721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.077196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.077484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.078443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.080531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.099774 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3838/7724] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:12.101425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:12.120781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac4f1b-254c-45fd-bbde-ab6f1aff1620 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:12.127764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.129779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.131281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.132093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] PATH_INFO: `/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b/users/9149755812cd4a80b9cbfda963fb4301/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.162282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a18511e9a34dd8b1af6759ffa7c88b, user_id=9149755812cd4a80b9cbfda963fb4301, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.166707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.185159 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3887/7725] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:12 2022] PUT /identity/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b/users/9149755812cd4a80b9cbfda963fb4301/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:12.189944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:12.206442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182351-0955-48d3-804c-6ddde5db293b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:12.392404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.393207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.393588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.393962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.394804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.405067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a948a-79c0-4d35-8c31-595cfcbe431b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.424315 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3839/7726] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:12.427553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:12.437530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:12.442502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9939d6b-302a-4db5-a049-bada44e14efc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:12.455480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.457156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.457633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.458187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] PATH_INFO: `/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b/users/9149755812cd4a80b9cbfda963fb4301/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.461374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a18511e9a34dd8b1af6759ffa7c88b, user_id=9149755812cd4a80b9cbfda963fb4301, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.465502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.493241 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3888/7727] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:12 2022] PUT /identity/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b/users/9149755812cd4a80b9cbfda963fb4301/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:12.505356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5d74-67f9-43ba-8474-e2ed9f00fd80 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.506359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5d74-67f9-43ba-8474-e2ed9f00fd80 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.506713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5d74-67f9-43ba-8474-e2ed9f00fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.554710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-310a5d74-67f9-43ba-8474-e2ed9f00fd80 None None] MFA Rules not processed for user `9149755812cd4a80b9cbfda963fb4301`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:12.556767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-310a5d74-67f9-43ba-8474-e2ed9f00fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:12.635868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:12.705493 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3840/7728] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:12.715967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:12.718463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:12.842730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d7e6c-ad11-4a39-b3ee-00510f38f5a2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:12.854319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:12.857696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:12.858548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:12.859313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:12.888487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:12.891648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:12.921909 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3889/7729] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:13.092105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:13.092721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:13.092721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:13.138421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] MFA Rules not processed for user `8f8535f5cdd64aeeabbd81b1a5617c67`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:13.142615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:13.290056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3841/7730] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:13.314376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:13.316194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:13.449803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dcb9d-d71f-4cd7-b069-575828f20cce service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:13.456153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:13.457360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:13.457816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:13.458255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:13.470753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:13.472985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:13.495353 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3890/7731] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:13.856935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:13.858527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:14.029142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e5ce2-37af-4a8e-9fa7-d6a17352688f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:14.037789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:14.038715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:14.039370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:14.039816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:14.042732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:14.065869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:14.073371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c5da-0ecb-4527-bf81-9b132e8d93cc service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:14.121978 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3842/7732] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:14.477181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:14.478858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:14.691253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cde693-4989-4157-81fd-89d74a260f54 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:14.704000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:14.705136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:14.705640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:14.706112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] PATH_INFO: `/v3/users/cc07de8013124cfbb98f6ddf3d9ffab1` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:14.707601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc07de8013124cfbb98f6ddf3d9ffab1)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:14.710621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:14.747551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:14.802795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc07de8013124cfbb98f6ddf3d9ffab1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:14.817035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc07de8013124cfbb98f6ddf3d9ffab1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:14.818645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc07de8013124cfbb98f6ddf3d9ffab1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:14.819837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc07de8013124cfbb98f6ddf3d9ffab1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:14.847108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc07de8013124cfbb98f6ddf3d9ffab1'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:14.877702 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3891/7733] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:14 2022] DELETE /identity/v3/users/cc07de8013124cfbb98f6ddf3d9ffab1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:14.882984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:14.883277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:14.883575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:14.919078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:14.921562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:15.037166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:15.066913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3843/7734] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:15.137966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:15.139624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:15.306348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a99b-5673-4ef0-a388-6e933f58a491 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:15.319669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:15.320360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:15.320641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:15.321129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:15.355193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:15.356739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7143b-7d7b-48fa-a3cb-d7b1ee7d0f2a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:15.393822 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3892/7735] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:16.129024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:16.131336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:16.161119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287a0b1-2d18-4f94-8f68-871d48135adc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:16.177143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:16.178444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.187146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.187772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] PATH_INFO: `/v3/projects/e8f6c051f8f84034a8f8e98cd209488e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.189558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f6c051f8f84034a8f8e98cd209488e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:16.192082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:16.267721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f6c051f8f84034a8f8e98cd209488e', 'request_id': 'req-f496a77d-e04b-48e0-84a0-8cba03d012a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:16.276958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f6c051f8f84034a8f8e98cd209488e', 'request_id': 'req-f496a77d-e04b-48e0-84a0-8cba03d012a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:16.284791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f6c051f8f84034a8f8e98cd209488e', 'request_id': 'req-f496a77d-e04b-48e0-84a0-8cba03d012a7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:16.325677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] The token cache is being invalidate because project e8f6c051f8f84034a8f8e98cd209488e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:16.326891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:16.329227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f496a77d-e04b-48e0-84a0-8cba03d012a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:16.352488 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3844/7736] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:16 2022] DELETE /identity/v3/projects/e8f6c051f8f84034a8f8e98cd209488e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:16.358666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.359715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.360112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.404247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:16.406369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:16.547615 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3893/7737] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:16.555536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.555985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.556270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.580367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:16.586507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:16.609296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3845/7738] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:16.613275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:16.627963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d815ec-cdb0-4074-a1fb-fe55dab92df9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:16.641187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:16.642423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.642423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.642657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.643537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:16.645605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:16.650470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:16.687347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3894/7739] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:16.694075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:16.720347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37199de2-5fed-4ca5-9638-689cb4a01fc2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:16.727375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:16.728322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.728781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.729241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.730980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:16.733252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:16.799868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:16.810779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236c37-dc07-4752-8672-4ea9fd8b0e5c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:16.811766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3846/7740] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:16 2022] POST /identity/v3/projects => generated 351 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:16.857940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:16.919354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:16.920015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:16.920679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:16.920968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:16.924498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:16.926544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:16.965542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:16.972377 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3895/7741] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:16 2022] POST /identity/v3/users => generated 276 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:17.000390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91522-ecc9-48aa-9458-71857ff2d611 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:17.006858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:17.007765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.008061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.008342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.009154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:17.017376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:17.040223 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3847/7742] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:17.042307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:17.075260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6415722-60b0-4ba7-8782-d34d90a5c69e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:17.084589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:17.085717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.086178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.086800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.087801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:17.092934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670b57d-8623-44db-b2ce-65c2cee5d5a6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:17.110829 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3896/7743] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:17.112490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:17.138506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f2fe-8400-45eb-b001-9ecf7ffa8139 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:17.147455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:17.148762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.149170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.164611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] PATH_INFO: `/v3/projects/279ca77f06da45d5aad33b842220b200/users/120bdb41db3949e386cbb9f6156e145c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.199998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=279ca77f06da45d5aad33b842220b200, user_id=120bdb41db3949e386cbb9f6156e145c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:17.203888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:17.237137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3848/7744] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:17 2022] PUT /identity/v3/projects/279ca77f06da45d5aad33b842220b200/users/120bdb41db3949e386cbb9f6156e145c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:17.238627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.238935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.239217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.269844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] MFA Rules not processed for user `120bdb41db3949e386cbb9f6156e145c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:17.271139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:17.373137 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3897/7745] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:17.392923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:17.394807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:17.483153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307896-ae87-45cc-8a1d-ba4e768479ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:17.489191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:17.490174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.490562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.491070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.502121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:17.503775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82db2f0-d1f9-422e-8440-52def371a7f7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:17.513728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3849/7746] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:17 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:17.736094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:17.737701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:17.856884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495763ec-b485-4a3a-be29-fe4ef9297892 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:17.863439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:17.864791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:17.865246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:17.866519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] PATH_INFO: `/v3/users/a407a47802544c4291831d8209b38e2e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:17.868697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a407a47802544c4291831d8209b38e2e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:17.871499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:17.938615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:17.962030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a407a47802544c4291831d8209b38e2e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:17.970895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a407a47802544c4291831d8209b38e2e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:17.973466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a407a47802544c4291831d8209b38e2e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:17.974870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a407a47802544c4291831d8209b38e2e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:17.999333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a407a47802544c4291831d8209b38e2e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:18.028806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3898/7747] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:17 2022] DELETE /identity/v3/users/a407a47802544c4291831d8209b38e2e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:18.032124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:18.032420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:18.032703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:18.071223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:18.074032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:18.107108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:18.187858 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3850/7748] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:18.240784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:18.245012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:18.404215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299113e-175e-476f-a058-926c7445d404 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:18.417024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:18.418038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:18.418491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:18.418957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:18.448140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:18.461974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:18.501558 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3899/7749] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:20.359946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:20.365552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:20.387432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72efc6-582b-4965-90a1-8b94e859b69b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:20.402098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:20.404456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:20.404894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:20.405338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] PATH_INFO: `/v3/projects/52a1cdeb63a6467381c95516fc0d7db9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:20.407977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a1cdeb63a6467381c95516fc0d7db9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:20.410130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:20.620284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a1cdeb63a6467381c95516fc0d7db9', 'request_id': 'req-f62f89bf-763f-4ae7-9438-83e76c72cb99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:20.639120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a1cdeb63a6467381c95516fc0d7db9', 'request_id': 'req-f62f89bf-763f-4ae7-9438-83e76c72cb99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:20.669877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a1cdeb63a6467381c95516fc0d7db9', 'request_id': 'req-f62f89bf-763f-4ae7-9438-83e76c72cb99'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:20.740408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] The token cache is being invalidate because project 52a1cdeb63a6467381c95516fc0d7db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:20.743683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:20.746058 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:20.769944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3851/7750] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:20 2022] DELETE /identity/v3/projects/52a1cdeb63a6467381c95516fc0d7db9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:20.776896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:20.796476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2fb4b-5aa1-4fca-8967-da92d42a062e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:21.045363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:21.048138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:21.048434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:21.048717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] PATH_INFO: `/v3/users/9149755812cd4a80b9cbfda963fb4301` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:21.053260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9149755812cd4a80b9cbfda963fb4301)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:21.068588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:21.173663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9149755812cd4a80b9cbfda963fb4301'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:21.193876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9149755812cd4a80b9cbfda963fb4301'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:21.195327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9149755812cd4a80b9cbfda963fb4301'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:21.198223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9149755812cd4a80b9cbfda963fb4301'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:21.206393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:21.218418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-56f65fdf-10bd-48e4-a217-efbc3bb9c1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9149755812cd4a80b9cbfda963fb4301'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:21.250118 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3900/7751] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:20 2022] DELETE /identity/v3/users/9149755812cd4a80b9cbfda963fb4301 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:21.919630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:21.921704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:21.964312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f89bf-763f-4ae7-9438-83e76c72cb99 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.084038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.085588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.086066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.086550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] PATH_INFO: `/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.088892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a18511e9a34dd8b1af6759ffa7c88b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.092601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.169902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:22.175411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a18511e9a34dd8b1af6759ffa7c88b', 'request_id': 'req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:22.192900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a18511e9a34dd8b1af6759ffa7c88b', 'request_id': 'req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:22.203384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a18511e9a34dd8b1af6759ffa7c88b', 'request_id': 'req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:22.227714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] The token cache is being invalidate because project a8a18511e9a34dd8b1af6759ffa7c88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:22.228019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:22.233681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c040a0c3-7b08-4891-a9bd-4d88ba495b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:22.235789 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3852/7752] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:21 2022] DELETE /identity/v3/projects/a8a18511e9a34dd8b1af6759ffa7c88b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:22.240966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.241823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.242116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.277699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:22.279184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:22.394033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3901/7753] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:22.404108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.404895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.405379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.442251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:22.443866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:22.460354 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3853/7754] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:22.464041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.477502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95264ff-1f6d-4d9e-b756-96ec289004fa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.486182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.487795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.489823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.490991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.492170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:22.492706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.495705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b0805-eb2e-488c-85ec-26a221528eae admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.528282 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3902/7755] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:22:22.528461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.534641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.534927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.535203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.537617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a020-8251-4b45-9f7f-596e0d3a798a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.543390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.544228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.544613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.544967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.545747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.547785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.579779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:22.581096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:22.586956 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3854/7756] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:22.591249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.676660 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3903/7757] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:22.726116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f62da-8c3a-4198-9cda-b23c6b3efad6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.743123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.744110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.744398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.744724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.745929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.750505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.789766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3855/7758] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:22.794413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.810242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c082d-924d-45ec-9f3c-5dd5e9479ee6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.817421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.819411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.820037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.821118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.822417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.824197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.845436 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3904/7759] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:22.850079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.864033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e570-9bde-4594-9550-14d9eb2c1b9f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.870831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.871736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.872245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.872593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.873402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.875119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c180c3-3d10-4f54-b644-24fab8de8d58 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.891409 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3856/7760] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:22.892685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:22.905473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d79799-c4e6-4f74-9ae0-08d84d076ee7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:22.910497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:22.911619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.912611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.912967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] PATH_INFO: `/v3/projects/12fc848afef34e64b33a8ff45a91e19c/users/709e45ab88db4bf399c4c518230d3ba3/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:22.931330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fc848afef34e64b33a8ff45a91e19c, user_id=709e45ab88db4bf399c4c518230d3ba3, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:22.934485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:22.952806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3905/7761] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:22 2022] PUT /identity/v3/projects/12fc848afef34e64b33a8ff45a91e19c/users/709e45ab88db4bf399c4c518230d3ba3/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:22.970772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:22.971322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:22.971706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:23.017393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] MFA Rules not processed for user `709e45ab88db4bf399c4c518230d3ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:23.018831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:23.104622 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3857/7762] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:23.137388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:23.140734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:23.239184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:23.261278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:23.263039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:23.296869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:23.299351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b6767-0731-4b2b-881b-bcb82995ad5f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:23.312663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:23.313726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:23.320309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:23.320309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:23.340928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:23.342879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182608-d017-4191-bddf-155c89384d4c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:23.373206 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3906/7763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:23.406720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3c20c-d207-48d1-ae88-524f62f1c17c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:23.417953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:23.418912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:23.419213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:23.419490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] PATH_INFO: `/v3/users/120bdb41db3949e386cbb9f6156e145c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:23.422734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120bdb41db3949e386cbb9f6156e145c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:23.425104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:23.506334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120bdb41db3949e386cbb9f6156e145c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:23.507117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120bdb41db3949e386cbb9f6156e145c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:23.518690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120bdb41db3949e386cbb9f6156e145c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:23.519734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120bdb41db3949e386cbb9f6156e145c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:23.541787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120bdb41db3949e386cbb9f6156e145c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:23.562771 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3858/7764] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:23 2022] DELETE /identity/v3/users/120bdb41db3949e386cbb9f6156e145c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:23.567678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:23.568302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:23.569101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:23.591244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:23.592547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:23.667864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3907/7765] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:23.687122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:23.690309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:23.789285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaea54-7d25-4453-a498-07d07d401c79 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:23.795499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:23.796249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:23.796494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:23.796776 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:23.810707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:23.812094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7084-fc92-498c-91eb-50009ab8e5bc service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:23.827659 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3859/7766] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:24.354991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:24.358573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:24.393412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea713e-dd10-4f7d-a241-aac919e707a1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:24.422735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:24.425283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:24.432120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:24.436005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] PATH_INFO: `/v3/projects/279ca77f06da45d5aad33b842220b200` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:24.444049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=279ca77f06da45d5aad33b842220b200)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:24.446821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:24.591628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279ca77f06da45d5aad33b842220b200', 'request_id': 'req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:24.620880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279ca77f06da45d5aad33b842220b200', 'request_id': 'req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:24.643175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279ca77f06da45d5aad33b842220b200', 'request_id': 'req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:24.686469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] The token cache is being invalidate because project 279ca77f06da45d5aad33b842220b200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:24.687188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:24.689592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e2e6de24-b9c8-4e0a-ab62-d1fe4e05c4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:24.693913 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3908/7767] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:24 2022] DELETE /identity/v3/projects/279ca77f06da45d5aad33b842220b200 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:24.698640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:24.699707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:24.700192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:24.736546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:24.738179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:24.836699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:24.911253 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3860/7768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:24.913157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:24.913552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:24.914454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:24.961660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:24.966326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:24.985438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3909/7769] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:24.990105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.003622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aed55-20a5-4aa8-9245-d930dcfa6365 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.029101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.029806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.030425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.030425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.031077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:25.043442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.046045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.095549 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3861/7770] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:25.100231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.116459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3ecb-428d-44a5-b4c6-3489a6034042 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.127745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.128950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.129895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.131103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.133759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.139530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.229286 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3910/7771] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:25 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:25.230448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.253851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483a389-1918-4bf6-9522-4b75fc946c78 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.438513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.439375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.439873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.440251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.441120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.445594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.512603 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3862/7772] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:25 2022] POST /identity/v3/users => generated 303 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:25.513980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.534392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537d37-324d-431f-999f-069e35ad13b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.541871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.543038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.543628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.544139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.545406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.547312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.570816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3911/7773] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:25.577686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.590651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8c9a9-5902-4744-9534-6ae9949f40fe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.597039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.599178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.599929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.601579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.601579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.604429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d1081-a52b-451f-9877-1f5030622da2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.618443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3863/7774] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:25.622702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.641635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b743e-1816-4cb9-bdee-3a8718f36a8d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:25.655450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:25.657726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.659873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.660264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] PATH_INFO: `/v3/projects/a97c71c39e8d4900ace3ea0db0252db2/users/39438715e29241418529a061c3b88261/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.694670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97c71c39e8d4900ace3ea0db0252db2, user_id=39438715e29241418529a061c3b88261, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:25.697634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:25.721188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:25.735003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3912/7775] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:25 2022] PUT /identity/v3/projects/a97c71c39e8d4900ace3ea0db0252db2/users/39438715e29241418529a061c3b88261/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:25.741991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1ff8-7b64-4269-ad75-9a21dc94b6fc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:25.742946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1ff8-7b64-4269-ad75-9a21dc94b6fc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:25.743435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1ff8-7b64-4269-ad75-9a21dc94b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:25.775584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d2cc1ff8-7b64-4269-ad75-9a21dc94b6fc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:25.782741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d2cc1ff8-7b64-4269-ad75-9a21dc94b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:25.920930 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3864/7776] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:22:25.959488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:25.966036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:26.104557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3816f-bac8-4801-85bc-379f460379b7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:26.110454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:26.111296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:26.111693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:26.112021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:26.129879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:26.137023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:26.161779 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3913/7777] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:26.185300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:26.186152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:26.186595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:26.207802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] MFA Rules not processed for user `6343f086d9584796aba71988b14570f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:26.209713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:26.337807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:26.423678 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3865/7778] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:27.426104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:27.428298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:27.449546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf81be7-0f77-46f4-83be-b0a131274deb service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:27.459328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:27.460567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:27.461305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:27.461776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] PATH_INFO: `/v3/users/7dcc41caaba74278a8a07e8ae14e88a0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:27.464293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcc41caaba74278a8a07e8ae14e88a0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:27.466964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:27.522749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcc41caaba74278a8a07e8ae14e88a0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:27.530858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcc41caaba74278a8a07e8ae14e88a0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:27.531630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcc41caaba74278a8a07e8ae14e88a0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:27.532389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcc41caaba74278a8a07e8ae14e88a0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:27.546522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcc41caaba74278a8a07e8ae14e88a0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:27.567439 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3914/7779] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:27 2022] DELETE /identity/v3/users/7dcc41caaba74278a8a07e8ae14e88a0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:27.829567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:27.846119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ac3c-4df7-48a7-a8b3-3509919bc55a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:27.923873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:27.925412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:27.925731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:27.926012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] PATH_INFO: `/v3/projects/2f43b1f083d049aa82d0799b0b3b57e0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:27.927399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f43b1f083d049aa82d0799b0b3b57e0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:27.929395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:27.990851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f43b1f083d049aa82d0799b0b3b57e0', 'request_id': 'req-00b37942-3177-4858-ad2d-d6034c661178'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.000083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f43b1f083d049aa82d0799b0b3b57e0', 'request_id': 'req-00b37942-3177-4858-ad2d-d6034c661178'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.010117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f43b1f083d049aa82d0799b0b3b57e0', 'request_id': 'req-00b37942-3177-4858-ad2d-d6034c661178'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.032554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] The token cache is being invalidate because project 2f43b1f083d049aa82d0799b0b3b57e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:28.032817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.033586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.039710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3866/7780] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:27 2022] DELETE /identity/v3/projects/2f43b1f083d049aa82d0799b0b3b57e0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:28.040753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:28.042337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:28.057119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9aa5-ba0d-4965-929b-16516d2bdca1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:28.127943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:28.129416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:28.129865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:28.130076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] PATH_INFO: `/v3/users/8f8535f5cdd64aeeabbd81b1a5617c67` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:28.131768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8535f5cdd64aeeabbd81b1a5617c67)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:28.134763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:28.155846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:28.197897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8535f5cdd64aeeabbd81b1a5617c67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.205225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8535f5cdd64aeeabbd81b1a5617c67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.206062 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8535f5cdd64aeeabbd81b1a5617c67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.206676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8535f5cdd64aeeabbd81b1a5617c67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.219548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9d658e-82d2-4c03-8395-38d50ab5bc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8535f5cdd64aeeabbd81b1a5617c67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.234784 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3915/7781] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:28 2022] DELETE /identity/v3/users/8f8535f5cdd64aeeabbd81b1a5617c67 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:28.437437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:28.438944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:28.456769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37942-3177-4858-ad2d-d6034c661178 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:28.527542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:28.528438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:28.528720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:28.529059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] PATH_INFO: `/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:28.530398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac70a17e4e734dccb1d7c9a2bf18bb87)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:28.532490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:28.550050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:28.587976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac70a17e4e734dccb1d7c9a2bf18bb87', 'request_id': 'req-ea238cf8-e0b6-4019-b272-2bc564287cea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.596030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac70a17e4e734dccb1d7c9a2bf18bb87', 'request_id': 'req-ea238cf8-e0b6-4019-b272-2bc564287cea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.601831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac70a17e4e734dccb1d7c9a2bf18bb87', 'request_id': 'req-ea238cf8-e0b6-4019-b272-2bc564287cea'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.618185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] The token cache is being invalidate because project ac70a17e4e734dccb1d7c9a2bf18bb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:28.618618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.619351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:28.621238 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3867/7782] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:28 2022] DELETE /identity/v3/projects/ac70a17e4e734dccb1d7c9a2bf18bb87 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:29.337016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:29.337582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:29.337582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:29.397636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] MFA Rules not processed for user `39438715e29241418529a061c3b88261`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:29.398897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:29.555395 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3916/7783] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:29.561812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:29.566315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:29.724207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea238cf8-e0b6-4019-b272-2bc564287cea admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:29.729193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:29.730109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:29.730569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:29.730941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:29.731791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:29.733826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:29.787821 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3868/7784] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:29 2022] POST /identity/v3/projects => generated 405 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:29.789030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:29.804092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d807-9f1d-4086-a0ab-c942276c56c1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:29.925432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:29.926190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:29.926522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:29.926825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:29.928585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:29.931699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:29.983179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:29.998082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171d242-5d22-439b-8d6d-fa5c984d4e40 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:29.999052 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3917/7785] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:29 2022] POST /identity/v3/users => generated 309 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:30.048446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:30.049158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:30.049440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:30.049717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:30.050498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:30.053409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:30.073533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3869/7786] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:30.078827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:30.091290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a50e4f-fb9e-4f38-83d2-8ea284232567 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:30.097224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:30.097695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:30.097980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:30.099814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] PATH_INFO: `/v3/projects/57287315271444f2bfb3e2408aa89401/users/3e8a497635a34830becc99671b5dee89/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:30.114038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:30.128558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57287315271444f2bfb3e2408aa89401, user_id=3e8a497635a34830becc99671b5dee89, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:30.133250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:30.170828 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3918/7787] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:30 2022] PUT /identity/v3/projects/57287315271444f2bfb3e2408aa89401/users/3e8a497635a34830becc99671b5dee89/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:30.174936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:30.201783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c973623-16e3-4c80-8c0d-b3bf889ccccf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:30.410906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:30.412043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:30.414606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:30.415026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:30.417059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:30.419368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:30.430259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:30.443768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:30.486212 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3870/7788] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:30.487376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:30.523100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3223c-ad2a-4b0a-8527-519936a039a1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:30.550836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:30.552124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:30.554532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:30.559399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] PATH_INFO: `/v3/projects/57287315271444f2bfb3e2408aa89401/users/3e8a497635a34830becc99671b5dee89/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:30.564900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57287315271444f2bfb3e2408aa89401, user_id=3e8a497635a34830becc99671b5dee89, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:30.569376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bebae-866e-4fdc-96c0-140c79f1601d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:30.597724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056bc4-2e23-4fb6-b6c7-cf6cc3313b76 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:30.598199 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3871/7789] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:30 2022] PUT /identity/v3/projects/57287315271444f2bfb3e2408aa89401/users/3e8a497635a34830becc99671b5dee89/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:30.686399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:30.687380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:30.690994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:30.691310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:30.700527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:30.900735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:30.902076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:30.950260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3919/7790] 10.222.0.18 () {60 vars in 1396 bytes} [Sat Jun 4 21:22:30 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:22:31.514034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:31.514575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:31.515985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:31.524866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:31.579955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] MFA Rules not processed for user `3e8a497635a34830becc99671b5dee89`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:31.583830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:31.713625 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3872/7791] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:32.559115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:32.602322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba523-ef12-4f36-b7b3-d7ca6fc546de service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:32.612354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:32.613295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:32.615583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:32.616054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:32.627738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:32.676477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:32.785230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:32.787554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:32.804320 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3920/7792] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:32.875310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:32.893802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17c9ed-0e2f-471d-98ca-234f15d8fd24 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:32.904920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:32.905751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:32.906143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:32.906591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:32.913271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:32.937128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:32.938989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:32.957437 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3873/7793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:33.866021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:33.947721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a840ec-6a94-456b-a95c-cadf883a7bee service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:33.961390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:33.962873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:33.963177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:33.964206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] PATH_INFO: `/v3/users/39438715e29241418529a061c3b88261` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:33.965495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39438715e29241418529a061c3b88261)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:33.968855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:34.066766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39438715e29241418529a061c3b88261'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.086777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39438715e29241418529a061c3b88261'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.088896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39438715e29241418529a061c3b88261'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.090105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39438715e29241418529a061c3b88261'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.110862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39438715e29241418529a061c3b88261'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.132632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3921/7794] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:33 2022] DELETE /identity/v3/users/39438715e29241418529a061c3b88261 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:34.543126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:34.559018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837e73f-d8cc-4e48-9f5b-4fb4e36193e4 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:34.635477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:34.637759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:34.638519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:34.639023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] PATH_INFO: `/v3/projects/a97c71c39e8d4900ace3ea0db0252db2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:34.642475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97c71c39e8d4900ace3ea0db0252db2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:34.645583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:34.745440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97c71c39e8d4900ace3ea0db0252db2', 'request_id': 'req-c222ef72-3751-4b38-88be-27e349efd92f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.756139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97c71c39e8d4900ace3ea0db0252db2', 'request_id': 'req-c222ef72-3751-4b38-88be-27e349efd92f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.770159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97c71c39e8d4900ace3ea0db0252db2', 'request_id': 'req-c222ef72-3751-4b38-88be-27e349efd92f'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.790188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:34.841775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] The token cache is being invalidate because project a97c71c39e8d4900ace3ea0db0252db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:34.842467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.843380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:34.862682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3874/7795] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:34 2022] DELETE /identity/v3/projects/a97c71c39e8d4900ace3ea0db0252db2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:34.867449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:34.870830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:34.894480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843eaac-106a-4e8b-af46-347ed543c251 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:34.928993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:35.033895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:35.035239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.035635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.036241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] PATH_INFO: `/v3/users/3e8a497635a34830becc99671b5dee89` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.038338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8a497635a34830becc99671b5dee89)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:35.043806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:35.166463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8a497635a34830becc99671b5dee89'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.184881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8a497635a34830becc99671b5dee89'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.185678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8a497635a34830becc99671b5dee89'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.186306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8a497635a34830becc99671b5dee89'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.208041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0ea102a-9dd6-4816-9812-6fd2f2673fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8a497635a34830becc99671b5dee89'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.233433 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3922/7796] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:34 2022] DELETE /identity/v3/users/3e8a497635a34830becc99671b5dee89 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:35.478474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:35.484077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:35.510293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222ef72-3751-4b38-88be-27e349efd92f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:35.622477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:35.625329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.625329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.625329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] PATH_INFO: `/v3/projects/57287315271444f2bfb3e2408aa89401` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.628045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57287315271444f2bfb3e2408aa89401)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:35.630267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:35.697425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57287315271444f2bfb3e2408aa89401', 'request_id': 'req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.705543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57287315271444f2bfb3e2408aa89401', 'request_id': 'req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.714273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57287315271444f2bfb3e2408aa89401', 'request_id': 'req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.733973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] The token cache is being invalidate because project 57287315271444f2bfb3e2408aa89401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:35.734421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.735175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1c83b80e-d5a1-40a0-bbb9-a51372ba71b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:35.740471 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3875/7797] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:35 2022] DELETE /identity/v3/projects/57287315271444f2bfb3e2408aa89401 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:22:35.742921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.743327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.743736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.770702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:35.772175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:35.871879 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3923/7798] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:35.879293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.879798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.880420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.902845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:35.904231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:35.913436 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3876/7799] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:35.917945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:35.934018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70cd75-23e8-45a8-bf7e-47a578777897 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:35.938706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:35.939375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.939686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.939959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.940689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:35.941022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:35.942740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:35.956341 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3924/7800] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:35.961771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:35.972924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8a728-c770-4b77-9bd2-5c0d4c94587d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:35.979564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:35.980511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:35.980923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:35.981324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:35.982618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:35.985185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.019096 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3877/7801] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:35 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:36.020929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.031285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14797a-1f25-4645-837a-6dc76025bc38 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.044082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:36.093814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.094524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.094812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.095093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.095844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.097912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.119608 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3925/7802] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:36 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:36.123663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.134636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e8ca6-7e03-4165-9162-90bb787933ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.139553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.140589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.140869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.141150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.141918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.143605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.159810 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3878/7803] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:36.161917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.173693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050210ea-b772-4a17-8d88-276282d9b6b8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.178895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.179610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.179898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.180175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.180976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.182590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651abff-2fdb-4007-9a14-1c479fe1a670 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.195836 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3926/7804] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:36.198223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.209200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ede84-d168-467d-a6c4-ac14275e2036 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.214859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.215922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.216206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.216485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] PATH_INFO: `/v3/projects/14a62299d8e84bafb9dca55eda2a64c2/users/be2f1a2db90f41b4a4214b4fa91779d5/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.233866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a62299d8e84bafb9dca55eda2a64c2, user_id=be2f1a2db90f41b4a4214b4fa91779d5, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.236611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.253659 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3879/7805] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:36 2022] PUT /identity/v3/projects/14a62299d8e84bafb9dca55eda2a64c2/users/be2f1a2db90f41b4a4214b4fa91779d5/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:36.263520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.263824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.264130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.294596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] MFA Rules not processed for user `be2f1a2db90f41b4a4214b4fa91779d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:36.295852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:36.404379 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3927/7806] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:36.408717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.438219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:36.542155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9e35b-2332-4532-9b7b-066ad96ebdc0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.548721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.549644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.550837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.552282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.553216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.555412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.596752 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3880/7807] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:36 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:36.598016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.610785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279ea0f-e631-4206-8e06-df513e0938b0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.682296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.683002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.683288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.683592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.684296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.687004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.722225 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3928/7808] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:36 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:36.728964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.741225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432199-ad7d-4a54-bc29-3e33d981376e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.746200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.747146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.747468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.748571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.748571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.750129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.770838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.771018 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3881/7809] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:36.782109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd6bb-240c-4f2e-9ab7-d710b85f7cb0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.789394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.790471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.791471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.791908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] PATH_INFO: `/v3/projects/105869fd85d04dd0a69f9f32d6e01deb/users/e07be7220d7d48c6841d716a3ceef33c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.816856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:36.820670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105869fd85d04dd0a69f9f32d6e01deb, user_id=e07be7220d7d48c6841d716a3ceef33c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.823823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.845156 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3929/7810] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:36 2022] PUT /identity/v3/projects/105869fd85d04dd0a69f9f32d6e01deb/users/e07be7220d7d48c6841d716a3ceef33c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:36.846374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.858663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b83c-45db-444d-bc71-7d191ab8baa8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.935976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.937044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.937796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.938163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.939047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.940877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500cf0a-fbb8-4a73-bda5-2cc4de55a6d5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.953237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3882/7811] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:36.957851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:36.970346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f56b4-dd6a-423b-bb29-3aa2a12f8b83 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:36.975292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:36.976234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:36.976503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:36.976776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] PATH_INFO: `/v3/projects/105869fd85d04dd0a69f9f32d6e01deb/users/e07be7220d7d48c6841d716a3ceef33c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:36.978760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105869fd85d04dd0a69f9f32d6e01deb, user_id=e07be7220d7d48c6841d716a3ceef33c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:36.981697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:36.997176 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3930/7812] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:36 2022] PUT /identity/v3/projects/105869fd85d04dd0a69f9f32d6e01deb/users/e07be7220d7d48c6841d716a3ceef33c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:37.009617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:37.010079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:37.010508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:37.077181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] MFA Rules not processed for user `e07be7220d7d48c6841d716a3ceef33c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:37.078801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:37.197495 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3883/7813] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:37.206493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:37.209060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:37.333357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13abb7-f8be-4798-b0ad-2118a4db8c63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:37.340275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:37.340651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:37.341557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:37.342348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:37.367538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:37.367726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:37.381592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3931/7814] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:37.541144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:37.567823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35162d-e9db-43f6-8090-ba78ec8be865 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:37.572705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:37.573450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:37.573741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:37.574030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:37.585474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:37.675692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:37.678985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f5a6c-a528-4d88-ac9a-3665aaa2094e service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:37.695610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3884/7815] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:43.300433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:43.400930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4b16-7a15-4226-baad-f38589923dbb service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:43.405702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:43.406692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:43.407049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:43.407398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] PATH_INFO: `/v3/users/be2f1a2db90f41b4a4214b4fa91779d5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:43.409389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2f1a2db90f41b4a4214b4fa91779d5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:43.411904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:43.484068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2f1a2db90f41b4a4214b4fa91779d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:43.494467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2f1a2db90f41b4a4214b4fa91779d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:43.495461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2f1a2db90f41b4a4214b4fa91779d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:43.495954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2f1a2db90f41b4a4214b4fa91779d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:43.510150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:43.511714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2f1a2db90f41b4a4214b4fa91779d5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:43.530695 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3932/7816] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:43 2022] DELETE /identity/v3/users/be2f1a2db90f41b4a4214b4fa91779d5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:43.535274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:43.536409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:43.536705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:43.568639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:43.570207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:43.642313 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3885/7817] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:43.649332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:43.651341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:43.771029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6de78-c62f-4f2d-88f4-9235739065a8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:43.775635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:43.776303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:43.776592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:43.776875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:43.787721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:43.789059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:43.804336 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3933/7818] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:44.168819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:44.172461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:44.201968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f3788-9637-4cbe-8746-47e4d76fc293 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:44.209317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:44.210448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:44.210733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:44.211011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] PATH_INFO: `/v3/projects/14a62299d8e84bafb9dca55eda2a64c2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:44.212340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a62299d8e84bafb9dca55eda2a64c2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:44.244006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:44.324182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a62299d8e84bafb9dca55eda2a64c2', 'request_id': 'req-22c01486-a20e-4827-8536-0cab804da3fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.342544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a62299d8e84bafb9dca55eda2a64c2', 'request_id': 'req-22c01486-a20e-4827-8536-0cab804da3fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.366034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a62299d8e84bafb9dca55eda2a64c2', 'request_id': 'req-22c01486-a20e-4827-8536-0cab804da3fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.392526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] The token cache is being invalidate because project 14a62299d8e84bafb9dca55eda2a64c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:44.392883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.394211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.402508 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3886/7819] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:44 2022] DELETE /identity/v3/projects/14a62299d8e84bafb9dca55eda2a64c2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:44.406292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:44.430891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b6808-e165-4d15-bc34-bc95f0d66269 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:44.559477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:44.560699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:44.560931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:44.561324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] PATH_INFO: `/v3/users/e07be7220d7d48c6841d716a3ceef33c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:44.562698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07be7220d7d48c6841d716a3ceef33c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:44.565853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:44.659353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07be7220d7d48c6841d716a3ceef33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.668899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07be7220d7d48c6841d716a3ceef33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.669654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07be7220d7d48c6841d716a3ceef33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.670317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07be7220d7d48c6841d716a3ceef33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.720838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3d21d3ea-0a35-4818-8ed7-cc220c6896a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07be7220d7d48c6841d716a3ceef33c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:44.734402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:44.742472 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3934/7820] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:44 2022] DELETE /identity/v3/users/e07be7220d7d48c6841d716a3ceef33c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:45.612162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:45.615797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:45.636209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01486-a20e-4827-8536-0cab804da3fa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:45.669551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:45.740920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:45.742029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:45.742385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:45.742734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] PATH_INFO: `/v3/projects/105869fd85d04dd0a69f9f32d6e01deb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:45.744209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105869fd85d04dd0a69f9f32d6e01deb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:45.747582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:45.808676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105869fd85d04dd0a69f9f32d6e01deb', 'request_id': 'req-6d9cc993-5829-4cd5-9264-d5f8303862c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:45.815723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105869fd85d04dd0a69f9f32d6e01deb', 'request_id': 'req-6d9cc993-5829-4cd5-9264-d5f8303862c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:45.826785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105869fd85d04dd0a69f9f32d6e01deb', 'request_id': 'req-6d9cc993-5829-4cd5-9264-d5f8303862c4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:45.852217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] The token cache is being invalidate because project 105869fd85d04dd0a69f9f32d6e01deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:45.852404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:45.853234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d9cc993-5829-4cd5-9264-d5f8303862c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:45.854873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3887/7821] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:45 2022] DELETE /identity/v3/projects/105869fd85d04dd0a69f9f32d6e01deb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:45.860308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:45.861455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:45.861951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:45.883044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:45.885030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:45.972946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3935/7822] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:45.981662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:45.982220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:45.982444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.008012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:46.009439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:46.028300 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3888/7823] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:46.029240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.040591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eb62b-88fa-4a77-848d-4e5dbad55d79 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.046864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.048082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.048583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.049212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.050200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:46.050747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.053487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.085525 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3936/7824] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:46.091201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.107772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7d7f9-b6d2-41be-8644-59795c49d4d0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.117536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.118243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.118525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.118805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.119548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.121473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.186005 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3889/7825] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:46 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:46.191045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.223988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3034dd-ba8d-4bcd-ba99-53d1a08dbe02 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.340259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.341133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.341492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.341986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.342812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.346756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.380590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3937/7826] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:46 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:46.384420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.400731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94dadf-51c5-491e-a835-c828dc29b23b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.423907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.425359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.428421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.428834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.430352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.432730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.453489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.456588 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3890/7827] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:46.468985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6bb2-c5d5-40a8-97ee-d2fd3647a6eb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.479636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.481528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.481816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.482099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.482849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.484701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6f354-ae9e-420b-b1d9-be8bc5cd795c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.498625 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3938/7828] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:46.502790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.513842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3394fa6-4979-4154-b4ef-4cd45ad19997 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.519901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.520864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.521153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.521432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] PATH_INFO: `/v3/projects/795e383feac2471597372e2fb424e5ec/users/3f70afef4c524a478f1b5b4c41bca5b9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.538249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e383feac2471597372e2fb424e5ec, user_id=3f70afef4c524a478f1b5b4c41bca5b9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.541119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.563778 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3891/7829] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:46 2022] PUT /identity/v3/projects/795e383feac2471597372e2fb424e5ec/users/3f70afef4c524a478f1b5b4c41bca5b9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:46.571177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.571474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.571787 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.602400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] MFA Rules not processed for user `3f70afef4c524a478f1b5b4c41bca5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:46.603293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:46.674349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:46.687549 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3939/7830] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:46.700358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:46.702450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:46.770493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2398d-b4ca-4130-8aa7-10ba8f340966 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:46.774258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:46.774929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:46.775213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:46.775493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:46.782763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:46.787762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:46.789256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7e84e-b5d6-4c7f-8e6a-a8e15745ad88 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:46.811656 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3892/7831] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:50.329993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:50.402732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137d96-3cdd-4e67-bfe0-b00a1e921fec None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:50.407392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:50.408314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:50.408599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:50.408880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] PATH_INFO: `/v3/users/3f70afef4c524a478f1b5b4c41bca5b9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:50.410137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f70afef4c524a478f1b5b4c41bca5b9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:50.413000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:50.468864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f70afef4c524a478f1b5b4c41bca5b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:50.476369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f70afef4c524a478f1b5b4c41bca5b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:50.477081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f70afef4c524a478f1b5b4c41bca5b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:50.477691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f70afef4c524a478f1b5b4c41bca5b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:50.490796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f70afef4c524a478f1b5b4c41bca5b9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:50.507727 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3940/7832] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:50 2022] DELETE /identity/v3/users/3f70afef4c524a478f1b5b4c41bca5b9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:50.513698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:50.514336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:50.514614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:50.534298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:50.535520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:50.605558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3893/7833] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:50.615597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:50.617082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:50.682362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98580519-91e6-4dd2-a12b-739502256488 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:50.686379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:50.687054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:50.687304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:50.687635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:50.697930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:50.699468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6371fb2-7b5f-43fd-acf1-b6cde2e228b5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:50.709376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3941/7834] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:50.999714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.001210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:51.017596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1335f-d810-4c56-873d-af85842f9112 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.024241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.025362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.025823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.026102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] PATH_INFO: `/v3/projects/795e383feac2471597372e2fb424e5ec` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.027629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795e383feac2471597372e2fb424e5ec)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.029607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.079853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795e383feac2471597372e2fb424e5ec', 'request_id': 'req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:51.086407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795e383feac2471597372e2fb424e5ec', 'request_id': 'req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:51.092604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795e383feac2471597372e2fb424e5ec', 'request_id': 'req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:51.107150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] The token cache is being invalidate because project 795e383feac2471597372e2fb424e5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:51.107536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:51.108402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-dbb8acca-990e-40ef-b0f8-d4ce3fc6fc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:51.110110 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3894/7835] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:50 2022] DELETE /identity/v3/projects/795e383feac2471597372e2fb424e5ec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:51.115205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.115494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.115801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.134079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:51.135326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:51.148677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:51.198968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3942/7836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:51.208150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.209019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.209311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.228371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:51.229950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:51.238448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3895/7837] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:51.243553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.254334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5369b-f180-4ac9-ba11-7d52bebe8868 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.259359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.260297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.260421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.260632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.261404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:51.261731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.263386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.277930 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3943/7838] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:51.282149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.292369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dc096-5d77-44e6-b983-17882f9e13a2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.297527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.298216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.298506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.298822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.299579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.301632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.338283 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3896/7839] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:51 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:51.342184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.353427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0e053-1522-4f7a-8293-3a3980a9c35b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.430154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.430921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.431272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.431655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.432444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.434691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.463744 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3944/7840] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:51 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:22:51.465148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.476808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e589380-d81a-4aef-8aa5-123c6f8fdff4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.481889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.482576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.482863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.483146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.483920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.485568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.497964 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3897/7841] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:51.502202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.513803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ef98-73b6-489a-9907-e127c5f2cc11 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.519191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.520017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.520353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.520706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.521514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.523372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1959567-129d-4b1d-a02f-717d4971374d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.537429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3945/7842] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:22:51.538614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.549398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5c7de-6e5f-42d3-b27f-25a32dcf4677 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.554431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.555331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.555653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.555936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] PATH_INFO: `/v3/projects/129f116240f944c7b8ccdbb3c70547d6/users/a6469878dcd74ab2bc4989e83ec653a1/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.572017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129f116240f944c7b8ccdbb3c70547d6, user_id=a6469878dcd74ab2bc4989e83ec653a1, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.574877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.589967 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3898/7843] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:51 2022] PUT /identity/v3/projects/129f116240f944c7b8ccdbb3c70547d6/users/a6469878dcd74ab2bc4989e83ec653a1/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:51.600179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.600503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.600755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.628395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] MFA Rules not processed for user `a6469878dcd74ab2bc4989e83ec653a1`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:51.629682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:51.699446 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3946/7844] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:51.710470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:51.712244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:51.731534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:51.785428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7539a8-8268-4ddb-ae77-306b72c8aeb0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:51.790483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:51.791074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:51.791761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:51.791761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:51.804153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:51.805729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:51.819257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3899/7845] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:55.737829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:55.739357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:55.760075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:55.815680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337177-3218-4284-80c0-ab8686a4c45d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:55.820143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:55.820825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:55.821115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:55.821561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:55.823536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:55.843033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:55.844864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025741df-7dbe-48ee-a937-2f0693d924a4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:55.855974 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3947/7846] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:57.833499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:57.836492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:57.918846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cef411-db83-4e3a-9107-a26c9ed69188 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:57.924053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:57.925137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:57.925519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:57.925861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] PATH_INFO: `/v3/users/709e45ab88db4bf399c4c518230d3ba3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:57.927300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=709e45ab88db4bf399c4c518230d3ba3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:57.929387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:57.984674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709e45ab88db4bf399c4c518230d3ba3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:57.988012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709e45ab88db4bf399c4c518230d3ba3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:57.996451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709e45ab88db4bf399c4c518230d3ba3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:57.997173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709e45ab88db4bf399c4c518230d3ba3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.009956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709e45ab88db4bf399c4c518230d3ba3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.025721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3900/7847] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:22:57 2022] DELETE /identity/v3/users/709e45ab88db4bf399c4c518230d3ba3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:58.029985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.030544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.031193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.049881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:58.051223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:58.114481 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3948/7848] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:58.124803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.126540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:58.177920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:58.201277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7525-ecb4-40a1-be3f-e01cd8508bfd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.205202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.205888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.206176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.206448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.216749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.218200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47c46c-24e7-4099-b049-8530af80d94d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.228330 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3901/7849] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:22:58.426366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.434918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:58.454867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850814c-3460-4bbe-ba6d-ca8f6ba945af None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.460164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.461249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.461770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.462261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] PATH_INFO: `/v3/projects/12fc848afef34e64b33a8ff45a91e19c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.463890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fc848afef34e64b33a8ff45a91e19c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.469507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.532203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fc848afef34e64b33a8ff45a91e19c', 'request_id': 'req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.540504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fc848afef34e64b33a8ff45a91e19c', 'request_id': 'req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.549010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fc848afef34e64b33a8ff45a91e19c', 'request_id': 'req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.566420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] The token cache is being invalidate because project 12fc848afef34e64b33a8ff45a91e19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:22:58.566878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.567673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-6fae16ed-2a4a-467b-995b-8c65d9b21c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:22:58.569382 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3949/7850] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:22:58 2022] DELETE /identity/v3/projects/12fc848afef34e64b33a8ff45a91e19c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:58.574599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.574888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.575164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.594571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:58.595856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:58.664056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3902/7851] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:22:58.668074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.668371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.668653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.688683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:58.689904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:58.698756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3950/7852] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:58.703383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.713409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa72a1-4d88-44c1-948d-174e55dd687c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.718405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.719102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.719381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.719703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.720555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:22:58.720862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.722559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.738899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3903/7853] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:22:58.740094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.755202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17ea6-e84d-499d-9686-1d3f9f798b70 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.760483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.761317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.761774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.762122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.762896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.765373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.794445 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3951/7854] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:22:58 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:58.798723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.809637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d27a6-7a76-46cc-b190-d628b4d9f3a0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.868264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.868937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.869220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.869498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.870187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.872155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.892732 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3904/7855] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:22:58 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:22:58.897099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.908216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013db6-a05c-4b98-88d0-fada4146d9e4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.913456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.914132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.914650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.914849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.915791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.917454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.923411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:58.931562 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3952/7856] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:58.934597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.945755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea3d6-ae5a-4273-a69b-d80fd81b82c8 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.951180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.951928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.952265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.952547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:58.953285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:58.954900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4334a9-2ca6-448f-a1d6-fc2c05c689a5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:58.966361 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3905/7857] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:22:58.973483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:58.984944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71412ae-90fc-44fb-bc7b-2bd5c5c70730 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:58.990063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:58.990970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:58.991252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:58.991554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] PATH_INFO: `/v3/projects/991f723f765e48d1974e01e5d28c6426/users/9586582e944b4963a103cd4c40c58db2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:59.010030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991f723f765e48d1974e01e5d28c6426, user_id=9586582e944b4963a103cd4c40c58db2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:59.013004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:59.035358 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3953/7858] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:22:58 2022] PUT /identity/v3/projects/991f723f765e48d1974e01e5d28c6426/users/9586582e944b4963a103cd4c40c58db2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:22:59.046183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:59.046481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:59.046764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:59.076411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] MFA Rules not processed for user `9586582e944b4963a103cd4c40c58db2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:22:59.077816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:59.116339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:59.153416 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3906/7859] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:22:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:22:59.165038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:22:59.166994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:22:59.237366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada5b9c-090a-4e45-8074-269668089a10 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:22:59.241679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:22:59.242408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:22:59.242753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:22:59.243038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:22:59.252673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:22:59.255249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e5c19-595f-4e05-8f95-365b6d6d7b39 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:22:59.265655 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3954/7860] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:02.391238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:02.392856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:02.473832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb503b-1ce7-449c-a61c-bed14215c5fe None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:02.479053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:02.480046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:02.480434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:02.480742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] PATH_INFO: `/v3/users/a6469878dcd74ab2bc4989e83ec653a1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:02.481980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6469878dcd74ab2bc4989e83ec653a1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:02.483970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:02.535233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6469878dcd74ab2bc4989e83ec653a1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:02.536655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6469878dcd74ab2bc4989e83ec653a1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:02.544465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6469878dcd74ab2bc4989e83ec653a1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:02.545111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6469878dcd74ab2bc4989e83ec653a1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:02.563791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6469878dcd74ab2bc4989e83ec653a1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:02.582316 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3907/7861] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:02 2022] DELETE /identity/v3/users/a6469878dcd74ab2bc4989e83ec653a1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:02.586986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:02.587802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:02.587802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:02.605439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:02.606650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:02.668756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3955/7862] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:02.679554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:02.680935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:02.743634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a477a2-65c6-42fc-b05d-bff21394c74f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:02.747378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:02.748229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:02.748521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:02.748806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:02.757483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:02.759993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:02.761463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:02.773392 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3908/7863] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:03.256545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:03.259699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:03.276938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c075b-4dc8-42fa-9161-81787c3770e9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:03.283911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:03.284844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:03.285129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:03.285605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] PATH_INFO: `/v3/projects/129f116240f944c7b8ccdbb3c70547d6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:03.288258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=129f116240f944c7b8ccdbb3c70547d6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:03.290525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:03.367481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129f116240f944c7b8ccdbb3c70547d6', 'request_id': 'req-60efcab9-ff29-4bd6-95c1-729458cb19fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:03.374906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129f116240f944c7b8ccdbb3c70547d6', 'request_id': 'req-60efcab9-ff29-4bd6-95c1-729458cb19fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:03.383913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129f116240f944c7b8ccdbb3c70547d6', 'request_id': 'req-60efcab9-ff29-4bd6-95c1-729458cb19fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:03.405892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] The token cache is being invalidate because project 129f116240f944c7b8ccdbb3c70547d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:03.406294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:03.407260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-60efcab9-ff29-4bd6-95c1-729458cb19fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:03.411689 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3956/7864] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:03 2022] DELETE /identity/v3/projects/129f116240f944c7b8ccdbb3c70547d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:12.777048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:13.399628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:18.070428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:18.072069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.086591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf2d7-54ca-451a-9df8-5d1bd16946b3 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:18.148139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:18.149026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.149310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.149579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] PATH_INFO: `/v3/users/9586582e944b4963a103cd4c40c58db2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.150822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9586582e944b4963a103cd4c40c58db2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:18.152767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:18.202953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9586582e944b4963a103cd4c40c58db2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.203654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9586582e944b4963a103cd4c40c58db2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.213119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9586582e944b4963a103cd4c40c58db2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.213939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9586582e944b4963a103cd4c40c58db2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.231320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9586582e944b4963a103cd4c40c58db2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.248237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3909/7865] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:18 2022] DELETE /identity/v3/users/9586582e944b4963a103cd4c40c58db2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:18.252980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.253474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.253664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.274458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:18.275892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.340541 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3957/7866] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:18.350349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:18.351911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.414101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d83f-eeb4-47dc-b2d9-c9ba232bc695 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:18.418771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:18.419416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.419734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.420013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.430084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:18.431610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97413ca2-cd3c-4cc8-abe4-0d2c8f71954b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:18.442222 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3910/7867] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:18.630008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:18.631441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.646050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f3009-1153-4a8c-9613-77f35627adef None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:18.651622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:18.652479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.652753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.653024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] PATH_INFO: `/v3/projects/991f723f765e48d1974e01e5d28c6426` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.654369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991f723f765e48d1974e01e5d28c6426)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:18.656283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:18.710243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991f723f765e48d1974e01e5d28c6426', 'request_id': 'req-287821a0-0a1c-4e07-b1fa-d613604b1386'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.716492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991f723f765e48d1974e01e5d28c6426', 'request_id': 'req-287821a0-0a1c-4e07-b1fa-d613604b1386'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.721976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991f723f765e48d1974e01e5d28c6426', 'request_id': 'req-287821a0-0a1c-4e07-b1fa-d613604b1386'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.736634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] The token cache is being invalidate because project 991f723f765e48d1974e01e5d28c6426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:18.736919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.737598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-287821a0-0a1c-4e07-b1fa-d613604b1386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:18.739913 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3958/7868] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:18 2022] DELETE /identity/v3/projects/991f723f765e48d1974e01e5d28c6426 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:18.744992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.745310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.745587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.776273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:18.800452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:18.802262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.874022 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3911/7869] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:18.885768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.886054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.886332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.905819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:18.907043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:18.915959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3959/7870] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:18.921044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:18.933740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fb6ff-bedb-4961-aa08-b0fcc8ab7ec6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:18.939296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:18.939991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.940280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.940524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.941276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:18.941589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:18.943235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:18.955846 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3912/7871] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:18.960495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:18.970310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357f196-d9c6-475a-82af-0bf03b889d1d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:18.975953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:18.976643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:18.976930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:18.977216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:18.977906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:18.979922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.009366 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3960/7872] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:18 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:19.013649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:19.024345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9faf69b-3ff7-4720-b5b2-1ca32c52e907 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:19.082289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:19.083520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.083826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.084109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.084803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:19.086737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.113113 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3913/7873] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:19 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:19.117617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:19.128294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffc0b-1aa4-43ff-920d-3d3303abc3e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:19.133566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:19.134239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.134556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.134833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.135601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:19.137253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.148574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3961/7874] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:19.152782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:19.163588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba76835-cd9a-45fc-b9aa-940f26291bf5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:19.168963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:19.169627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.169914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.170195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.170960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:19.172623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a3b88-0a6f-4ff5-9ec0-f615199a1ff9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.189984 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3914/7875] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:19.191187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:19.204383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950f20-6542-4f90-b7fe-8d7247aba2b6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:19.211061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:19.211996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.212295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.212567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] PATH_INFO: `/v3/projects/69fa349c76654fc4ae3f1a1f2c290d29/users/41e8a335d98e46db96cb5d364158f96b/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.228262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fa349c76654fc4ae3f1a1f2c290d29, user_id=41e8a335d98e46db96cb5d364158f96b, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:19.230932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.245895 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3962/7876] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:19 2022] PUT /identity/v3/projects/69fa349c76654fc4ae3f1a1f2c290d29/users/41e8a335d98e46db96cb5d364158f96b/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:19.255899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.256195 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.256479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.288836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] MFA Rules not processed for user `41e8a335d98e46db96cb5d364158f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:19.290065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:19.348528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:19.361767 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3915/7877] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:19.372583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:19.374716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:19.400423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:19.444991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643958e-9bf4-40df-bf9d-310115a746bf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:19.449047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:19.449702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:19.449998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:19.450272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:19.459257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:19.460742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6c95-474d-412f-a3d7-f188450aaa41 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:19.469849 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3963/7878] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:29.369832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:29.465732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=17 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:36.475802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:36.552481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995d6c4-fe49-4e17-ac8b-ccbf293d062c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:36.558944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:36.560016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:36.561033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:36.561589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] PATH_INFO: `/v3/users/41e8a335d98e46db96cb5d364158f96b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:36.563090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e8a335d98e46db96cb5d364158f96b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:36.565400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:36.623747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e8a335d98e46db96cb5d364158f96b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:36.624564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e8a335d98e46db96cb5d364158f96b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:36.633454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e8a335d98e46db96cb5d364158f96b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:36.634122 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e8a335d98e46db96cb5d364158f96b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:36.649403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e8a335d98e46db96cb5d364158f96b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:36.665478 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3916/7879] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:36 2022] DELETE /identity/v3/users/41e8a335d98e46db96cb5d364158f96b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:36.670831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:36.671459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:36.671574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:36.690692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:36.692167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:36.761059 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3964/7880] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:36.772006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:36.773744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:36.839172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdf9-1f6e-4a1c-8849-59e9e0e267e1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:36.843205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:36.843958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:36.844243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:36.844525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:36.856898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:36.858863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:36.870431 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3917/7881] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:37.083994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.085980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:37.113981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe311-120c-42e9-9a5a-bf5386cea73a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.119037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.120010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.120292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.120571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] PATH_INFO: `/v3/projects/69fa349c76654fc4ae3f1a1f2c290d29` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.121762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fa349c76654fc4ae3f1a1f2c290d29)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.123988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.154802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.165997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c9629-d3f2-4e97-92de-66f540e0e912 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.183756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fa349c76654fc4ae3f1a1f2c290d29', 'request_id': 'req-979bce15-0ada-42f5-9b42-af0d3f550c9c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:37.187966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:37.191203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fa349c76654fc4ae3f1a1f2c290d29', 'request_id': 'req-979bce15-0ada-42f5-9b42-af0d3f550c9c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:37.199183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fa349c76654fc4ae3f1a1f2c290d29', 'request_id': 'req-979bce15-0ada-42f5-9b42-af0d3f550c9c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:37.213395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] The token cache is being invalidate because project 69fa349c76654fc4ae3f1a1f2c290d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:37.213709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:37.214350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-979bce15-0ada-42f5-9b42-af0d3f550c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:37.216191 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3965/7882] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:37 2022] DELETE /identity/v3/projects/69fa349c76654fc4ae3f1a1f2c290d29 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:37.220739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.221028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.221312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.224541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.225194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.225476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.225750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.227498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:37.238848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.240316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580e50d-7e2f-4eac-8bba-b927949801d4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.240968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:37.242144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:37.250451 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3918/7883] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:23:37.311726 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3966/7884] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:37.320717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.321041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.321296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.350009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:37.351265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:37.361056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3919/7885] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:37.368121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.386473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391e13-5467-4f9c-b580-392e91006a9a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.393254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.394031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.394367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.394725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.395579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:37.395943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.397654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.415909 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3967/7886] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:37.417538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.430758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7679b-464e-45a5-b211-5a164f193e52 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.436965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.437671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.437955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.438232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.439435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.441514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.479912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3920/7887] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:37 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:37.484369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.501858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c0278-563d-4d6c-b81e-e732a5e6ee98 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.530567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:37.610364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.611121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.611540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.611989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.612700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.615068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.643602 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3968/7888] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:37 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:37.647223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.658999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc7988-2833-4cf9-af9a-4397355d6f63 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.665629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.666318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.666595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.667203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.668071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.669739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.683277 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3921/7889] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:37.689459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.702959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a347cda-75f0-464a-9e61-b7fa0e3a4b84 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.710462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.715824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.716162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.716679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.717972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.720011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3134dc0-7d66-43f6-9beb-46d1ca3f5286 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.731642 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3969/7890] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:37.737257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:37.748841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005361-9241-4b32-93dc-22517ea5eb0b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:37.755005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:37.756794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.757078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.757360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] PATH_INFO: `/v3/projects/b0710ce565c44b15bf65746b64416d5c/users/4b33706a4e9f4d5f8843bd5bfaac5fc6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.780416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0710ce565c44b15bf65746b64416d5c, user_id=4b33706a4e9f4d5f8843bd5bfaac5fc6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:37.784337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:37.803588 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3922/7891] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:37 2022] PUT /identity/v3/projects/b0710ce565c44b15bf65746b64416d5c/users/4b33706a4e9f4d5f8843bd5bfaac5fc6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:37.909194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:37.909549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:37.909832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:37.949541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] MFA Rules not processed for user `4b33706a4e9f4d5f8843bd5bfaac5fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:37.950808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:38.048163 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3970/7892] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:38.089204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:38.091839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:38.170256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c086a8-c3ee-4ac1-b0d3-eb273208aca3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:38.178865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:38.179716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:38.180017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:38.180355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:38.190196 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:38.191955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:38.202759 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3923/7893] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:41.712285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:41.714726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:41.813842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e0aa-6559-4da4-9c77-61ca62246c1e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:41.820347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:41.820975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:41.821299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:41.821572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] PATH_INFO: `/v3/users/6343f086d9584796aba71988b14570f0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:41.823126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6343f086d9584796aba71988b14570f0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:41.826054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:41.851188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:41.883677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6343f086d9584796aba71988b14570f0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:41.890943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6343f086d9584796aba71988b14570f0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:41.891661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6343f086d9584796aba71988b14570f0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:41.892285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6343f086d9584796aba71988b14570f0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:41.904318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ce9127f7-bf4d-4895-87ff-f289479d3862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6343f086d9584796aba71988b14570f0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:41.920192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3971/7894] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:41 2022] DELETE /identity/v3/users/6343f086d9584796aba71988b14570f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:42.110128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.123197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6601b-6b33-46ab-963a-6205afcf2cb7 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.207212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.208234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.208667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.208955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] PATH_INFO: `/v3/projects/ed013dca03534a42a3a99593e56d0162` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.210308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed013dca03534a42a3a99593e56d0162)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.212260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.219057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:42.264806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed013dca03534a42a3a99593e56d0162', 'request_id': 'req-183d093a-724a-43a3-9f80-4ebb951ddd4c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:42.272237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed013dca03534a42a3a99593e56d0162', 'request_id': 'req-183d093a-724a-43a3-9f80-4ebb951ddd4c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:42.277957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed013dca03534a42a3a99593e56d0162', 'request_id': 'req-183d093a-724a-43a3-9f80-4ebb951ddd4c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:42.294183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] The token cache is being invalidate because project ed013dca03534a42a3a99593e56d0162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:42.294473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:42.295156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-183d093a-724a-43a3-9f80-4ebb951ddd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:42.296762 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3924/7895] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:42 2022] DELETE /identity/v3/projects/ed013dca03534a42a3a99593e56d0162 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:42.301715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.302083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.302379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.320312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:42.321447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:42.392285 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3972/7896] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:42.400948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.401239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.401522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.421403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:42.422685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:42.441531 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3925/7897] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:42.449593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.464978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e189a-8c56-44dc-b015-353499092b15 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.471943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.472756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.473347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.473723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.475606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:42.476569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.478606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.497513 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3973/7898] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:42.502074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.512702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468d58d-aa82-4501-bd11-faae344f5675 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.519439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.520265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.520676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.520995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.521786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.523988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.558049 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3926/7899] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:42.562420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.573888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457df6e-6697-4adb-84a8-ad54a89ce3a7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.643342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.644150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.644438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.644737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.645442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.647621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.687585 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3974/7900] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:42.692093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.703532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5971-1dac-49bb-a8e8-938157e2896e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.708678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.709363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.709648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.709926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.710721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.712519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.723847 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3927/7901] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:42.728044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.738526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b64d4-dee9-4ed2-a2bc-7aec282d5495 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.743387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.744126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.744412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.744711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.745448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.747059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bd7dc-5061-4d59-96ac-ab4413767ce7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.757467 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3975/7902] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:42.762116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:42.773598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7e01e-31e1-451f-8d59-252030f6ac22 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:42.779098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:42.780183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.780566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.780913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] PATH_INFO: `/v3/projects/942101d1ad0b4dd0aa838c1d4e392180/users/0b78f08ec1184e9c8a56aee770b4b683/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.797428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=942101d1ad0b4dd0aa838c1d4e392180, user_id=0b78f08ec1184e9c8a56aee770b4b683, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:42.800209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:42.814655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3928/7903] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:42 2022] PUT /identity/v3/projects/942101d1ad0b4dd0aa838c1d4e392180/users/0b78f08ec1184e9c8a56aee770b4b683/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:42.825816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:42.826325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:42.826621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:42.834513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:42.866241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] MFA Rules not processed for user `0b78f08ec1184e9c8a56aee770b4b683`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:42.867466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:42.936663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3976/7904] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:42.941421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.010629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3023d5-4b13-4219-9380-f8f372e739ab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.015772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.016389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.016672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.016950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.017659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.019592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.048482 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3929/7905] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:42 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:43.049760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.063192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9adb89-d697-478a-a7bb-a400c24f71a0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.130188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.131188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.131477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.131786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.132486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.134434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.158046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3977/7906] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:43.161989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.172780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fe2-e7f8-48a3-b539-182a739dc5ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.178309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.179156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.179482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.179875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.180614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.182256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.193596 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3930/7907] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:43.197726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.208746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd039c-e19b-4f2a-99c0-467101a6decd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.213728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.214639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.214924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.215212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] PATH_INFO: `/v3/projects/a32c6eacd7934fcd9c7991898013d664/users/5213b7bffd8e4f66b4e9f97ffbfd795d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.231439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32c6eacd7934fcd9c7991898013d664, user_id=5213b7bffd8e4f66b4e9f97ffbfd795d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.234281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.249211 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3978/7908] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:43 2022] PUT /identity/v3/projects/a32c6eacd7934fcd9c7991898013d664/users/5213b7bffd8e4f66b4e9f97ffbfd795d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:43.253659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.261427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:43.266549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537ea3d-68c7-4c8c-ae16-647205727e59 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.350398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.351005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.351289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.351593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.352492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.353919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760d3b4-9f75-4f24-ae52-8ecf30dda360 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.371396 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3931/7909] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:43.375748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.386870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad345e-f3e1-4266-b118-8b511bef7ccc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.393507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.393507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.394696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.397921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] PATH_INFO: `/v3/projects/a32c6eacd7934fcd9c7991898013d664/users/5213b7bffd8e4f66b4e9f97ffbfd795d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.403404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32c6eacd7934fcd9c7991898013d664, user_id=5213b7bffd8e4f66b4e9f97ffbfd795d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.407297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.419281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3979/7910] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:43 2022] PUT /identity/v3/projects/a32c6eacd7934fcd9c7991898013d664/users/5213b7bffd8e4f66b4e9f97ffbfd795d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:43.431334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.431760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.432010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.462044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] MFA Rules not processed for user `5213b7bffd8e4f66b4e9f97ffbfd795d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:43.463283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:43.538766 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3932/7911] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:43.543499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.555186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c38a63-bd5f-4a7f-bbbc-62993d83ae13 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.560214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.560885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.561196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.561482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.562247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.564038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.594605 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3980/7912] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/domains => generated 275 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:43.596181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.606239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e30db6-7ee4-4152-b2c2-6da69bba5812 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.680101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.680918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.681239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.681592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.682356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.684069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.707455 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3933/7913] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/domains => generated 277 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:43.708801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.723098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6de2-e03b-4f24-b142-046efa24b1c7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.756233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:43.757932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.760063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:43.786718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:43.793099 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.793786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.794097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.794447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.795285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.796952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.817577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3981/7914] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/domains => generated 277 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:43.818874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.836769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bebc8-a549-47df-9b4c-8eb18ac3162c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.884016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa675cde-16c0-4e2e-be5e-760d5b931511 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.890193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.891219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.891532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.891818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.892964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.894591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.896749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.897640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.897924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.898200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] PATH_INFO: `/v3/users/4b33706a4e9f4d5f8843bd5bfaac5fc6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.899428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b33706a4e9f4d5f8843bd5bfaac5fc6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:43.901631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:43.912042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3982/7915] 10.222.0.18 () {60 vars in 1149 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/domains => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:43.916161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:43.951924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b33706a4e9f4d5f8843bd5bfaac5fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:43.952653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b33706a4e9f4d5f8843bd5bfaac5fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:43.960076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b33706a4e9f4d5f8843bd5bfaac5fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:43.960746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b33706a4e9f4d5f8843bd5bfaac5fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:43.974324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2b296b7d-27c7-4ed0-b2e1-7c58de630ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b33706a4e9f4d5f8843bd5bfaac5fc6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:43.984011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a63e10-1f38-4a7b-a748-eb5e817c6fd7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:43.988997 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3934/7916] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:43 2022] DELETE /identity/v3/users/4b33706a4e9f4d5f8843bd5bfaac5fc6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:43.992911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:43.993816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.994107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.994217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:43.994388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9c56e45ce17444f5bf232cdba324695b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:43.994511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:43.994667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.006256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9c56e45ce17444f5bf232cdba324695b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.007940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.013324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:44.014898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.032107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9c56e45ce17444f5bf232cdba324695b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.035835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9c56e45ce17444f5bf232cdba324695b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.057110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.071027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.079755 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3935/7917] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:44.086278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.089180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.090546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.093318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.098742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.114075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project 9c56e45ce17444f5bf232cdba324695b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:44.114347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.115321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.122656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.123295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.126636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9c56e45ce17444f5bf232cdba324695b', 'request_id': 'req-32d3fbf1-351c-4d4f-bdd4-67977b126937'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.133222 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3983/7918] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:43 2022] DELETE /identity/v3/domains/9c56e45ce17444f5bf232cdba324695b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:44.138215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.139951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.152861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce9d1e-fa8e-4bad-89dc-818eded583ea None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.210703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3fbf1-351c-4d4f-bdd4-67977b126937 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.210955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.211580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.211988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.212271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.214059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.215463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.216197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.216489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.216769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.217512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.219120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.240918 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3984/7919] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/domains => generated 249 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:44.242941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.282143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.283652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.293638 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3936/7920] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:23:44.308437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5048-d8c4-4d79-8bf4-aa8598e83e4b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.315795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.316717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.316972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.317319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/c3e29dca35fa4681bf26497afbc4df94` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.329004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c3e29dca35fa4681bf26497afbc4df94)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.330627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.352316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.353151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.362185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.387260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.388002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.393875 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3985/7921] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:44 2022] PATCH /identity/v3/domains/c3e29dca35fa4681bf26497afbc4df94 => generated 250 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:44.395005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.405642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2a83-722f-4944-9024-534c2d8132a7 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.460748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.471182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.472156 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.472383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.472720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/c3e29dca35fa4681bf26497afbc4df94` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.476277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.478144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.484738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c3e29dca35fa4681bf26497afbc4df94)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.487154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.521814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.526339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.551476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46bf4-df61-48df-a1b9-81025c1af067 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.557061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.558008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.558317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.558592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] PATH_INFO: `/v3/projects/b0710ce565c44b15bf65746b64416d5c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.559973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0710ce565c44b15bf65746b64416d5c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.561890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.576353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.583742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.589680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.604269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project c3e29dca35fa4681bf26497afbc4df94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:44.604554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.605210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.611449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0710ce565c44b15bf65746b64416d5c', 'request_id': 'req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.612514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.613149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.613750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c3e29dca35fa4681bf26497afbc4df94', 'request_id': 'req-08ea134a-1be9-44b6-a15f-dae35cf4ef61'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.617895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0710ce565c44b15bf65746b64416d5c', 'request_id': 'req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.622478 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3937/7922] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:44 2022] DELETE /identity/v3/domains/c3e29dca35fa4681bf26497afbc4df94 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:44.623405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0710ce565c44b15bf65746b64416d5c', 'request_id': 'req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.627446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.628955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.638609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] The token cache is being invalidate because project b0710ce565c44b15bf65746b64416d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:44.638905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.639923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b3813b39-a0d3-4a29-bcfa-3465bffbaf54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.641606 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3986/7923] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:44 2022] DELETE /identity/v3/projects/b0710ce565c44b15bf65746b64416d5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:44.646429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873074ae-5c08-4dce-92f8-cddb08138460 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.646641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873074ae-5c08-4dce-92f8-cddb08138460 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.647041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873074ae-5c08-4dce-92f8-cddb08138460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.665766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-873074ae-5c08-4dce-92f8-cddb08138460 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:44.666904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-873074ae-5c08-4dce-92f8-cddb08138460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.699604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea134a-1be9-44b6-a15f-dae35cf4ef61 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.731419 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3987/7924] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:44.735469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.739326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.739749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.740057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.760061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:44.761030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.761248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.761706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.761999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.762279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.763014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.765059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.769991 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3988/7925] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:44.774459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.786297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3938/7926] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/domains => generated 277 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:44.786551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9143911-1268-4e58-bb75-d67b327bd334 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.787411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.789223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.795814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:UPDATE=1,keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:44.845349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.846018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.846299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.846570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.847332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:44.847668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.849321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.853508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cc69f-ec95-4d7e-b2b2-9a7f66b88ee6 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.859053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.859969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.860251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.860523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/dc55f38597e94bc189943d7be6a10f44` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.861518 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3989/7927] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:44.865950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.872340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc55f38597e94bc189943d7be6a10f44)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.874004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.875741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582d8b-2eb6-4378-af25-3274ae636fbb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.880697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.881338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.881642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.882047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.882622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.884554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:44.893884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.894590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.916470 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3990/7928] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:44.917366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.918991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.920952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.921585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:44.927007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3939/7929] 10.222.0.18 () {60 vars in 1249 bytes} [Sat Jun 4 21:23:44 2022] PATCH /identity/v3/domains/dc55f38597e94bc189943d7be6a10f44 => generated 278 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:44.928490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:44.929836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:44.988462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e3f77-ceae-48bc-8129-803459a0e978 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.994053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:44.994730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:44.994859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eff0db-3345-4ab4-98a3-4edf9a2a6a4c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:44.994982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:44.995279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:44.996002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:44.997918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.018205 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3991/7930] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:44 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:45.022737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.024609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:45.028872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:45.037751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ee19f-aad6-41bb-b767-66b2a8afec72 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.044119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.044796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.045071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.045342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.046071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.047733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.055284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.056212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.056495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.056773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/dc55f38597e94bc189943d7be6a10f44` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.057894 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3992/7931] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:45.061933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.071135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=dc55f38597e94bc189943d7be6a10f44)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.071926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544e27a-0ce8-4ce8-8477-dfebb7dfcf58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.073380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.078160 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3940/7932] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:23:44 2022] GET /identity/v3/domains/dc55f38597e94bc189943d7be6a10f44 => generated 278 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:45.078311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.078311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.078311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.078311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.078674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.079294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.080093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.089431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e9721-88e6-44b9-8b39-6479d7ebb195 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.091492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3993/7933] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:45.094100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.095019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.095307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.095596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.095710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/dc55f38597e94bc189943d7be6a10f44` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.096847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc55f38597e94bc189943d7be6a10f44)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.098413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.106429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea40c0-be3c-465a-9f5f-a31a1b042358 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.111591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.112501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.112766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.113052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] PATH_INFO: `/v3/projects/c00e14fc13844afdb92a0e9438c28e20/users/49e4cd98e40e46b09692831494b4ece0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.126495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.129583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00e14fc13844afdb92a0e9438c28e20, user_id=49e4cd98e40e46b09692831494b4ece0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.130360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.132402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5a5d-dcbc-4c90-a0a6-5c357def1a19 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.150014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3994/7934] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:45 2022] PUT /identity/v3/projects/c00e14fc13844afdb92a0e9438c28e20/users/49e4cd98e40e46b09692831494b4ece0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:45.162727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.163075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.163311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.185515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.194662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] MFA Rules not processed for user `49e4cd98e40e46b09692831494b4ece0`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:45.195004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.195931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:45.201841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.214281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:45.215536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project dc55f38597e94bc189943d7be6a10f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:45.216118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.217112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.226072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.226750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.227404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc55f38597e94bc189943d7be6a10f44', 'request_id': 'req-2dfe76bd-5178-4f61-a703-d871ad275180'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.236558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3941/7935] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:45 2022] DELETE /identity/v3/domains/dc55f38597e94bc189943d7be6a10f44 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:45.240961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.242338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:45.267178 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3995/7936] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:45.279126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.280715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:45.308076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe76bd-5178-4f61-a703-d871ad275180 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.313638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.314313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.314618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.314881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.315615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.317230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.330690 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3942/7937] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:23:45 2022] GET /identity/v3/domains => generated 1347 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:45.335230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.340405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:45.342786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb1713-feff-4273-a6c9-4020c3ae2412 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.346284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19e0bd-53e6-4337-a2d9-c8cc069e946d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.347207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.348016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.348376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.348663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.352627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.353485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.353769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.354043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/dc55f38597e94bc189943d7be6a10f44` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.358534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.360313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.362509 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:23:45.370127 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3996/7938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find domain: dc55f38597e94bc189943d7be6a10f44.: keystone.exception.DomainNotFound: Could not find domain: dc55f38597e94bc189943d7be6a10f44. Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dc55f38597e94bc189943d7be6a10f44. Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:45.374558 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:45.375817 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dc55f38597e94bc189943d7be6a10f44. Jun 04 21:23:45.376857 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:45.378153 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3943/7939] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:45 2022] PATCH /identity/v3/domains/dc55f38597e94bc189943d7be6a10f44 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:23:45.381711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.393632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064e7b5-9f5b-4448-8458-ad1edfe3718a service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.398802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.399712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.400002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.400281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.401047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.402657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.419331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3997/7940] 10.222.0.18 () {60 vars in 1148 bytes} [Sat Jun 4 21:23:45 2022] POST /identity/v3/domains => generated 276 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:45.423749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.436280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacf6f8-caca-4a32-a4e3-a4a664329c58 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.497843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.498635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.498922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.499213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.499985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.501928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.532872 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3944/7941] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:45 2022] POST /identity/v3/users => generated 348 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:45.537250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.548441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ff4f9-2bd1-49ba-b348-208534725ce3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.553667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.554424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.554828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.555111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/groups` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.555865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.557737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.574326 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3998/7942] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:23:45 2022] POST /identity/v3/groups => generated 324 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:45.578316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.589124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba166ac-1ab0-47d4-b49d-e27fb1dd628e tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.594049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.594995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.595295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.595670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.597104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9a7748ab08f4412b917bfac4ffd4cb19)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.598697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.618856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.619634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.648968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.649619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.652372 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3945/7943] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:45 2022] PATCH /identity/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19 => generated 277 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:45.656684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:45.658469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:45.672650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f896-fff0-48ed-864b-b774e0db0267 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:45.743913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:45.744939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:45.745427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:45.745850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:45.759274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9a7748ab08f4412b917bfac4ffd4cb19)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:45.761156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:45.797985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.802058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.804699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:45.934459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e90e675d8944e4789f94a25bcdb1dc9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.941769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e90e675d8944e4789f94a25bcdb1dc9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.942714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e90e675d8944e4789f94a25bcdb1dc9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.943579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e90e675d8944e4789f94a25bcdb1dc9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:45.956362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e90e675d8944e4789f94a25bcdb1dc9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.018775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.026406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.032822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.049117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project 9a7748ab08f4412b917bfac4ffd4cb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:46.049636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.050456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.058161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=74,keystone:DELETE=24,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:46.059596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.060447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.064755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9a7748ab08f4412b917bfac4ffd4cb19', 'request_id': 'req-0fc74373-feda-4214-8456-ef694255dc0b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.072558 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 3999/7944] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:45 2022] DELETE /identity/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:46.076920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.089722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227ab-7559-48ee-afdb-faeec134e010 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.158816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.160329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.160329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.160687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.169022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=9a7748ab08f4412b917bfac4ffd4cb19)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.170874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19.: keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.188745 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.190810 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:46.191860 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3946/7945] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.194863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.196893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:46.211984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74373-feda-4214-8456-ef694255dc0b tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.217045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.218034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.218322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.218778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/users/5e90e675d8944e4789f94a25bcdb1dc9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.228104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:get_user(user_id=5e90e675d8944e4789f94a25bcdb1dc9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.230234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9.: keystone.exception.UserNotFound: Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9. Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 21:23:46.250628 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.251701 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9. Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.252858 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4000/7946] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/users/5e90e675d8944e4789f94a25bcdb1dc9 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.256853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.268714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87891a-0852-41e8-9e8d-9fb8b920df87 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.273473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.274363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.274718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.274988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/groups/47c23bab9d9a41ac8fbc885f59a83727` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.280106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:get_group(group_id=47c23bab9d9a41ac8fbc885f59a83727)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.281152 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:46.281152 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:46.281152 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:46.282334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find group: 47c23bab9d9a41ac8fbc885f59a83727.: keystone.exception.GroupNotFound: Could not find group: 47c23bab9d9a41ac8fbc885f59a83727. Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jun 04 21:23:46.304997 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_group(group_id) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.306149 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 47c23bab9d9a41ac8fbc885f59a83727. Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:46.307353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3947/7947] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/groups/47c23bab9d9a41ac8fbc885f59a83727 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.310736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.322886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d6e69-6cc8-4896-955b-316f04edcf79 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.328065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.328976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.329268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.329571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/groups/47c23bab9d9a41ac8fbc885f59a83727` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.334449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find group: 47c23bab9d9a41ac8fbc885f59a83727.: keystone.exception.GroupNotFound: Could not find group: 47c23bab9d9a41ac8fbc885f59a83727. Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jun 04 21:23:46.344591 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.345674 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 47c23bab9d9a41ac8fbc885f59a83727. Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.346873 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4001/7948] 10.222.0.18 () {58 vars in 1226 bytes} [Sat Jun 4 21:23:46 2022] DELETE /identity/v3/groups/47c23bab9d9a41ac8fbc885f59a83727 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.350365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.360954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2856e-265b-439d-a909-40067ed7ac80 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.365917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.366802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.367088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.367369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/users/5e90e675d8944e4789f94a25bcdb1dc9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.376312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5e90e675d8944e4789f94a25bcdb1dc9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.378178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.381689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9.: keystone.exception.UserNotFound: Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9. Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jun 04 21:23:46.398113 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.399246 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 5e90e675d8944e4789f94a25bcdb1dc9. Jun 04 21:23:46.400345 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:46.401540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3948/7949] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:46 2022] DELETE /identity/v3/users/5e90e675d8944e4789f94a25bcdb1dc9 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.403707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.414640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe59285-4ca4-45f5-9c03-c7cc0a07072d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.419704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.420635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.420921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.421317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.429923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19.: keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.440235 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.441440 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.442738 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.443968 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4002/7950] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:46 2022] PATCH /identity/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:23:46.447160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.458944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83136227-5331-49f3-b97c-68586a550f6c tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.464468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.465074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.465362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.465639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.466340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.467983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.482551 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3949/7951] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/domains => generated 1347 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:46.487829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.498427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7b63c-d33a-4664-aeb9-0a544fbc9e8d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.503421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.504139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.504387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.504671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.505469 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:46.505860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.507487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.527680 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4003/7952] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:46.533405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.547061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d8f7-8d2a-47ae-b8a5-00f947a8bbfb tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.553123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.553798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.554106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.554367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.555106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1255181345) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:46.555414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.557050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.569809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3950/7953] 10.222.0.18 () {58 vars in 1198 bytes} [Sat Jun 4 21:23:46 2022] GET /identity/v3/domains?name=tempest-test_domain-1255181345 => generated 407 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:46.574926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.586251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bf9e1-9aaf-4b35-a06b-a2da4f718cdc tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.591380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.592331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.592616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.592893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.600569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19.: keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:46.610737 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:46.612128 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9a7748ab08f4412b917bfac4ffd4cb19. Jun 04 21:23:46.616379 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:46.617631 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4004/7954] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:46 2022] PATCH /identity/v3/domains/9a7748ab08f4412b917bfac4ffd4cb19 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 04 21:23:46.617729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.627770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239da2d-74d4-410b-b380-b069ca7d78f3 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.632660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.633515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.633797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.634075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/c671019ef1e043609d511c693dc6c6ed` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.646480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c671019ef1e043609d511c693dc6c6ed)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.648136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.698932 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3951/7955] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:46 2022] PATCH /identity/v3/domains/c671019ef1e043609d511c693dc6c6ed => generated 277 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:46.700248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.710604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326798-126e-472d-8a93-187a8d2e8205 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.715370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.716205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.716490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.716767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/c671019ef1e043609d511c693dc6c6ed` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.731187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c671019ef1e043609d511c693dc6c6ed)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.733598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:46.759719 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.763462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.827413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.835447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.845708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.861494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project c671019ef1e043609d511c693dc6c6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:46.861845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.862616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.871903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.872835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.877220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c671019ef1e043609d511c693dc6c6ed', 'request_id': 'req-0a3d2bf4-e601-4698-960b-2abd7ca9e469'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:46.884446 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4005/7956] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:46 2022] DELETE /identity/v3/domains/c671019ef1e043609d511c693dc6c6ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:46.890256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:46.892933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:46.907739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcff11-6851-4d51-84cf-ddcaeddb2f96 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:46.977208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:46.978446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:46.978796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:46.979073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/653586e8fa484e7cbc794e509c4ef156` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:46.992530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=653586e8fa484e7cbc794e509c4ef156)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:46.994190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:47.017107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.017982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.046606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.046763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.053207 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3952/7957] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:46 2022] PATCH /identity/v3/domains/653586e8fa484e7cbc794e509c4ef156 => generated 278 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:47.054454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:47.065036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2bf4-e601-4698-960b-2abd7ca9e469 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:47.094868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:47.133295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:47.134284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:47.134571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:47.135050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/653586e8fa484e7cbc794e509c4ef156` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:47.148250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=653586e8fa484e7cbc794e509c4ef156)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:47.150189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:47.174877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.179161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '653586e8fa484e7cbc794e509c4ef156'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.229763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.236455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.242604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.257021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project 653586e8fa484e7cbc794e509c4ef156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:47.257303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.257974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.266964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.267662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.271223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '653586e8fa484e7cbc794e509c4ef156', 'request_id': 'req-e625882f-c145-454a-9d91-d55fcd4f9a45'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.277185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4006/7958] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:47 2022] DELETE /identity/v3/domains/653586e8fa484e7cbc794e509c4ef156 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:47.281298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:47.282859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:47.296038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ca66-5542-47b5-99c8-0a86342142fe tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:47.338441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:47.359035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:47.360051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:47.360336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:47.360635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/6ed4a1e066da41d7acf36cd0c4a78565` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:47.372409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6ed4a1e066da41d7acf36cd0c4a78565)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:47.374045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:47.397169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.397974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.426140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.427072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.430304 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3953/7959] 10.222.0.18 () {60 vars in 1248 bytes} [Sat Jun 4 21:23:47 2022] PATCH /identity/v3/domains/6ed4a1e066da41d7acf36cd0c4a78565 => generated 276 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:47.434410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:47.436061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:47.450800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625882f-c145-454a-9d91-d55fcd4f9a45 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:47.513770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5213b7bffd8e4f66b4e9f97ffbfd795d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a32c6eacd7934fcd9c7991898013d664', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:47.514935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:47.515222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:47.515502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] PATH_INFO: `/v3/domains/6ed4a1e066da41d7acf36cd0c4a78565` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:47.525260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:47.528054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6ed4a1e066da41d7acf36cd0c4a78565)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:47.530264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:47.557261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.560531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.611292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.618846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.624381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.640871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] The token cache is being invalidate because project 6ed4a1e066da41d7acf36cd0c4a78565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:47.641160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.641810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.650498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.651270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.654969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-71a1d365-b68e-465a-801c-8dac8afdb7a7 tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6ed4a1e066da41d7acf36cd0c4a78565', 'request_id': 'req-71a1d365-b68e-465a-801c-8dac8afdb7a7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.660721 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4007/7960] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:47 2022] DELETE /identity/v3/domains/6ed4a1e066da41d7acf36cd0c4a78565 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:47.664960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:47.666377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:47.741617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047563d-d840-4d69-8eed-819e6c39357d tempest-DomainsTestJSON-1323616575 tempest-DomainsTestJSON-1323616575-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:47.806050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:47.806848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:47.807132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:47.807404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] PATH_INFO: `/v3/users/0b78f08ec1184e9c8a56aee770b4b683` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:47.808650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b78f08ec1184e9c8a56aee770b4b683)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:47.810567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:47.863316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b78f08ec1184e9c8a56aee770b4b683'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.863998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b78f08ec1184e9c8a56aee770b4b683'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.865277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:47.873268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b78f08ec1184e9c8a56aee770b4b683'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.874189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b78f08ec1184e9c8a56aee770b4b683'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.887398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b78f08ec1184e9c8a56aee770b4b683'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:47.902893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3954/7961] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:47 2022] DELETE /identity/v3/users/0b78f08ec1184e9c8a56aee770b4b683 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:47.908219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:47.908219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:47.908725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:47.926802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:47.928291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:47.994609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4008/7962] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:48.004824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:48.006652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:48.075459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f6668-7582-4f25-893d-1808e37d59e1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:48.079172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:48.079857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:48.080342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:48.080477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:48.090434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:48.091918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:48.102542 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3955/7963] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:48.417012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:48.419007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:48.437073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c0df-23dc-4d79-9b9d-3c446836ab36 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:48.444650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:48.445945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:48.446532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:48.446767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] PATH_INFO: `/v3/projects/942101d1ad0b4dd0aa838c1d4e392180` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:48.448627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=942101d1ad0b4dd0aa838c1d4e392180)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:48.451428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:48.500273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:48.510034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942101d1ad0b4dd0aa838c1d4e392180', 'request_id': 'req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.518197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942101d1ad0b4dd0aa838c1d4e392180', 'request_id': 'req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.524617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942101d1ad0b4dd0aa838c1d4e392180', 'request_id': 'req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.538462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] The token cache is being invalidate because project 942101d1ad0b4dd0aa838c1d4e392180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:48.538754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.539395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.541062 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4009/7964] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:48 2022] DELETE /identity/v3/projects/942101d1ad0b4dd0aa838c1d4e392180 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:48.545372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:48.556640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f96-fe08-4259-8379-7d181fbb6bd1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:48.629775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:48.630708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:48.631142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:48.631417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] PATH_INFO: `/v3/users/5213b7bffd8e4f66b4e9f97ffbfd795d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:48.632914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5213b7bffd8e4f66b4e9f97ffbfd795d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:48.634975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:48.698299 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5213b7bffd8e4f66b4e9f97ffbfd795d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.699118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5213b7bffd8e4f66b4e9f97ffbfd795d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.707824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5213b7bffd8e4f66b4e9f97ffbfd795d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.708761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5213b7bffd8e4f66b4e9f97ffbfd795d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.720235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:48.722635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9024efcd-ac74-4f13-b2c8-cbb39001ae0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5213b7bffd8e4f66b4e9f97ffbfd795d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:48.741419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3956/7965] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:48 2022] DELETE /identity/v3/users/5213b7bffd8e4f66b4e9f97ffbfd795d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:49.077615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.079312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:49.095752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e4bb4-e6f5-469d-9c62-f3c0ec6d7dca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.158565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.159450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.159945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.160233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] PATH_INFO: `/v3/projects/a32c6eacd7934fcd9c7991898013d664` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.161466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32c6eacd7934fcd9c7991898013d664)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.163661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.215497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32c6eacd7934fcd9c7991898013d664', 'request_id': 'req-623d8437-5226-4433-9d25-91e8a771a317'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:49.222949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32c6eacd7934fcd9c7991898013d664', 'request_id': 'req-623d8437-5226-4433-9d25-91e8a771a317'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:49.228918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32c6eacd7934fcd9c7991898013d664', 'request_id': 'req-623d8437-5226-4433-9d25-91e8a771a317'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:49.244903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] The token cache is being invalidate because project a32c6eacd7934fcd9c7991898013d664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:49.245210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:49.246057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-623d8437-5226-4433-9d25-91e8a771a317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:49.247737 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4010/7966] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:49 2022] DELETE /identity/v3/projects/a32c6eacd7934fcd9c7991898013d664 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:49.253411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.253842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.254217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.281538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:49.282913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:49.365812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3957/7967] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:49.379799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.380133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.381263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.409084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:49.410547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:49.420813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4011/7968] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:49.426447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.437392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fbdd3-fc8c-4b40-bc3e-a4713849eabc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.442903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.444275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.444597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.444918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.445701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:49.446050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.447939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.461289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3958/7969] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:49.466293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.476180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a05d-ed2d-40c8-8f51-229597878010 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.481822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.482497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.482778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.483172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.483999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.486139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.516378 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4012/7970] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:49.521040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.531838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e43d-fc5b-41be-9402-010d023fd1ca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.597783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.598599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.599277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.599736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.600551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.602914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.624351 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3959/7971] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:49.628814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.640654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253277c-ca7d-43a1-89c7-88f4e1610c3c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.646508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.647213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.647538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.647875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.648630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.650345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.663336 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4013/7972] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:49.667887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.679546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f7ef-c78d-4983-aa4f-86c1d219c685 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.684711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.685454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.685805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.686090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.686890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.688774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52412ebf-1fe1-41db-a187-600bc7ee8ce2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.700601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3960/7973] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:49.705337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.717038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba27a7-5dc5-42e7-b781-836a0a32356d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.722758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.723816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.724192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.724509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] PATH_INFO: `/v3/projects/4248a8c03ccf4b04a8b0352f37e617d6/users/c85fe307082247eb923d7ba66ac32876/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.741428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4248a8c03ccf4b04a8b0352f37e617d6, user_id=c85fe307082247eb923d7ba66ac32876, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.744434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:49.746898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:49.762306 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4014/7974] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:49 2022] PUT /identity/v3/projects/4248a8c03ccf4b04a8b0352f37e617d6/users/c85fe307082247eb923d7ba66ac32876/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:49.774703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.774987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.775262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.804932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] MFA Rules not processed for user `c85fe307082247eb923d7ba66ac32876`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:49.806214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:49.856330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:49.886034 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3961/7975] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:49.891636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:49.967057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ed3c-5cb7-475b-9279-c3e4079580c0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:49.972500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:49.973376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:49.973610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:49.973976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:49.974882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:49.976892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.010273 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4015/7976] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:49 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:50.014668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.028761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4f49-3d64-4c8d-adec-1e4c2b3c7cc1 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.101374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.102083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.102446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.102724 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.103542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.105701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.128511 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3962/7977] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:50.133430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.145272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06fdcf-6503-4dee-bc55-ce84f46143b3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.150891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.151646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.151977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.152257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.153067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.154822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.167261 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4016/7978] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:50.171630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.182401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506095be-aa9c-4457-b394-29c430c20898 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.187991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.188892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.189175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.189453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] PATH_INFO: `/v3/projects/ef250790de56405ca775825481ad59ba/users/55598dc6294f493b8f95d51f5ab7d680/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.206126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef250790de56405ca775825481ad59ba, user_id=55598dc6294f493b8f95d51f5ab7d680, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.209538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.224414 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3963/7979] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:50 2022] PUT /identity/v3/projects/ef250790de56405ca775825481ad59ba/users/55598dc6294f493b8f95d51f5ab7d680/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:50.228581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.239282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87799-5148-4d28-b65a-c5b854640626 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.304832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.305504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.306070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.306070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.306791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.308560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5a6d-5143-4c0b-aca8-762046b6ec48 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.322309 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4017/7980] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:50.325551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.337781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f0f9f-c7d4-4129-b75f-b9b76f15814b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.343328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.344322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.344638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.344923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] PATH_INFO: `/v3/projects/ef250790de56405ca775825481ad59ba/users/55598dc6294f493b8f95d51f5ab7d680/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.347107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef250790de56405ca775825481ad59ba, user_id=55598dc6294f493b8f95d51f5ab7d680, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.350433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.362317 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3964/7981] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:50 2022] PUT /identity/v3/projects/ef250790de56405ca775825481ad59ba/users/55598dc6294f493b8f95d51f5ab7d680/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:50.374030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.374384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.374629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.406178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] MFA Rules not processed for user `55598dc6294f493b8f95d51f5ab7d680`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:50.407817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:50.429238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.431702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:50.466248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:50.492622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4018/7982] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:50.493592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.502886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba718e-af75-41fb-aec0-87331c9e794b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.507830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.508527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.508816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.509057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.509778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.510241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5c3-2b2a-4cd3-9f63-4a89d58c84cb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.511418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.516807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.518217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.518624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.519006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] PATH_INFO: `/v3/users/49e4cd98e40e46b09692831494b4ece0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.520256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e4cd98e40e46b09692831494b4ece0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.522904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.527332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4019/7983] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/services => generated 290 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:50.531455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.553870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51627c-1d6e-4a69-b49c-a7e07b25c8b3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.559750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.560503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.560876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.561168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.561983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.563812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.569978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:50.580527 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-618739862. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:50.580527 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:50.580527 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:50.583303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e4cd98e40e46b09692831494b4ece0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:50.584644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e4cd98e40e46b09692831494b4ece0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:50.598048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e4cd98e40e46b09692831494b4ece0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:50.598733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e4cd98e40e46b09692831494b4ece0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:50.613772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c2b78dae-a7c1-42fb-94a3-432ec55cf063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e4cd98e40e46b09692831494b4ece0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:50.614500 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4020/7984] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/endpoints => generated 359 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:50.618919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.620901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:50.631217 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3965/7985] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:50 2022] DELETE /identity/v3/users/49e4cd98e40e46b09692831494b4ece0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:50.633107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.633444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.633668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.654309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23de4ac-1244-4175-9211-c0e743c80c0d tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.654567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:50.655622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:50.726994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.727902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.728254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.728621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-618739862` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.729375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-618739862)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.730761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.736418 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4021/7986] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:23:50 2022] GET /identity/v3/regions/tempest-region-618739862 => generated 178 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:50.737244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.745843 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3966/7987] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/auth/tokens => generated 3544 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:50.750109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058e95-39f6-4529-802b-c2fb8b5319b6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.758005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.758691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.758870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.759019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.759326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.760076 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.760221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:50.761958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.780375 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4022/7988] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/services => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:50.784232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.808443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4788883-a2c6-4a85-8e0b-9765d19818dd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.814890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.815633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.815886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.816241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.817003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.818845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.838855 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-985706930. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:50.838855 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:50.838855 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:50.844082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54cf9a-bb2a-4fa8-afbf-5ee88beb6f77 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.860918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.862038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.862355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.862821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.875200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4023/7989] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/endpoints => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:50.876615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.879486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.882609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.902115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984e35a-9a64-47ad-ab1b-6d75d8191537 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.907046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.907929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.908247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.908492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-985706930` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.909233 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3967/7990] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:50 2022] GET /identity/v3/auth/tokens => generated 3859 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:23:50.909354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-985706930)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.910290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.912476 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4024/7991] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:23:50 2022] GET /identity/v3/regions/tempest-region-985706930 => generated 178 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:50.917270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:50.941818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ccad2-73a6-47c2-bead-42082906ce86 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:50.947970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:50.948653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:50.948935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:50.949219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:50.950191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:50.952175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:50.962962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:50.976612 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-327864738. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:50.976612 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:50.976612 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:51.005815 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3968/7992] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:23:50 2022] POST /identity/v3/endpoints => generated 359 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:51.011444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.025025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9464113-0d35-479d-a690-fe60846c371e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.033189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:51.049777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.051008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.051331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.051735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-327864738` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.052679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-327864738)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.053807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.059252 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4025/7993] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/regions/tempest-region-327864738 => generated 178 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.060436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.073984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080837ca-92a6-4618-a2fd-f1164b0af558 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.078953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.079716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.080032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.080400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.081124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.082152 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:51.082152 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:51.082152 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:51.083449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.096444 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3969/7994] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints => generated 4383 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:51.099498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.111646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38afb1-ccea-4796-bae5-4faef8e0d88e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.119883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.121080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.121383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.121783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.128074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=024e9a1de6964e4c95a7b3902781f4e3)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.129221 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:51.129221 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:51.129221 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:51.130650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.133025 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4026/7995] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3 => generated 359 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:51.146191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.158638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11103e-68e5-4a0e-aad4-d877bc53a1ee tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.164406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.165280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.165830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.165830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.167492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=024e9a1de6964e4c95a7b3902781f4e3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.169628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.179675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '024e9a1de6964e4c95a7b3902781f4e3', 'request_id': 'req-8dc81c10-ff3a-440a-9584-02babf84a237'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.191624 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3970/7996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:51 2022] DELETE /identity/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:51.196381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.207531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172e982-d7ea-47f7-9139-8dd9454b7234 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.226869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.227906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.228259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.228580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.229434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.230561 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:51.230561 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:51.230561 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:51.231899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.242464 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4027/7997] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints => generated 4037 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:51.247773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.256252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.258681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:51.265153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81c10-ff3a-440a-9584-02babf84a237 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.272915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.274430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.274803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.275147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.284101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Could not find endpoint: 024e9a1de6964e4c95a7b3902781f4e3.: keystone.exception.EndpointNotFound: Could not find endpoint: 024e9a1de6964e4c95a7b3902781f4e3. Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._iter().one() Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._only_one_row( Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:51.297134 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 024e9a1de6964e4c95a7b3902781f4e3. Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:51.298470 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 21:23:51.299724 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application with Lock( Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._enter() Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.creator() Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application created_value = creator( Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 024e9a1de6964e4c95a7b3902781f4e3. Jun 04 21:23:51.300855 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:51.302333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb405d31-73f6-4c9f-a7be-79102e445cda tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.302440 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3971/7998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:51 2022] DELETE /identity/v3/endpoints/024e9a1de6964e4c95a7b3902781f4e3 => generated 114 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 04 21:23:51.303024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.306678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.307672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.307987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.308250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] PATH_INFO: `/v3/projects/c00e14fc13844afdb92a0e9438c28e20` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.309656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00e14fc13844afdb92a0e9438c28e20)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.311683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.316083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89448c66-c487-4874-9bc9-4446c16234ea tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.322632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.324152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.324457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.324861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-327864738` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.325624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-327864738)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.327644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.350025 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3972/7999] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:23:51 2022] DELETE /identity/v3/regions/tempest-region-327864738 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:51.355347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.381604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446bd95-4763-4f05-bed0-779dc76be8ab tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.382065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00e14fc13844afdb92a0e9438c28e20', 'request_id': 'req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.389715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00e14fc13844afdb92a0e9438c28e20', 'request_id': 'req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.397133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00e14fc13844afdb92a0e9438c28e20', 'request_id': 'req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.412079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] The token cache is being invalidate because project c00e14fc13844afdb92a0e9438c28e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:51.412388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.413075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faabf492-c96c-44a1-9c37-d6dd7bdb1b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:51.415548 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4028/8000] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:51 2022] DELETE /identity/v3/projects/c00e14fc13844afdb92a0e9438c28e20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:51.421120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace6-c087-4a95-9c72-9a015b488db8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.421523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace6-c087-4a95-9c72-9a015b488db8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.421883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1ace6-c087-4a95-9c72-9a015b488db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.444364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89e1ace6-c087-4a95-9c72-9a015b488db8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:51.445899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89e1ace6-c087-4a95-9c72-9a015b488db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:51.454662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.455585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.456018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.456371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.457138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.459139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.472703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3973/8001] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints => generated 4037 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:51.474522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.476886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:51.491818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afe51-12bb-4cbf-9e67-61914b98c1b9 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.497268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.497950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.498240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.498600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.499438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Adding query filter params (service_id=a132cd3e594240bd88963298846a13ad) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:51.499788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.501500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.508800 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3974/8002] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints?service_id=a132cd3e594240bd88963298846a13ad => generated 501 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.513261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.524074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4029/8003] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:51.524917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4154d8-21de-44e8-9524-5bde8244e622 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.531761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.532097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.532329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.533940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.534861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.535263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.535828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.537041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Adding query filter params (service_id=24a276b9b6104ac99848eaef12325923) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:51.538332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.540425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.547856 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3975/8004] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints?service_id=24a276b9b6104ac99848eaef12325923 => generated 503 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.552612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.558603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:51.559882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:51.563994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e37180-cb9c-495f-94b2-bfbdf39422db tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.569583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.571555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4030/8005] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3859 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:51.571703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.571703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.571703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.571945 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:51.572066 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.573894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.574884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.584095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3976/8006] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:51.587450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea430b-1acc-466e-bfea-5b5aa8c0f675 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.588743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.591984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.592730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.593051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.593367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.594215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:51.594528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.596515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.599874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa469da-9dbb-415a-b92a-744338209167 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.604927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.605592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.605894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.606173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.606937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:51.607245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.608887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.611045 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4031/8007] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.615131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3977/8008] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.616381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.620729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.630957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea138-805d-4c60-837b-385ee0fdb6e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.631247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae1411-de78-49f2-a9ab-1e1d34f1f4ad tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.636134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.636803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.636981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.637164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.637381 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.638117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.640234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.640534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.640824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.641103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.642135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.644381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.655761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3978/8009] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/services => generated 288 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:51.659437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:51.660641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.680347 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4032/8010] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/projects => generated 359 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:51.684519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dde6f-4da5-405b-b35b-e10556a0a3cd tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.684850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.693011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:51.749619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.750448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.750761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.751069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.751901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.753885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.755410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba416c3-0bce-4155-8ed8-1875610acad3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.771416 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1155523758. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:51.771416 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:51.771416 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:51.775254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.775977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.776263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.776541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.777274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.779754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.799097 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3979/8011] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/endpoints => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:51.803800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.809171 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4033/8012] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/users => generated 280 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:51.810057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.822146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8f6c-566e-4d59-90b3-d58caac03e8a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.828548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee452aa-4ae8-4040-9d4e-4aae0c9a6a5f tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.834933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.836349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.836778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.837138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-1155523758` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.838144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1155523758)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.839306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.841511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.841893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.842147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.842424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.843156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.843682 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3980/8013] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/regions/tempest-region-1155523758 => generated 180 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:51.844824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.845747 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.856459 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4034/8014] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:51.860619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.861626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a021d-e6d2-44ba-a38a-b88fc146f319 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.867393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.868344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.868704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.868987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/3c284a5e5198431ab4e7c843371e8595` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.873259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef004e-5b32-404f-a747-8ce4f1197d80 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.876070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=3c284a5e5198431ab4e7c843371e8595)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.877989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.879948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.879948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.879948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.880333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.881022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.882655 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.894033 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4035/8015] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:51.894814 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-349310059. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:51.894814 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:51.894814 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:51.898430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.909825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf443-8ca3-4ef8-aec0-60d1e2fc2db5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.930923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3981/8016] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:23:51 2022] PATCH /identity/v3/endpoints/3c284a5e5198431ab4e7c843371e8595 => generated 362 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:51.934867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.935020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.936354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.936639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.936967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] PATH_INFO: `/v3/projects/0d0ca8e624bd483ab5a9bc3302b53e2e/users/48fe167251b348faac855822818348c9/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.954894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0ca8e624bd483ab5a9bc3302b53e2e, user_id=48fe167251b348faac855822818348c9, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.957908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6577997-ab29-407b-a0ee-3d4ce3a3d709 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.958574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d22d4-be8c-4493-b94b-6d7f04f227c6 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.963554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:51.964742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.965078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.965411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-349310059` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:51.966348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-349310059)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:51.967737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:51.970549 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3982/8017] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:23:51 2022] GET /identity/v3/regions/tempest-region-349310059 => generated 178 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:51.974508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:51.974925 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4036/8018] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:51 2022] PUT /identity/v3/projects/0d0ca8e624bd483ab5a9bc3302b53e2e/users/48fe167251b348faac855822818348c9/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:51.985804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:51.986199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05fff-f021-44d7-9ff4-7ca444b47082 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:51.986306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:51.986408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.017355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] MFA Rules not processed for user `48fe167251b348faac855822818348c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:52.018567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.053018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.053795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.054116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.054483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/3c284a5e5198431ab4e7c843371e8595` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.060765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=3c284a5e5198431ab4e7c843371e8595)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.062700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.071160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '3c284a5e5198431ab4e7c843371e8595', 'request_id': 'req-fa06eeb7-aed2-41b7-9115-e7cae455ef46'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.072608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.084015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3983/8019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:51 2022] DELETE /identity/v3/endpoints/3c284a5e5198431ab4e7c843371e8595 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.086696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.088054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.093007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4037/8020] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3988 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:52.121006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eeb7-aed2-41b7-9115-e7cae455ef46 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.127394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.128572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.129204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.129459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.129582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-349310059` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.130738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-349310059)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.131129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.132476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.158235 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3984/8021] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/regions/tempest-region-349310059 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.162920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.190004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792472-6099-4090-bdd1-f45c9ab9c31c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.196707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.197705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.198074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.198276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-1155523758` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.199086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1155523758)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.201023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.210114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a891aa-71f7-4468-bb5f-7de32e2255b1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.223672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3985/8022] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/regions/tempest-region-1155523758 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:52.226527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.227189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.227764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.227764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.228782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.237856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.239706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.252042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55f7b6-990d-4427-8710-4982530b771e tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.257957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.259003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.259293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.259655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services/d034dc7113cc4bcfa927bf9bff384d59` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.260591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d034dc7113cc4bcfa927bf9bff384d59)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.262732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.263553 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4038/8023] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3988 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:52.279994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.292006 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3986/8024] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/services/d034dc7113cc4bcfa927bf9bff384d59 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.297803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.320677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137ab3-904c-43c7-925c-b4a28e11f5aa tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.326546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.327599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.328024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.328352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/fac72594ef7a40ba99df1c155712c4cf` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.334592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fac72594ef7a40ba99df1c155712c4cf)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.336774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.347465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fac72594ef7a40ba99df1c155712c4cf', 'request_id': 'req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.361598 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3987/8025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/endpoints/fac72594ef7a40ba99df1c155712c4cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.366898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.378755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384855f-b687-4e51-88c6-ba0a501bc6f5 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.395854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.396508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb8fcb-9f44-4fa7-9f1b-fb91c3de463b tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.396868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.397150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.397421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] PATH_INFO: `/v3/users/48fe167251b348faac855822818348c9` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.398733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fe167251b348faac855822818348c9)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.400849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.403386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.404428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.404744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.405065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-985706930` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.406002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-985706930)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.407908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.426177 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-985706930. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:52.426177 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:52.426177 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:52.436433 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3988/8026] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/regions/tempest-region-985706930 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.440493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.454274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fe167251b348faac855822818348c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.461767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43d4ac-12f2-42be-aaed-27617ebaea0c tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.462961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fe167251b348faac855822818348c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.463747 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fe167251b348faac855822818348c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.464367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fe167251b348faac855822818348c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.466283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.466569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.467462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.467855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.468409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services/24a276b9b6104ac99848eaef12325923` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.468817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_service(service_id=24a276b9b6104ac99848eaef12325923)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.470425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.479373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-37b81eb8-ab4c-4640-adac-82ebe650a596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fe167251b348faac855822818348c9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.493666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3989/8027] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/services/24a276b9b6104ac99848eaef12325923 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.495121 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4039/8028] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/users/48fe167251b348faac855822818348c9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.497997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.499544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.499691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.500481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.500780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.519142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:52.520370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.523472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3033-486f-477d-aded-23d8d3465805 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.532976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=10,keystone:SELECT=90 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.585816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.586637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.586928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.587211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/endpoints/a6b8ac02256a45f9a4f591c42b49e654` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.593077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a6b8ac02256a45f9a4f591c42b49e654)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.594943 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4040/8029] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3544 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:52.595671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.605399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a6b8ac02256a45f9a4f591c42b49e654', 'request_id': 'req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.606200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.608135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.620140 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3990/8030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/endpoints/a6b8ac02256a45f9a4f591c42b49e654 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.621276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.645499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3edc6-6e97-4e08-9cfb-bd2c501e1cc3 tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.651322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.652237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.652524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.653155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/regions/tempest-region-618739862` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.653561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-618739862)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.655317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.668178 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-618739862. To ensure interoperability, identifiers should be a valid uuid. Jun 04 21:23:52.668178 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 04 21:23:52.668178 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:52.675477 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3991/8031] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/regions/tempest-region-618739862 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.679553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.701083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66924-a81a-4caf-a39e-a73e1ecbcafb tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.703309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed4f25-3c01-42b7-88c8-37cc1b6cb636 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.706233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55598dc6294f493b8f95d51f5ab7d680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef250790de56405ca775825481ad59ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.707097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.707384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.707702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] PATH_INFO: `/v3/services/a132cd3e594240bd88963298846a13ad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.708385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a132cd3e594240bd88963298846a13ad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.710039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.717283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.717976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.718261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.718539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.729221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.730686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464ace-f933-4a11-9113-64ab4cf27344 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.732617 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3992/8032] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/services/a132cd3e594240bd88963298846a13ad => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.742752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.744603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.751735 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4041/8033] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:23:52.770272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369217-3e52-4a74-8285-22b2cb1a24be tempest-EndPointsTestJSON-15726098 tempest-EndPointsTestJSON-15726098-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:52.775750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:52.776677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.776946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.777225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] PATH_INFO: `/v3/users/c85fe307082247eb923d7ba66ac32876` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.778422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85fe307082247eb923d7ba66ac32876)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:52.780426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:52.829285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85fe307082247eb923d7ba66ac32876'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.830154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85fe307082247eb923d7ba66ac32876'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.837625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85fe307082247eb923d7ba66ac32876'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.838226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85fe307082247eb923d7ba66ac32876'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.851103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85fe307082247eb923d7ba66ac32876'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:52.854879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.867194 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3993/8034] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:52 2022] DELETE /identity/v3/users/c85fe307082247eb923d7ba66ac32876 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:52.871690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:52.872019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:52.872303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:52.891269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:52.893296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:52.948927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:52.971327 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4042/8035] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:52.981605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:52.983427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.047839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.049417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.059028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f5667-b77b-4d65-b954-3032b838948a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.065236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980887-d55c-48c3-8a61-063e142774a3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.067152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.068133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.068496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.069488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.071979 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.072874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.073161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.073441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] PATH_INFO: `/v3/projects/0d0ca8e624bd483ab5a9bc3302b53e2e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.074819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0ca8e624bd483ab5a9bc3302b53e2e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.076930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.080884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.082327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227822d-eb40-4f04-9f1d-4cd7a3910549 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.094094 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3994/8036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:53.131071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0ca8e624bd483ab5a9bc3302b53e2e', 'request_id': 'req-f733eb00-64ef-451f-9efa-5f8c896e49c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.137444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0ca8e624bd483ab5a9bc3302b53e2e', 'request_id': 'req-f733eb00-64ef-451f-9efa-5f8c896e49c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.143673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0ca8e624bd483ab5a9bc3302b53e2e', 'request_id': 'req-f733eb00-64ef-451f-9efa-5f8c896e49c0'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.158126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] The token cache is being invalidate because project 0d0ca8e624bd483ab5a9bc3302b53e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:53.158445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.159104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f733eb00-64ef-451f-9efa-5f8c896e49c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.161274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4043/8037] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:53 2022] DELETE /identity/v3/projects/0d0ca8e624bd483ab5a9bc3302b53e2e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:53.166433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.166727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.167046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.186829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:53.188129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.260970 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3995/8038] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:53.268936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016576-042e-4278-891b-97c71d595191 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.269448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016576-042e-4278-891b-97c71d595191 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.269448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016576-042e-4278-891b-97c71d595191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.288368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-87016576-042e-4278-891b-97c71d595191 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:53.289624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-87016576-042e-4278-891b-97c71d595191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.297862 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4044/8039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:53.302193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.312795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b97b-aa7e-4a99-90cf-3d789cdfb7e5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.317709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.318454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.318735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.319004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.319764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:53.320071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.321689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.339475 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3996/8040] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:53.342281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016576-042e-4278-891b-97c71d595191 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.352186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016576-042e-4278-891b-97c71d595191 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.357405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.358940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.359258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.359560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.360251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.362344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.384859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.386849 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.395815 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4045/8041] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:53 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:53.399789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.404955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547601a0-a94e-4fd5-849b-b0a9e337935e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.466382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.467260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.467626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.467910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] PATH_INFO: `/v3/projects/4248a8c03ccf4b04a8b0352f37e617d6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.469141 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4248a8c03ccf4b04a8b0352f37e617d6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.469656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fee2a-9220-47cd-badc-bdad82e95d50 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.471148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.474792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.475462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.475774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.476048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.476733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.478640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.494608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:53.502350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4046/8042] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:53 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:53.506720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.518188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e53dd-121c-44c6-81d5-c4c4aeb82c14 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.523928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4248a8c03ccf4b04a8b0352f37e617d6', 'request_id': 'req-bce871f8-03fe-40b0-b95a-5cbf8208d38e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.530154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4248a8c03ccf4b04a8b0352f37e617d6', 'request_id': 'req-bce871f8-03fe-40b0-b95a-5cbf8208d38e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.536246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4248a8c03ccf4b04a8b0352f37e617d6', 'request_id': 'req-bce871f8-03fe-40b0-b95a-5cbf8208d38e'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.544748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:53.551698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] The token cache is being invalidate because project 4248a8c03ccf4b04a8b0352f37e617d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:53.552160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.552866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.554570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3997/8043] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:53 2022] DELETE /identity/v3/projects/4248a8c03ccf4b04a8b0352f37e617d6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:53.558663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.560526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.577769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.578457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.578743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.579021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.579784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.581411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.594972 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4047/8044] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:23:53.596039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.597770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.610365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732b4e-06da-4938-8e62-f58b0cf43db6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.615097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.615820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.616105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.616379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.617127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.618723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.624712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce871f8-03fe-40b0-b95a-5cbf8208d38e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.631959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4048/8045] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:53.632166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.632166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.632166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.632166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] PATH_INFO: `/v3/users/55598dc6294f493b8f95d51f5ab7d680` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.632931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55598dc6294f493b8f95d51f5ab7d680)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.637834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.638002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.647888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138635-774e-44d5-bcf5-2bc1df35806e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.652809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.653757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.654103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.654387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] PATH_INFO: `/v3/projects/704bfcd03a884c3a89a011644bcbf4ec/users/52894cd22b0642ee853fa2b53c9e04ea/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.670527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=704bfcd03a884c3a89a011644bcbf4ec, user_id=52894cd22b0642ee853fa2b53c9e04ea, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.673260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a798a-ca5c-4b91-b84c-8aa9500eaccf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.688177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4049/8046] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:53 2022] PUT /identity/v3/projects/704bfcd03a884c3a89a011644bcbf4ec/users/52894cd22b0642ee853fa2b53c9e04ea/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:53.693144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55598dc6294f493b8f95d51f5ab7d680'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.693841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55598dc6294f493b8f95d51f5ab7d680'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.697991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.698275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.698555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.701171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55598dc6294f493b8f95d51f5ab7d680'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.701861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55598dc6294f493b8f95d51f5ab7d680'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.713695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55598dc6294f493b8f95d51f5ab7d680'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:53.724933 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] MFA Rules not processed for user `52894cd22b0642ee853fa2b53c9e04ea`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:53.726163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.727496 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3998/8047] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:53 2022] DELETE /identity/v3/users/55598dc6294f493b8f95d51f5ab7d680 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:53.797453 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4050/8048] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:53.809720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:53.811176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:53.844140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:53.887879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfc63f-ad3f-4784-804c-15f64fd5c78f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:53.893311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:53.894036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:53.894292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:53.894578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:53.904856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:53.906458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17a38d-a8cd-4277-a566-98f56dcb111e service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:53.916018 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 3999/8049] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:23:54.022898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.024615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:54.096125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c609c2-19ad-4a75-b361-54b828884427 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.101117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.102182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.102525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.102862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] PATH_INFO: `/v3/projects/ef250790de56405ca775825481ad59ba` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.104170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef250790de56405ca775825481ad59ba)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.106228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.129563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:54.155244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef250790de56405ca775825481ad59ba', 'request_id': 'req-af6e3433-138f-4dbe-8a05-3de6e4216dee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:54.161593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef250790de56405ca775825481ad59ba', 'request_id': 'req-af6e3433-138f-4dbe-8a05-3de6e4216dee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:54.167959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef250790de56405ca775825481ad59ba', 'request_id': 'req-af6e3433-138f-4dbe-8a05-3de6e4216dee'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:54.182434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] The token cache is being invalidate because project ef250790de56405ca775825481ad59ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:54.182868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:54.183532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-af6e3433-138f-4dbe-8a05-3de6e4216dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:54.185128 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4051/8050] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:54 2022] DELETE /identity/v3/projects/ef250790de56405ca775825481ad59ba => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:54.190224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.190539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.190828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.210842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:54.212264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:54.275772 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4000/8051] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:54.283749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.284259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.284388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.305001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:54.306302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:54.315880 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4052/8052] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:54.320496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.331729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ebbc3-afb5-464e-bbf2-11523fae5c9b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.336691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.337400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.337688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.337970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.338707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:54.339016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.340663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.354082 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4001/8053] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:54.359397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.370410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c878c0-a324-4d08-b2b9-c1b408634b36 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.376857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.377517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.378025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.378147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.378782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.380962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.411546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4053/8054] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:54.415585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.426181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732435-aae4-4880-ae13-61a861875ed4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.485936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.486620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.486908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.487185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.487906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.489912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.512768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4002/8055] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:54.517037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.528323 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181031-1477-48a3-a9c2-49bc14080338 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.533713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.534386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.534677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.534959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.535732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.537429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.549066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4054/8056] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:54.553987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.567191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec616f-2cf9-4130-9c5a-ca4554ec4487 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.572376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.573092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.573378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.573682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.574418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.576268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27802d-9836-47d1-b111-261b03c908d5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.588621 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4003/8057] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:54.592932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.604353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0571-8fb9-4b4f-b96f-e0c0d98651dc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.609322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.610272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.610555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.610835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] PATH_INFO: `/v3/projects/fb848a78645349daba05b7b06a2d7b9d/users/ca7a8863252744ccaf3e327b197ec159/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.626831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb848a78645349daba05b7b06a2d7b9d, user_id=ca7a8863252744ccaf3e327b197ec159, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.629590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.645486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4055/8058] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:54 2022] PUT /identity/v3/projects/fb848a78645349daba05b7b06a2d7b9d/users/ca7a8863252744ccaf3e327b197ec159/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:54.656715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.657229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.657229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.685225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] MFA Rules not processed for user `ca7a8863252744ccaf3e327b197ec159`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:54.686561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:54.701268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:54.762297 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4004/8059] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:54.767488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.845428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d1bcf-b28f-4c73-83f7-972029506134 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.851741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.852407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.852689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.852967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.853689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.855656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.885073 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4056/8060] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:54.889652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:54.902221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46aa7c-5b9a-4651-9410-972b5c087a15 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:54.963992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:54.964659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:54.964941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:54.965217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:54.966005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:54.967944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:54.990003 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4005/8061] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:54 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:54.994654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.009440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1fa5e-5522-4a54-9848-f04aeafec701 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.015066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.015776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.016065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.016348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.017090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.018712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.029748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4057/8062] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:55.034001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.044845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bff1e-58ce-4d85-9b29-2162fb8c3c87 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.050516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.051402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.051728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.052075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] PATH_INFO: `/v3/projects/f67c5054078c4f0d91d5403af22b39c8/users/8c01974ef0f94277a26912aa02cb10e5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.068279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67c5054078c4f0d91d5403af22b39c8, user_id=8c01974ef0f94277a26912aa02cb10e5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.070815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.085983 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4006/8063] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:55 2022] PUT /identity/v3/projects/f67c5054078c4f0d91d5403af22b39c8/users/8c01974ef0f94277a26912aa02cb10e5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:55.090586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.107355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca72e-ef2c-4695-a423-26bb8997aee7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.131538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:55.174790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.175386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.175697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.175975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.176695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.178539 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609ab9-053a-4a4e-9839-783d5dd2088d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.188248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4058/8064] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:55.192676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.202961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf768756-67a3-474f-8340-8ab41c2cbffc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.207968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.208919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.209201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.209480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] PATH_INFO: `/v3/projects/f67c5054078c4f0d91d5403af22b39c8/users/8c01974ef0f94277a26912aa02cb10e5/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.211472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67c5054078c4f0d91d5403af22b39c8, user_id=8c01974ef0f94277a26912aa02cb10e5, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.214128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.226851 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4007/8065] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:55 2022] PUT /identity/v3/projects/f67c5054078c4f0d91d5403af22b39c8/users/8c01974ef0f94277a26912aa02cb10e5/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:55.238392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.238684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.238961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.267391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] MFA Rules not processed for user `8c01974ef0f94277a26912aa02cb10e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:55.268628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:55.348567 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4059/8066] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:55.353986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.365507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caf0ec-e1e5-4187-a8d0-a4b016ad777a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.371120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.371788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.372077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.372351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.373075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.374135 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.374135 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:55.374135 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:55.375026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.392786 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4008/8067] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Jun 4 21:23:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:55.397364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.407574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d4d0-b986-4cc0-8ade-5f86f756e9c1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.413319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.414154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.414441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.414730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/143c09a586e1460ebff1d4334a30bd8a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.415387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=143c09a586e1460ebff1d4334a30bd8a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.416425 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.416425 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:55.416425 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:55.417300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.425345 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4060/8068] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:23:55 2022] GET /identity/v3/OS-OAUTH1/consumers/143c09a586e1460ebff1d4334a30bd8a => generated 220 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:55.430308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.440427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6c1b5-4988-4834-84ae-1e4f4041b2c8 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.447398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.448278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.448563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.448838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/143c09a586e1460ebff1d4334a30bd8a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.449481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=143c09a586e1460ebff1d4334a30bd8a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.450507 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.450507 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:55.450507 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:55.451400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.451683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer 143c09a586e1460ebff1d4334a30bd8a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:55.451956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.452725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.473222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '143c09a586e1460ebff1d4334a30bd8a', 'request_id': 'req-d20d7418-17ab-446e-9846-a5c1dd615256'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.488266 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4009/8069] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/143c09a586e1460ebff1d4334a30bd8a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:55.493422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.495465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:55.509031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1a5f-b2e2-462e-a13d-738a2b0c8850 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.514085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.515061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.515346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.515671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.516478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.517460 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.517460 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:55.517460 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:55.518337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.535392 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4061/8070] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Jun 4 21:23:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:55.539577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.549996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7418-17ab-446e-9846-a5c1dd615256 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.555818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.556688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.556984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.557231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.557890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=95956e389ca74892a0a34b36ac057163)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.558909 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.558909 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:55.558909 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:55.559817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.564932 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4010/8071] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:23:55 2022] GET /identity/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163 => generated 220 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:55.569686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.582026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bcb50-19ee-4615-ae26-fbf2a4a6df69 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.588575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.589422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.589707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.589984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.590650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=95956e389ca74892a0a34b36ac057163)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.591723 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.591723 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:55.591723 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:55.592609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.592875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer 95956e389ca74892a0a34b36ac057163 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:55.593161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.593920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.613592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '95956e389ca74892a0a34b36ac057163', 'request_id': 'req-46144edd-1937-4c25-abe5-ab9d2ad4f3be'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.630696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4062/8072] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:55.635626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.638615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:55.658871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6697366-5ab7-4bc4-8a7d-8a2fc24784a5 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.665693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.666851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.667163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.667484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.668377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=95956e389ca74892a0a34b36ac057163)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.670285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jun 04 21:23:55.695194 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 04 21:23:55.696517 ncdv-master-1 devstack@keystone.service[97804]: ERROR keystone.server.flask.application Jun 04 21:23:55.697350 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4011/8073] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:23:55 2022] GET /identity/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163 => generated 74 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:23:55.700863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.713181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144edd-1937-4c25-abe5-ab9d2ad4f3be tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.720081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.721209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.721606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.721999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.723077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=95956e389ca74892a0a34b36ac057163)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.726401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.726841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer 95956e389ca74892a0a34b36ac057163 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:55.727276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.728277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jun 04 21:23:55.757153 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: ERROR keystone.server.flask.application Jun 04 21:23:55.758507 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4063/8074] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/95956e389ca74892a0a34b36ac057163 => generated 74 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 21:23:55.764645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.766652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:55.781803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455762-bf39-40e1-8436-b11b0e719aaf tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.786560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.787251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.787679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.787960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.788699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.790350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.804478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:55.815754 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4012/8075] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Jun 4 21:23:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:55.816565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.828451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa0b4-e61d-44a6-a86c-24ea34487dc7 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.834429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.835214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.835643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.835941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.836673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.838280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.853573 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4064/8076] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Jun 4 21:23:55 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:55.857868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.869896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966070f2-4ad0-420f-b19a-6ab036cdf588 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.875899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.876637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.876967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.877347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.878173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.879204 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:55.879204 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:55.879204 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:55.881135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.887794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4013/8077] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Jun 4 21:23:55 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:55.892615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.904105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4af62-e544-47df-9c67-f0719ed3751f tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.909417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.910268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.910627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.911016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6f555b24fffe4fd6b19c792c2e35201f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.911816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6f555b24fffe4fd6b19c792c2e35201f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.913430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.913703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer 6f555b24fffe4fd6b19c792c2e35201f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:55.914110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.914800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.926220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6f555b24fffe4fd6b19c792c2e35201f', 'request_id': 'req-df6022e5-e14a-485b-87f2-08ff842e3c23'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.936242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:55.942403 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4065/8078] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6f555b24fffe4fd6b19c792c2e35201f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:55.946752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:55.948557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:55.962807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23094c1-aaa4-482c-a295-334534151f41 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:55.967752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:55.968488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:55.968771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:55.969045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4dcc8699851a4e1e9f545c5e93edd49f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:55.969697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4dcc8699851a4e1e9f545c5e93edd49f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:55.971286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:55.971588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer 4dcc8699851a4e1e9f545c5e93edd49f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:55.971868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.972518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:55.985481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4dcc8699851a4e1e9f545c5e93edd49f', 'request_id': 'req-8eb4e0c4-20c5-444f-8134-b2beeb582a25'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.002132 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4014/8079] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:55 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4dcc8699851a4e1e9f545c5e93edd49f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:56.007451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.018746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6022e5-e14a-485b-87f2-08ff842e3c23 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.024127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.024775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.025067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.025350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.026084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.027762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.042863 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4066/8080] 10.222.0.18 () {60 vars in 1184 bytes} [Sat Jun 4 21:23:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:56.047031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.048493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:56.062244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e0c4-20c5-444f-8134-b2beeb582a25 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.067062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.068428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.068714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.068996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.069728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=d3b6f5a451d34c518e76c443f1084b62)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.070744 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:56.070744 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:56.070744 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:56.071667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.088982 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4015/8081] 10.222.0.18 () {60 vars in 1284 bytes} [Sat Jun 4 21:23:56 2022] PATCH /identity/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62 => generated 221 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:56.093174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.105039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5c61-0be7-4e4b-a3cf-da132af5fef3 tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.110075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.110905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.111190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.111465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.112165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d3b6f5a451d34c518e76c443f1084b62)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.113835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.118722 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4067/8082] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:23:56 2022] GET /identity/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62 => generated 221 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:56.124788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.142270 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748047-e406-43f7-b68b-012cc471077c tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.149521 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c01974ef0f94277a26912aa02cb10e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f67c5054078c4f0d91d5403af22b39c8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.150348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.150634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.150906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.151614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d3b6f5a451d34c518e76c443f1084b62)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.153201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.153465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invalidating token cache because consumer d3b6f5a451d34c518e76c443f1084b62 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:56.153739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.154514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.168237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd3b6f5a451d34c518e76c443f1084b62', 'request_id': 'req-3bd85e58-ddc7-4541-a4bd-1ec9cde2035b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.184345 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4016/8083] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:23:56 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d3b6f5a451d34c518e76c443f1084b62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:56.189587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.192409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:56.262572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55797-f7d7-4c13-bcef-ac48ce9d004b tempest-OAUTHConsumersV3Test-2012674539 tempest-OAUTHConsumersV3Test-2012674539-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.267856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.268725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.269003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.269285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] PATH_INFO: `/v3/users/ca7a8863252744ccaf3e327b197ec159` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.270505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7a8863252744ccaf3e327b197ec159)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.272604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.329855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7a8863252744ccaf3e327b197ec159'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.336643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7a8863252744ccaf3e327b197ec159'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.337307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7a8863252744ccaf3e327b197ec159'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.337892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7a8863252744ccaf3e327b197ec159'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.350199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7a8863252744ccaf3e327b197ec159'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.364746 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4068/8084] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:56 2022] DELETE /identity/v3/users/ca7a8863252744ccaf3e327b197ec159 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:56.369370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.369763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.370046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.389016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:56.390642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:56.452655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4017/8085] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:56.466893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.468495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:56.532060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43bbad-caff-4993-87c1-3f30702bb76e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.535855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.536573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.536866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.537168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.547025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.548513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.553581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:56.563952 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4069/8086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:23:56.892367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:56.893610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:56.909573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b31a-d824-4667-b16b-c69c3a52fe1e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:56.915337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:56.916322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:56.916562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:56.916858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] PATH_INFO: `/v3/projects/fb848a78645349daba05b7b06a2d7b9d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:56.918121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb848a78645349daba05b7b06a2d7b9d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:56.920342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:56.971620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb848a78645349daba05b7b06a2d7b9d', 'request_id': 'req-608e62f5-5134-4ec5-8682-562d1eab523d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.979125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb848a78645349daba05b7b06a2d7b9d', 'request_id': 'req-608e62f5-5134-4ec5-8682-562d1eab523d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.986044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb848a78645349daba05b7b06a2d7b9d', 'request_id': 'req-608e62f5-5134-4ec5-8682-562d1eab523d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:56.999542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] The token cache is being invalidate because project fb848a78645349daba05b7b06a2d7b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:56.999829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.000438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.002653 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4018/8087] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:56 2022] DELETE /identity/v3/projects/fb848a78645349daba05b7b06a2d7b9d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:57.006731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.018259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8c1a-226d-4ff7-8025-bacda30e4e95 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:57.087122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:57.087975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.088262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.088541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] PATH_INFO: `/v3/users/8c01974ef0f94277a26912aa02cb10e5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.089942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c01974ef0f94277a26912aa02cb10e5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:57.091947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:57.145183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c01974ef0f94277a26912aa02cb10e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.153635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c01974ef0f94277a26912aa02cb10e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.154403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c01974ef0f94277a26912aa02cb10e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.155117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c01974ef0f94277a26912aa02cb10e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.168985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c94f8e63-ac6c-4fb8-bfc6-6a4969df2036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c01974ef0f94277a26912aa02cb10e5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.184468 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4070/8088] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:57 2022] DELETE /identity/v3/users/8c01974ef0f94277a26912aa02cb10e5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:57.486149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.487798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:57.498211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:57.503285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e62f5-5134-4ec5-8682-562d1eab523d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:57.567290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:57.568788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.569076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.569343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] PATH_INFO: `/v3/projects/f67c5054078c4f0d91d5403af22b39c8` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.570593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67c5054078c4f0d91d5403af22b39c8)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:57.572555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:57.622418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67c5054078c4f0d91d5403af22b39c8', 'request_id': 'req-457bb06f-48b0-4619-bfdb-2db387811f07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.628432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67c5054078c4f0d91d5403af22b39c8', 'request_id': 'req-457bb06f-48b0-4619-bfdb-2db387811f07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.634422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67c5054078c4f0d91d5403af22b39c8', 'request_id': 'req-457bb06f-48b0-4619-bfdb-2db387811f07'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.649280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] The token cache is being invalidate because project f67c5054078c4f0d91d5403af22b39c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:23:57.649574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.650198 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-457bb06f-48b0-4619-bfdb-2db387811f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:57.651822 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4019/8089] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:57 2022] DELETE /identity/v3/projects/f67c5054078c4f0d91d5403af22b39c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:57.657185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.657648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.657759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.675472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:57.676880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:57.736588 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4071/8090] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:23:57.744746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.745032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.745310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.764744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:57.765953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:57.776341 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4020/8091] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:57.781043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.791541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7477-4300-4388-a809-b33a7fd6335e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:57.796807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:57.797464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.797748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.798007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.798754 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:23:57.799065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:57.800721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:57.816942 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4072/8092] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:57.822433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.832614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8da6e-ed56-492f-a42c-309cd95ba34f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:57.839181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:57.839913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.840193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.840466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.841162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:57.843099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:57.877895 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4021/8093] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:57 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:57.879151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.891735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554adc1-127d-4792-8117-6586ff0ac794 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:57.896029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:57.953129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:57.953795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:57.954077 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:57.954347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:57.955028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:57.957024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:57.979486 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4073/8094] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:57 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:57.983786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:57.995372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806e0b8-2ff5-44e3-a339-b38d3988b3cf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.001215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.001919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.002225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.002485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.003222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.004900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.016490 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4022/8095] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:58.022087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.032986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f164f-60a8-4a99-8e4b-46dbd2aa822a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.038399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.039147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.039429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.039736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.040462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.042069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5865d51-3940-40d9-a528-9978d7ed6aa7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.053311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4074/8096] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:58.057967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.069566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65611a8-ffea-49ea-95b2-3a78982d42fd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.075962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.076862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.077138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.077414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] PATH_INFO: `/v3/projects/219be543c4bd4557bdc005d8d0f2b0ac/users/22df63167186411aaffc8f39e8cdae30/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.095433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219be543c4bd4557bdc005d8d0f2b0ac, user_id=22df63167186411aaffc8f39e8cdae30, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.098277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.115301 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4023/8097] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:58 2022] PUT /identity/v3/projects/219be543c4bd4557bdc005d8d0f2b0ac/users/22df63167186411aaffc8f39e8cdae30/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:58.125774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.126070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.126380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.157515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] MFA Rules not processed for user `22df63167186411aaffc8f39e8cdae30`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:58.158748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:58.241141 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4075/8098] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:58.247072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.292558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:58.329310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c840-e877-4274-bfe5-f0e18c325151 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.335611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.336318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.336723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.337031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.337903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.340223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.373655 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4024/8099] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:23:58 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:58.378835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.391449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b68b-4ecc-47bf-a614-f268f5e4f64b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.459456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.460486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.460615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.461131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.461845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.464176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.486557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4076/8100] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:23:58 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:58.490656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.501554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d46ca-43e1-49d4-80fa-8d4bd92a61ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.506800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.507538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.507827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.508107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.508847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.510458 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.521723 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4025/8101] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:58.526197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.534876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:58.537793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4472d5-6ce4-4113-a626-26378a334a63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.544660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.545624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.545917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.546199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] PATH_INFO: `/v3/projects/10a7055de32142bfa393b4522318c1c0/users/7698e4870d1644689a8bf80a0e537011/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.562861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7055de32142bfa393b4522318c1c0, user_id=7698e4870d1644689a8bf80a0e537011, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.565574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.581416 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4077/8102] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:58 2022] PUT /identity/v3/projects/10a7055de32142bfa393b4522318c1c0/users/7698e4870d1644689a8bf80a0e537011/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:58.586014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.596810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf13ed-c76a-4532-b91d-de476aa2985b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.654910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.655612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.655894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.656167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.656882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.658478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69645b-64aa-4336-bb09-358d1099c508 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.668656 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4026/8103] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:23:58.675064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.688880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664c7f7-d220-438d-98c3-277e5212eb0f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.696106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.697033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.697367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.697603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] PATH_INFO: `/v3/projects/10a7055de32142bfa393b4522318c1c0/users/7698e4870d1644689a8bf80a0e537011/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.699915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7055de32142bfa393b4522318c1c0, user_id=7698e4870d1644689a8bf80a0e537011, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.702812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.713598 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4078/8104] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:23:58 2022] PUT /identity/v3/projects/10a7055de32142bfa393b4522318c1c0/users/7698e4870d1644689a8bf80a0e537011/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:58.725082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.725390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.725679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.753825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] MFA Rules not processed for user `7698e4870d1644689a8bf80a0e537011`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:58.755050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:58.838215 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4027/8105] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:58.843922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.855974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd46eb-4acf-48ef-b08c-446cb5bb9e0a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.861065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.861760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.862050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.862337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.863336 ncdv-master-1 devstack@keystone.service[97803]: WARNING oslo_log.versionutils [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:58.863901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.865607 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:58.865607 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:58.865607 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:58.866098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.891663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4079/8106] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:23:58 2022] POST /identity/v3/policies => generated 230 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:58.892850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.902494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64529d3-65ba-4dcf-8e14-530a03159f33 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.907398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.908324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.908596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.908878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/ee07d46b764043a2901c5ad392a83984` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.909883 ncdv-master-1 devstack@keystone.service[97804]: WARNING oslo_log.versionutils [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:58.910416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=ee07d46b764043a2901c5ad392a83984)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.911780 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:58.911780 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:58.911780 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:58.912769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.938462 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4028/8107] 10.222.0.18 () {60 vars in 1251 bytes} [Sat Jun 4 21:23:58 2022] PATCH /identity/v3/policies/ee07d46b764043a2901c5ad392a83984 => generated 236 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:58.940036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.951579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57374c6b-abdd-43d2-950c-c52078ab61f9 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.957066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.957925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.958208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.958642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/ee07d46b764043a2901c5ad392a83984` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.959590 ncdv-master-1 devstack@keystone.service[97803]: WARNING oslo_log.versionutils [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:58.960226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=ee07d46b764043a2901c5ad392a83984)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:58.961538 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:58.961538 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:58.961538 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:58.962425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:58.973219 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4080/8108] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:23:58 2022] GET /identity/v3/policies/ee07d46b764043a2901c5ad392a83984 => generated 236 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:23:58.977870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:58.990036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ca3e1-370f-459d-8a31-a5d1df7f4033 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:58.997605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:58.998491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:58.998782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:58.999062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/ee07d46b764043a2901c5ad392a83984` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:58.999919 ncdv-master-1 devstack@keystone.service[97804]: WARNING oslo_log.versionutils [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:59.000506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ee07d46b764043a2901c5ad392a83984)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.002150 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:59.002150 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:59.002150 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:59.002664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.008730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:59.025064 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4029/8109] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:58 2022] DELETE /identity/v3/policies/ee07d46b764043a2901c5ad392a83984 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:59.030261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.041093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973fa18-e6a1-4f89-991c-bc68c4e8106b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.045871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.046537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.046832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.047125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.048398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.050279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.070227 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4081/8110] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:23:59 2022] POST /identity/v3/policies => generated 229 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:59.074034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.086501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f80a-d903-4867-a420-a0e3cf84c09b tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.092287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.092954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.093242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.093522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.094453 ncdv-master-1 devstack@keystone.service[97804]: WARNING oslo_log.versionutils [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:59.094992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.096272 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:59.096272 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:59.096272 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:59.097221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.118784 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4030/8111] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:23:59 2022] POST /identity/v3/policies => generated 229 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:23:59.123832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.135983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a27b1-bdfd-4c87-a7dd-4daa7cf96207 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.141450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.142174 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.142465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.142751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.144024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.146058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.164002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4082/8112] 10.222.0.18 () {60 vars in 1151 bytes} [Sat Jun 4 21:23:59 2022] POST /identity/v3/policies => generated 230 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:23:59.168348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.180542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8eab3-7ecd-4474-9501-be6fa26f175f tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.187175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.187957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.188449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.188822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.189766 ncdv-master-1 devstack@keystone.service[97804]: WARNING oslo_log.versionutils [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:59.190442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.191647 ncdv-master-1 devstack@keystone.service[97804]: WARNING py.warnings [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:59.191647 ncdv-master-1 devstack@keystone.service[97804]: warnings.warn(msg) Jun 04 21:23:59.191647 ncdv-master-1 devstack@keystone.service[97804]: Jun 04 21:23:59.192552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.203928 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4031/8113] 10.222.0.18 () {58 vars in 1130 bytes} [Sat Jun 4 21:23:59 2022] GET /identity/v3/policies => generated 764 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:23:59.208159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.220202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5230b-4789-42a9-b317-f29b21201c49 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.226249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.227236 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.227734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.228051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/7093333a3801462585545940993bf61e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.229010 ncdv-master-1 devstack@keystone.service[97803]: WARNING oslo_log.versionutils [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 04 21:23:59.229649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=7093333a3801462585545940993bf61e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.231175 ncdv-master-1 devstack@keystone.service[97803]: WARNING py.warnings [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:23:59.231175 ncdv-master-1 devstack@keystone.service[97803]: warnings.warn(msg) Jun 04 21:23:59.231175 ncdv-master-1 devstack@keystone.service[97803]: Jun 04 21:23:59.232252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.250774 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4083/8114] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:59 2022] DELETE /identity/v3/policies/7093333a3801462585545940993bf61e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:59.255153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.275628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561a035-1941-45ab-9871-57f125ee0e35 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.275628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.275628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.276064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.276064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/8e9f53edceb24d3c8db92a27e292bc1b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.276472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8e9f53edceb24d3c8db92a27e292bc1b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.278310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.294083 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4032/8115] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:59 2022] DELETE /identity/v3/policies/8e9f53edceb24d3c8db92a27e292bc1b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:59.298813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.311220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b2996-5894-418d-8680-d9d513128fe3 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.317213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7698e4870d1644689a8bf80a0e537011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10a7055de32142bfa393b4522318c1c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.318390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.318808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.319103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] PATH_INFO: `/v3/policies/1059b15b8411455989be2e8ac8e459cb` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.320298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1059b15b8411455989be2e8ac8e459cb)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.322158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03cf7a-547d-4373-a5f7-f75808771c3e tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.338726 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4084/8116] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:23:59 2022] DELETE /identity/v3/policies/1059b15b8411455989be2e8ac8e459cb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:23:59.344577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.424133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dda192-7319-4ea6-ade7-5f4dcdba67a2 tempest-PoliciesTestJSON-76459460 tempest-PoliciesTestJSON-76459460-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.430225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.431227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.431538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.431823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] PATH_INFO: `/v3/users/22df63167186411aaffc8f39e8cdae30` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.433032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22df63167186411aaffc8f39e8cdae30)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.435004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.483386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22df63167186411aaffc8f39e8cdae30'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:59.484204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22df63167186411aaffc8f39e8cdae30'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:59.491896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22df63167186411aaffc8f39e8cdae30'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:59.492685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22df63167186411aaffc8f39e8cdae30'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:59.505337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22df63167186411aaffc8f39e8cdae30'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:23:59.520944 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4033/8117] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:23:59 2022] DELETE /identity/v3/users/22df63167186411aaffc8f39e8cdae30 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:23:59.526380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.526682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.526964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.545531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:23:59.547087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:59.613443 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4085/8118] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:23:59.623494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:23:59.625231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:23:59.678374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:59.699225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e54f0c-18f7-4469-819a-fb3149caa330 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:23:59.703721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:23:59.704378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:23:59.704664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:23:59.704942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:23:59.714877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:23:59.716358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:23:59.726206 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4034/8119] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:00.017667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:00.019359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:00.033947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3acec-4310-416c-8799-66e83a3ce481 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:00.040312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:00.041508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.041608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.041993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] PATH_INFO: `/v3/projects/219be543c4bd4557bdc005d8d0f2b0ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.043213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219be543c4bd4557bdc005d8d0f2b0ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:00.045342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:00.092873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:00.097046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219be543c4bd4557bdc005d8d0f2b0ac', 'request_id': 'req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.104505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219be543c4bd4557bdc005d8d0f2b0ac', 'request_id': 'req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.110428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219be543c4bd4557bdc005d8d0f2b0ac', 'request_id': 'req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.124442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] The token cache is being invalidate because project 219be543c4bd4557bdc005d8d0f2b0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:00.124729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.125347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.127022 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4086/8120] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:00 2022] DELETE /identity/v3/projects/219be543c4bd4557bdc005d8d0f2b0ac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:00.131417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:00.141961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011858-0b8d-4a28-9cbf-abd89eb2e732 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:00.202850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:00.203699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.203977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.204248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] PATH_INFO: `/v3/users/7698e4870d1644689a8bf80a0e537011` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.205410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7698e4870d1644689a8bf80a0e537011)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:00.207321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:00.254749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7698e4870d1644689a8bf80a0e537011'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.255455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7698e4870d1644689a8bf80a0e537011'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.266814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7698e4870d1644689a8bf80a0e537011'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.267827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7698e4870d1644689a8bf80a0e537011'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.282845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f6d9e642-9328-47eb-93d4-8e7b25e9e955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7698e4870d1644689a8bf80a0e537011'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.297733 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4035/8121] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:00 2022] DELETE /identity/v3/users/7698e4870d1644689a8bf80a0e537011 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:00.615594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:00.617925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:00.643969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa4ae-73a7-46ec-9ce7-46a28bbd9f12 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:00.709572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:00.710686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.710886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.711182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] PATH_INFO: `/v3/projects/10a7055de32142bfa393b4522318c1c0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.712442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a7055de32142bfa393b4522318c1c0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:00.714345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:00.765197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a7055de32142bfa393b4522318c1c0', 'request_id': 'req-f9199c70-05ff-48bc-8005-99c8daeaeca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.772064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a7055de32142bfa393b4522318c1c0', 'request_id': 'req-f9199c70-05ff-48bc-8005-99c8daeaeca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.778294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a7055de32142bfa393b4522318c1c0', 'request_id': 'req-f9199c70-05ff-48bc-8005-99c8daeaeca9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.793069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] The token cache is being invalidate because project 10a7055de32142bfa393b4522318c1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:00.793340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.794019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f9199c70-05ff-48bc-8005-99c8daeaeca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:00.795687 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4087/8122] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:00 2022] DELETE /identity/v3/projects/10a7055de32142bfa393b4522318c1c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:00.801535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.801892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.802105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.822256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:00.823533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:00.879907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:00.895572 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4036/8123] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:00.901132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.901422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.901711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.921700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:00.922918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:00.931749 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4088/8124] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:00.936254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:00.946670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a23ef-7be1-4f4e-9993-db4e4c8fac73 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:00.952123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:00.952793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.953081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.953363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:00.954131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:00.954442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:00.956118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:00.970783 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4037/8125] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:00.975635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:00.989258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73cddc-1207-4a70-933f-014e1f646b79 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:00.997807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:00.998702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:00.999085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:00.999428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.000542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.003425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.038457 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4089/8126] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:00 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:01.045283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.059442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceb3a2-e88f-4046-a7b3-5d8440b853ff admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.127860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.128712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.129289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.129643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.130625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.132675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.157054 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4038/8127] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:01.161095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.172066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2f330-2b66-4a95-85de-2a7eb53871f2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.177258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.178260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.178592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.178881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.179700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.181360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.193352 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4090/8128] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:01.198069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.209130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcac4a1-b64d-4ecb-bc7d-931a9a5bc568 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.214127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.214798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.215076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.215353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.216152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.217771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093df8b-44b8-4ecf-be3e-cce7b6c7fc90 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.229818 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4039/8129] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:01.234731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.245510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7e2f5-d0f5-4d96-80af-d1fbb137911d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.250364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.251295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.251608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.251891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] PATH_INFO: `/v3/projects/907839a887414a0fb906569142dd7331/users/c24a48df23d64a2f89d5258dd51a04da/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.268424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] RBAC: Authorizing `identity:create_grant(project_id=907839a887414a0fb906569142dd7331, user_id=c24a48df23d64a2f89d5258dd51a04da, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.271220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.281279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:01.288993 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4091/8130] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:01 2022] PUT /identity/v3/projects/907839a887414a0fb906569142dd7331/users/c24a48df23d64a2f89d5258dd51a04da/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:01.299789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.300086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.300373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.329577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] MFA Rules not processed for user `c24a48df23d64a2f89d5258dd51a04da`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:01.331113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:01.409099 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4040/8131] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:01.413989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.427190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f552cf-a123-4af6-8374-bc645369245f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.432444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.433352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.433611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.433891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.434633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.435818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85eae3-13ed-47f5-ae8b-e0d438d35532 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.506512 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4092/8132] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 789 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:01.510720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.519778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c7549-ea56-4b70-8968-987a2ba959f3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.523972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.524919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.525200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.525474 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/57fbcbe29e7c415c8f03783b94726139` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.534393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:get_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=57fbcbe29e7c415c8f03783b94726139)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.536051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.537986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4041/8133] 10.222.0.18 () {58 vars in 1391 bytes} [Sat Jun 4 21:24:01 2022] GET /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/57fbcbe29e7c415c8f03783b94726139 => generated 689 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:01.542442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.542827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.543116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.558252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] MFA Rules not processed for user `c24a48df23d64a2f89d5258dd51a04da`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:01.559495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:01.666162 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4093/8134] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 04 21:24:01.670691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.681011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb331893-a5da-4f1d-acd9-8cab3fc0db52 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.685716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.686674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.686965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.687248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/57fbcbe29e7c415c8f03783b94726139` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.688638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=57fbcbe29e7c415c8f03783b94726139)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.690321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.712444 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4042/8135] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:01 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/57fbcbe29e7c415c8f03783b94726139 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:01.718487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.728914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f342c-0104-48f0-b87f-f59269c6fb71 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.733165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.734214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.734566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.734905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.735779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.737001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.785670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:01.827555 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4094/8136] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 921 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:01.829783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.840378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1d8e-3acc-49a6-a2ac-c8a2ab75fc85 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.844858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.845813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.846104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.846491 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/403b84b99a964f569b4b530d5ba0215a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.859855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=403b84b99a964f569b4b530d5ba0215a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.861481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.864060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:01.888674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4043/8137] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:01 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/403b84b99a964f569b4b530d5ba0215a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:01.893924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:01.904537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e59a94-ce52-4125-88d4-fd34a28ccf55 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:01.909029 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:01.909923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:01.910319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:01.910602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:01.911408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:01.912927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:01.987924 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4095/8138] 10.222.0.18 () {60 vars in 1314 bytes} [Sat Jun 4 21:24:01 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 812 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:01.993431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.003893 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2531021-d634-4e69-84b1-68e33d7f0a70 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.009034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.009993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.010352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.010622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/00fca0e378524554b57ef82b01bcc97a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.021927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=00fca0e378524554b57ef82b01bcc97a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.023446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.047993 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4044/8139] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:01 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/00fca0e378524554b57ef82b01bcc97a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.054065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.065055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70eed-955b-4c60-9e86-e23252984098 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.069600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.070528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.070822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.071103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.071905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.073089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.153376 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4096/8140] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Jun 4 21:24:02 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 789 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:02.158312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.170615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d2f8-bfc2-43fb-b54c-925f3c56d977 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.176238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.177334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.178011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.178427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.179254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.180843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.254643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4045/8141] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Jun 4 21:24:02 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 789 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:02.258758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.268921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f8f42-27f8-4833-bb17-c107d9fc0074 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.273395 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.274220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.274508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.274771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.275471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:list_application_credentials(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.277142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.289618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4097/8142] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:24:02 2022] GET /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 1502 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:02.293970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.304103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be131b31-0a1e-4503-ae88-79916dde01b4 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.308614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.309559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.309850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.310149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/d8efab0352b448c19a1aad6c00afc875` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.319994 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=d8efab0352b448c19a1aad6c00afc875)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.321544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.342556 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4046/8143] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:02 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/d8efab0352b448c19a1aad6c00afc875 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.346818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.356624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209c159-1999-4b4a-88d6-c8b11ca67187 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.361004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.361973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.362255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.362531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/d912481515b74e78bcee0e42d073061c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.371701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=d912481515b74e78bcee0e42d073061c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.373214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.393994 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4098/8144] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:02 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/d912481515b74e78bcee0e42d073061c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.399308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.409404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83c15-1147-4701-9b2c-5d9d8cb44f1c tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.413912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.414802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.415092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.415371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.416166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.417332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.493429 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4047/8145] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Jun 4 21:24:02 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 789 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:02.497777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.507937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f484d5a-805c-4c14-82c0-66b1bc26b24d tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.512654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.513546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.513841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.514467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.515217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:create_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.516468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.528858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:02.600535 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4099/8146] 10.222.0.18 () {60 vars in 1313 bytes} [Sat Jun 4 21:24:02 2022] POST /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials => generated 789 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:02.605004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.615884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cefe-065c-4768-8e54-2250ff76c07a tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.620713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.621606 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.621897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.622181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.622903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Adding query filter params (name=tempest-application_credential-1194809896) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:02.623219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:list_application_credentials(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.624895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.635728 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4048/8147] 10.222.0.18 () {58 vars in 1385 bytes} [Sat Jun 4 21:24:02 2022] GET /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials?name=tempest-application_credential-1194809896 => generated 887 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:02.640340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.650260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7a85-e53b-4eea-8f38-ee9516dd88fd tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.654851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.655884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.656170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.656443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/733d3076f42743bc970b2b61e9de5b4c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.665450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=733d3076f42743bc970b2b61e9de5b4c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.666997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.687688 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4100/8148] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:02 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/733d3076f42743bc970b2b61e9de5b4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.691937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.696911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:02.703337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96de77-e3a1-4443-9465-09201fe184b3 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.708691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c24a48df23d64a2f89d5258dd51a04da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907839a887414a0fb906569142dd7331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.709903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.710428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.710977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/0635853d2c5b464d98efc416c66c85f7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.719869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c24a48df23d64a2f89d5258dd51a04da, application_credential_id=0635853d2c5b464d98efc416c66c85f7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.721425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31049778-d280-4655-855d-34326427b64f tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.740513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4049/8149] 10.222.0.18 () {58 vars in 1394 bytes} [Sat Jun 4 21:24:02 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da/application_credentials/0635853d2c5b464d98efc416c66c85f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.745875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:02.812243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a770-a9bf-4bdd-962a-d90cd089e785 tempest-ApplicationCredentialsV3Test-67981025 tempest-ApplicationCredentialsV3Test-67981025-project] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:02.817095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:02.817966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.818241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.818514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] PATH_INFO: `/v3/users/c24a48df23d64a2f89d5258dd51a04da` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.819796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24a48df23d64a2f89d5258dd51a04da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:02.821720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:02.874168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24a48df23d64a2f89d5258dd51a04da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:02.881390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24a48df23d64a2f89d5258dd51a04da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:02.882096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24a48df23d64a2f89d5258dd51a04da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:02.882901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24a48df23d64a2f89d5258dd51a04da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:02.906451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24a48df23d64a2f89d5258dd51a04da'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:02.916765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:02.921948 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4101/8150] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:02 2022] DELETE /identity/v3/users/c24a48df23d64a2f89d5258dd51a04da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:02.926888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:02.927253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:02.927701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:02.945493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:02.946855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:03.015144 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4050/8151] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:03.026400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.027847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:03.093710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a6506-b887-44d1-8800-db9ecdc6689d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.098438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.099085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.099431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.099936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.110541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.112208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa50b-d8ab-4189-9d69-b9e3c195f8aa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:03.122350 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4102/8152] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:03.420283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.422109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:03.438448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d8b6-56c2-4858-b2fc-dd96d7c33d82 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.443824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.444782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.445137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.445412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] PATH_INFO: `/v3/projects/907839a887414a0fb906569142dd7331` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.446772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907839a887414a0fb906569142dd7331)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.448633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:03.500778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907839a887414a0fb906569142dd7331', 'request_id': 'req-cd9bd815-5e56-4829-817e-98c22bf44aa2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:03.507750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907839a887414a0fb906569142dd7331', 'request_id': 'req-cd9bd815-5e56-4829-817e-98c22bf44aa2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:03.517576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907839a887414a0fb906569142dd7331', 'request_id': 'req-cd9bd815-5e56-4829-817e-98c22bf44aa2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:03.533939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] The token cache is being invalidate because project 907839a887414a0fb906569142dd7331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:03.534266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:03.534984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-cd9bd815-5e56-4829-817e-98c22bf44aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:03.536825 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4051/8153] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:03 2022] DELETE /identity/v3/projects/907839a887414a0fb906569142dd7331 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:03.542129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.542450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.542751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.561668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:03.562892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:03.626521 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4103/8154] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:03.718342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.718578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.718900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.741271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:03.742481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:03.758908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4052/8155] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:03.764043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.777431 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e083b-0c69-4408-923c-c05fc5c9918b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.782959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.783649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.783925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.784197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.785040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:03.785352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.786962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:03.799479 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4104/8156] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:03.804714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.814898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c92aa-0a3b-43f6-96fe-d31d32243604 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.821403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.822067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.822348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.822623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.823304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.825264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:03.854716 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4053/8157] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:03 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:03.860848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.872516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79222f9f-c5fc-4df1-8e68-667c13356503 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.933836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.934524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.934808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.935083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.935838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.937744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:03.964660 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4105/8158] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:03 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:03.966133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:03.977083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb30d-e3f3-456f-a980-84acf3234e5b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:03.982992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:03.983690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:03.984020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:03.984234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:03.984964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:03.986582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:04.003060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4054/8159] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:04.007688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:04.020458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82da9a3-8786-48f5-93e4-10487a8c0f43 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:04.025533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:04.026295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.026613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.026855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.027769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:04.029413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893c79-62fe-440b-a59e-c2c686d54b91 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:04.040344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4106/8160] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:04.054134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:04.066654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e6ad9-7766-4cf6-a7b1-b71e739c1601 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:04.072988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:04.073869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.074243 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.074587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] PATH_INFO: `/v3/projects/a32807827fcc4460980567e38d465926/users/9f0a2fe3c7f549389a87fe00c45e6ce4/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.088167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:04.091830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32807827fcc4460980567e38d465926, user_id=9f0a2fe3c7f549389a87fe00c45e6ce4, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:04.095811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:04.111260 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4055/8161] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:04 2022] PUT /identity/v3/projects/a32807827fcc4460980567e38d465926/users/9f0a2fe3c7f549389a87fe00c45e6ce4/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:04.121521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697ccf-b823-4b90-92f5-56a9e151f6ba None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.122035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697ccf-b823-4b90-92f5-56a9e151f6ba None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.122167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697ccf-b823-4b90-92f5-56a9e151f6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.137064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:04.153790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5e697ccf-b823-4b90-92f5-56a9e151f6ba None None] MFA Rules not processed for user `9f0a2fe3c7f549389a87fe00c45e6ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:04.155004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5e697ccf-b823-4b90-92f5-56a9e151f6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:04.226960 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4107/8162] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:04.242428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:04.244482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:04.313559 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d677e75-d460-47b6-9e33-9e71eb23f2d6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:04.318426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:04.319697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.320234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.320816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.332457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:04.334023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:04.344837 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4056/8163] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:04.467282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8c6-2694-42a9-98dc-9307d443decf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.467606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8c6-2694-42a9-98dc-9307d443decf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.467890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8c6-2694-42a9-98dc-9307d443decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.498032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4a54c8c6-2694-42a9-98dc-9307d443decf None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:04.499281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4a54c8c6-2694-42a9-98dc-9307d443decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:04.578250 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4108/8164] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:04.629308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:04.630811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:04.720205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5d2b-73b1-465f-9b23-db7a22128dd5 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:04.727791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:04.728435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.728713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.729037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.737400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:04.738974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:04.747276 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4057/8165] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:04.980042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7410f-5b64-4084-9b97-e4c13bfe647c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:04.980276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7410f-5b64-4084-9b97-e4c13bfe647c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:04.980594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7410f-5b64-4084-9b97-e4c13bfe647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:04.999660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-59d7410f-5b64-4084-9b97-e4c13bfe647c None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:05.000832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59d7410f-5b64-4084-9b97-e4c13bfe647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:05.009388 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4109/8166] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:05.022144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:05.035643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995a1cd-05dd-43c9-884e-ec58b734472d service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:05.041822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:05.042466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.042750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.043026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.051529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:05.053260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:05.062225 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4058/8167] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:05.303794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad63eb-a358-457d-8443-f112cf4330a6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.304343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad63eb-a358-457d-8443-f112cf4330a6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.304542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad63eb-a358-457d-8443-f112cf4330a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.324937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f8ad63eb-a358-457d-8443-f112cf4330a6 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:05.326484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f8ad63eb-a358-457d-8443-f112cf4330a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:05.335255 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4110/8168] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:05.349283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:05.363575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9c923-c7ec-4e26-975a-6cf590be83ea service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:05.371383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:05.372191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.372527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.372837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.384597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:05.386304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:05.396789 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4059/8169] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:24:05.640656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc78-604f-48a2-a904-fd57353df9f2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.640949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc78-604f-48a2-a904-fd57353df9f2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.641225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5becc78-604f-48a2-a904-fd57353df9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.660795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a5becc78-604f-48a2-a904-fd57353df9f2 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:05.662019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a5becc78-604f-48a2-a904-fd57353df9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:05.669970 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4111/8170] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:05.682589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:05.696588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efe666-b0a2-4287-96e1-7cda467eb496 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:05.703005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:05.703690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.703977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.704256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.713086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:05.714702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:05.723327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4060/8171] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:05.952121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988f27-0f51-435a-96ed-555d4223179b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:05.952417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988f27-0f51-435a-96ed-555d4223179b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:05.952701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988f27-0f51-435a-96ed-555d4223179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:05.971687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-73988f27-0f51-435a-96ed-555d4223179b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:05.972924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-73988f27-0f51-435a-96ed-555d4223179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:05.982298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4112/8172] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:05.994938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:06.013420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0d49-f21f-4d31-85aa-7e3081719f51 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:06.022927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:06.023577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:06.023921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:06.024131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:06.033934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:06.036314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:06.045325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4061/8173] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:06.284274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240a78-d8d2-4448-8191-061de61f9e17 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:06.284674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240a78-d8d2-4448-8191-061de61f9e17 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:06.285058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240a78-d8d2-4448-8191-061de61f9e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:06.305398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d1240a78-d8d2-4448-8191-061de61f9e17 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:06.306621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d1240a78-d8d2-4448-8191-061de61f9e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:06.314841 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4113/8174] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:06.328933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:06.342532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c11c6d-2c9d-481b-889f-61407a663913 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:06.348250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:06.348993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:06.349280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:06.349690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:06.362986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:06.364496 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:06.374486 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4062/8175] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:07.322410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03a3c-b4cd-4760-ac8b-7c18404283e1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.322904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03a3c-b4cd-4760-ac8b-7c18404283e1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.322987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab03a3c-b4cd-4760-ac8b-7c18404283e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.341895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fab03a3c-b4cd-4760-ac8b-7c18404283e1 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:07.343112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fab03a3c-b4cd-4760-ac8b-7c18404283e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:07.351662 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4114/8176] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:07.365318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:07.383662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131952-e401-4928-b5b8-53d97f2ce351 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:07.389946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:07.390862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.391149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.391555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.400124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:07.404783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:07.406594 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:07.416421 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4063/8177] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:07.570130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d96d-76a0-4fbb-aef7-8b23624063c2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.570423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d96d-76a0-4fbb-aef7-8b23624063c2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.570707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d96d-76a0-4fbb-aef7-8b23624063c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.589850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-add6d96d-76a0-4fbb-aef7-8b23624063c2 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:07.591288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-add6d96d-76a0-4fbb-aef7-8b23624063c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:07.599113 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4115/8178] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:07.613603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:07.628731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838416-ed9a-49fd-aa1a-92c965ed3ee9 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:07.634739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:07.635395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.635714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.636000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.645505 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:07.647909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:07.657237 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4064/8179] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:07.807292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e43ad-b8e6-4c66-842f-b9dba885560c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.807630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e43ad-b8e6-4c66-842f-b9dba885560c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.807909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e43ad-b8e6-4c66-842f-b9dba885560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.825653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e22e43ad-b8e6-4c66-842f-b9dba885560c None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:07.826859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e22e43ad-b8e6-4c66-842f-b9dba885560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:07.834049 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4116/8180] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:07.846640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:07.860373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7532f-419c-4571-9ef8-3aeb5e0bb4e8 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:07.866117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:07.866686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:07.866970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:07.867244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:07.875897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:07.877493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:07.886006 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4065/8181] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:08.030714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5831-42e3-4db1-b780-cd6395ad430b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.031012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5831-42e3-4db1-b780-cd6395ad430b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.031312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a5831-42e3-4db1-b780-cd6395ad430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.050143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6a1a5831-42e3-4db1-b780-cd6395ad430b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:08.051332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6a1a5831-42e3-4db1-b780-cd6395ad430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.060095 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4117/8182] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:08.072979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.086701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c58e8-3464-4135-8bf3-dea2d5aabd0d service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.092793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.093469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.093754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.094036 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.103315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.104987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.113764 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4066/8183] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:08.276218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.276617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.276942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.295699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:08.296922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.305919 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4118/8184] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:08.319653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.334082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae664810-ba08-4e95-aa22-2c9b3b7a1c19 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.340312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.341009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.341303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.341575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.351182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.353003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64b5c8-63d3-42a5-8219-490b45aef744 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.362452 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4067/8185] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:08.435439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.437043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.452715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:08.511080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbafba6-c9e8-4ab2-9a3b-e6658254ecfb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.516821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.517707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.517995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.518276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] PATH_INFO: `/v3/users/52894cd22b0642ee853fa2b53c9e04ea` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.519578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52894cd22b0642ee853fa2b53c9e04ea)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.521553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.537068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.537545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.537686 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.556256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:08.557492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.564871 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4068/8186] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:08.572358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52894cd22b0642ee853fa2b53c9e04ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.578391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.579726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52894cd22b0642ee853fa2b53c9e04ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.580448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52894cd22b0642ee853fa2b53c9e04ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.581102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52894cd22b0642ee853fa2b53c9e04ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.593463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f841f47f-d010-4eb0-87d6-e47b3f218bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52894cd22b0642ee853fa2b53c9e04ea'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.593646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a837a-ea5f-4cca-a929-6e78aa578f02 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.599292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.600185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.600533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.601376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.603410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.608790 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4119/8187] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:08 2022] DELETE /identity/v3/users/52894cd22b0642ee853fa2b53c9e04ea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:08.613408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.613775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.614125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.615769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.618041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.626610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4069/8188] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 21:24:08.631737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:08.633731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.713489 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4120/8189] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:08.724161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.725640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.748113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.749630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.761751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d26ce-4ad3-46b9-ac75-495d720b019b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.766913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.767827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.768132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.768419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] PATH_INFO: `/v3/users/9f0a2fe3c7f549389a87fe00c45e6ce4` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.769630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0a2fe3c7f549389a87fe00c45e6ce4)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.771612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.791986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756da7b2-2cf8-49d0-8ccb-7a7c178781c1 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:08.803496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:08.826151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0a2fe3c7f549389a87fe00c45e6ce4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.833231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0a2fe3c7f549389a87fe00c45e6ce4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.833941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0a2fe3c7f549389a87fe00c45e6ce4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.834567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0a2fe3c7f549389a87fe00c45e6ce4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.846826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-085bc69f-6214-4db8-b88e-abdfb874826a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0a2fe3c7f549389a87fe00c45e6ce4'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:08.846983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:08.847737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.848115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.848520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.850478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.861852 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4121/8190] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:08 2022] DELETE /identity/v3/users/9f0a2fe3c7f549389a87fe00c45e6ce4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:08.863147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:08.864975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:08.866367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:08.866761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:08.867102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:08.875900 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4070/8191] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:08.887104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:08.888429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.960884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4122/8192] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:08.973855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:08.975426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:08.989584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783bc51-3336-431f-8ed5-d2825f87e721 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.037088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:09.048181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.048924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.049276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.049636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.062440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.063931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba21146-ac25-43cc-8bec-195a3a03dbdb service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.074768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4071/8193] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:09.183050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.184863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.200177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9500ac-3ac4-48bd-b6d6-3b0c432d7e71 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.205773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.206654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.206935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.207207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] PATH_INFO: `/v3/projects/704bfcd03a884c3a89a011644bcbf4ec` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.208441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704bfcd03a884c3a89a011644bcbf4ec)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.210985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.277582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704bfcd03a884c3a89a011644bcbf4ec', 'request_id': 'req-93163a10-2a5c-4db5-a92b-1152e755fc52'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.284021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704bfcd03a884c3a89a011644bcbf4ec', 'request_id': 'req-93163a10-2a5c-4db5-a92b-1152e755fc52'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.290072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704bfcd03a884c3a89a011644bcbf4ec', 'request_id': 'req-93163a10-2a5c-4db5-a92b-1152e755fc52'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.304773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] The token cache is being invalidate because project 704bfcd03a884c3a89a011644bcbf4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:09.305092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.305729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.307364 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4123/8194] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:09 2022] DELETE /identity/v3/projects/704bfcd03a884c3a89a011644bcbf4ec => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:09.312727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086c2-bf92-4987-8bf4-08def21c6b40 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.313017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086c2-bf92-4987-8bf4-08def21c6b40 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.313727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086c2-bf92-4987-8bf4-08def21c6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.332232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d9b086c2-bf92-4987-8bf4-08def21c6b40 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:09.333435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d9b086c2-bf92-4987-8bf4-08def21c6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.381206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.382485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.403676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4072/8195] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:09.412374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.412869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.412991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.429211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:09.434958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:09.436271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.444721 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4073/8196] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:09.448883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.457869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cfc2a-ec4e-488f-820f-3a9e8a528125 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.462660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.463314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.463643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.463923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.464653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:09.464960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.466555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.469301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93163a10-2a5c-4db5-a92b-1152e755fc52 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.473969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.474876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.475163 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.475499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] PATH_INFO: `/v3/projects/a32807827fcc4460980567e38d465926` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.476771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32807827fcc4460980567e38d465926)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.478387 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4074/8197] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:24:09.479944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.482813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.492566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15313b5b-c4f1-4c81-b34a-d7075597cb89 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.497134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.497774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.498051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.498322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.499004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.500916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.527729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32807827fcc4460980567e38d465926', 'request_id': 'req-93acd3b8-99dc-497e-aa77-bfda3e87729c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.529885 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4075/8198] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:09.534071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.537489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32807827fcc4460980567e38d465926', 'request_id': 'req-93acd3b8-99dc-497e-aa77-bfda3e87729c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.543380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32807827fcc4460980567e38d465926', 'request_id': 'req-93acd3b8-99dc-497e-aa77-bfda3e87729c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.557463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] The token cache is being invalidate because project a32807827fcc4460980567e38d465926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:09.557758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.558428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-93acd3b8-99dc-497e-aa77-bfda3e87729c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:09.560213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4124/8199] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:09 2022] DELETE /identity/v3/projects/a32807827fcc4460980567e38d465926 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:09.564892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619020-af85-4b75-a13b-8343ee7231ee None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.565187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619020-af85-4b75-a13b-8343ee7231ee None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.565470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d619020-af85-4b75-a13b-8343ee7231ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.584281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9d619020-af85-4b75-a13b-8343ee7231ee None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:09.585637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d619020-af85-4b75-a13b-8343ee7231ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.596530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f185-2ac0-41fb-aca0-ae2e17af09e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.601382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.602048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.602329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.602603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.603282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.605274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.626885 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4076/8200] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:09.630762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.632485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.644508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16858240-a59d-46ea-b9f6-19fc03fd01de admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.646979 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4125/8201] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:09.649607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.650262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.650551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.650823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.651646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.653197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.655149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.655684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.655802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.663900 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4077/8202] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:09.667772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.674035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:09.676170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.678342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fc115-8a0b-457b-ba49-2c54a3832105 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.683457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.684166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.684454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.684565 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4126/8203] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:09.684735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.685535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.687142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.688483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.697456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e06bd-f493-4d17-986a-d8d1a798fc90 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.698186 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4078/8204] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:24:09.702187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.702430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.703078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.703362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.703674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.704407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:09.704717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.706352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.712480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a448e7-482e-4c7e-a864-09e54d45511c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.718109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.719017 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4127/8205] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:24:09.719720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.720026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.720317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] PATH_INFO: `/v3/projects/e3a0e715b531413fb885be9b4f301f6a/users/5fde5b33000144d09e5455986e5c1778/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.723045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.730020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:09.733364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d1b5-cd3d-4e0f-89c8-d0366ca0c237 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.737582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a0e715b531413fb885be9b4f301f6a, user_id=5fde5b33000144d09e5455986e5c1778, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.738636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.739290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.739711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.739978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.740666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.740833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e52d8-e8a1-4708-a58b-fc891ea96f60 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.742762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.755448 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4079/8206] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:09 2022] PUT /identity/v3/projects/e3a0e715b531413fb885be9b4f301f6a/users/5fde5b33000144d09e5455986e5c1778/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:09.766597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.766900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.767175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.771989 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4128/8207] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:09.775973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.793465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:09.794492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] MFA Rules not processed for user `5fde5b33000144d09e5455986e5c1778`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:09.795875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.840537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc49d2-1969-4c4b-bbc9-d389b0131628 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.845445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.846127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.846411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.846721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.847412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.849378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.861099 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4080/8208] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:09.871546 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4129/8209] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:09 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:09.873517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.874401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.874992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:09.885241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddeb96-7211-422c-8dee-6daacf1f9b7b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.890973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.891680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.891971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.892251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.893009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.894630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.905504 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4130/8210] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:24:09.909733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.921316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659b76d-7833-4b49-a7af-ec2193f71e7d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.926340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.927025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.927300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.927614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.928398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.930433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.941575 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4131/8211] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:24:09.945928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:09.953797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c583a8-fe51-4695-8764-98bfb5438278 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.955616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e987-2cf5-4af4-9e8b-47ad804e5b59 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:09.957535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.958215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.958497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.958773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.960283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:09.961198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:09.961468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:09.961750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] PATH_INFO: `/v3/projects/af78b05bc8144757bdc2bff6b3c7ce06/users/d4ef2cec93d84babb647081638921d6d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:09.967482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.968954 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7590b-0fda-45e9-a5c2-e9e940576a85 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.978269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af78b05bc8144757bdc2bff6b3c7ce06, user_id=d4ef2cec93d84babb647081638921d6d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:09.978425 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4081/8212] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:24:09.981387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:09.996639 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4132/8213] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:09 2022] PUT /identity/v3/projects/af78b05bc8144757bdc2bff6b3c7ce06/users/d4ef2cec93d84babb647081638921d6d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:10.008379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:10.008644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:10.008926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:10.036319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] MFA Rules not processed for user `d4ef2cec93d84babb647081638921d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:10.037558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:10.100023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:10.104544 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4082/8214] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:10.117437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:10.119271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:10.184988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6e682-c4cb-4fc9-b668-209b2a048ca1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:10.188821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:10.189548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:10.189830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:10.190136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:10.200392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:10.202060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f567c-2946-42a9-b205-eae2d401d09f service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:10.212583 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4133/8215] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:10.816797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:10.883712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0fa51-628f-4abf-b5c4-51db2164c55c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:10.889357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:10.890271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:10.890522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:10.890822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] PATH_INFO: `/v3/users/d4ef2cec93d84babb647081638921d6d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:10.892083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ef2cec93d84babb647081638921d6d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:10.894126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:10.944588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ef2cec93d84babb647081638921d6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:10.945303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ef2cec93d84babb647081638921d6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:10.952268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ef2cec93d84babb647081638921d6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:10.952888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ef2cec93d84babb647081638921d6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:10.965110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ef2cec93d84babb647081638921d6d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:10.980628 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4083/8216] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:10 2022] DELETE /identity/v3/users/d4ef2cec93d84babb647081638921d6d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:10.985457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:10.985969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:10.986087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.003113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:11.004339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:11.066298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4134/8217] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:11.077162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.079696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:11.158798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ee1b3-f416-4e90-b4bf-293db7a62018 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.165716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.166617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.166965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.167312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.181931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.183372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05ca8-1027-457f-af50-af0fcdb38f9f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.193020 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4084/8218] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:11.487347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.489123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:11.496864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:11.503949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbfe4-19ad-4685-9362-4c8f3a0c001d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.511066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.511988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.512275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.512554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] PATH_INFO: `/v3/projects/af78b05bc8144757bdc2bff6b3c7ce06` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.513767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af78b05bc8144757bdc2bff6b3c7ce06)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.516605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.567624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af78b05bc8144757bdc2bff6b3c7ce06', 'request_id': 'req-554549d1-5dde-431d-8e16-d4f48b1eb429'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:11.577119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af78b05bc8144757bdc2bff6b3c7ce06', 'request_id': 'req-554549d1-5dde-431d-8e16-d4f48b1eb429'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:11.583126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af78b05bc8144757bdc2bff6b3c7ce06', 'request_id': 'req-554549d1-5dde-431d-8e16-d4f48b1eb429'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:11.596824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] The token cache is being invalidate because project af78b05bc8144757bdc2bff6b3c7ce06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:11.597114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:11.597738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-554549d1-5dde-431d-8e16-d4f48b1eb429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:11.599420 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4135/8219] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:11 2022] DELETE /identity/v3/projects/af78b05bc8144757bdc2bff6b3c7ce06 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:11.605917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.606331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.606681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.626161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:11.627414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:11.646167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:11.691459 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4085/8220] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:11.699741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011919-13e7-4464-8820-e807841620ab None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.700036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011919-13e7-4464-8820-e807841620ab None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.700574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76011919-13e7-4464-8820-e807841620ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.719266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-76011919-13e7-4464-8820-e807841620ab None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:11.720525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-76011919-13e7-4464-8820-e807841620ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:11.728869 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4136/8221] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:11.733476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.743688 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057befda-d2f9-47da-9bf6-eaf46424daf0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.748342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.749047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.749335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.749614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.750354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:11.750664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.752301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.765826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4086/8222] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:11.770439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011919-13e7-4464-8820-e807841620ab None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.780471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76011919-13e7-4464-8820-e807841620ab None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.785813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.786715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.786996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.787334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.788376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.790475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.831266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4137/8223] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:11 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:11.833288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.844051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba527197-5247-49cb-b751-9b360a84a40e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.906859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.907570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.907861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.908145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.908855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.910940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.932613 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4087/8224] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:11 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:11.936845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.947296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3bcb2-e23d-48af-9ce6-83c78e3a0bd7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.953523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.954228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.954599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.954912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.955689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.957308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:11.968441 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4138/8225] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:11.972553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:11.982933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9f33-cd52-4429-9890-22f7e70e9673 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:11.987631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:11.988294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:11.988582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:11.988862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:11.989664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:11.991324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629333f-1674-4478-ac94-79a8a8df8cf5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:12.001672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4088/8226] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:12.005894 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:12.018731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12f22-074b-43d1-878b-c6649bdfd3ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:12.024535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:12.025445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.025731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.026010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] PATH_INFO: `/v3/projects/342a2dcfbc6441a69ab4c3db23efaf59/users/37db3906ef84401a9afd53b9a1ed0dc7/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.043946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342a2dcfbc6441a69ab4c3db23efaf59, user_id=37db3906ef84401a9afd53b9a1ed0dc7, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:12.047342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:12.067332 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4139/8227] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:12 2022] PUT /identity/v3/projects/342a2dcfbc6441a69ab4c3db23efaf59/users/37db3906ef84401a9afd53b9a1ed0dc7/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:12.079278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.079728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.080032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.114031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] MFA Rules not processed for user `37db3906ef84401a9afd53b9a1ed0dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:12.115421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:12.183107 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4089/8228] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:12.197889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:12.199872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:12.262575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21efc-61ed-4844-8c4c-358e13b90113 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:12.266721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:12.267368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.267673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.267974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.276753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:12.278193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77417-5208-4b44-afeb-ca7b54f6d7d6 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:12.287391 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4140/8229] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:12.476800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:12.497967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:12.552373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de0599-25c4-4a59-8180-70804f4acaea None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:12.557442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:12.558326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.558607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.558888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] PATH_INFO: `/v3/users/37db3906ef84401a9afd53b9a1ed0dc7` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.560133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37db3906ef84401a9afd53b9a1ed0dc7)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:12.562069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:12.617552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37db3906ef84401a9afd53b9a1ed0dc7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:12.618223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37db3906ef84401a9afd53b9a1ed0dc7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:12.625729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37db3906ef84401a9afd53b9a1ed0dc7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:12.626442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37db3906ef84401a9afd53b9a1ed0dc7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:12.638244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37db3906ef84401a9afd53b9a1ed0dc7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:12.653349 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4090/8230] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:12 2022] DELETE /identity/v3/users/37db3906ef84401a9afd53b9a1ed0dc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:12.658280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.658573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.658853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.676408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:12.677615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:12.697398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:12.741632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4141/8231] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:12.751910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:12.753514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:12.833750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86147a1e-34e3-4fe9-b74f-cc8d1d44c328 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:12.838360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:12.839008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:12.839289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:12.839566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:12.849898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:12.851342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b0ad-1780-477f-a1c8-a0c9885c1544 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:12.861019 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4091/8232] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:13.180964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.182632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:13.198188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2de717-2bdc-45c6-9d4c-7134e5cb267c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.206336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.207630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.207993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.208180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] PATH_INFO: `/v3/projects/342a2dcfbc6441a69ab4c3db23efaf59` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.209663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342a2dcfbc6441a69ab4c3db23efaf59)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.212471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.270905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342a2dcfbc6441a69ab4c3db23efaf59', 'request_id': 'req-daf3b970-bcab-4978-a684-575befe33255'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:13.279815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342a2dcfbc6441a69ab4c3db23efaf59', 'request_id': 'req-daf3b970-bcab-4978-a684-575befe33255'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:13.286162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342a2dcfbc6441a69ab4c3db23efaf59', 'request_id': 'req-daf3b970-bcab-4978-a684-575befe33255'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:13.300342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] The token cache is being invalidate because project 342a2dcfbc6441a69ab4c3db23efaf59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:13.300636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:13.301268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-daf3b970-bcab-4978-a684-575befe33255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:13.303092 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4142/8233] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:13 2022] DELETE /identity/v3/projects/342a2dcfbc6441a69ab4c3db23efaf59 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:13.308504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.308802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.309088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.329075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:13.330386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:13.369463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:13.400043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4092/8234] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:13.408047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.408358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.408698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.429473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:13.430733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:13.439565 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4143/8235] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:13.444070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.455071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd78fa-f9cc-40c9-957a-24a8dff2750e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.460161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.460799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.461081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.461359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.462091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:13.462402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.464064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.477674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4093/8236] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:13.482398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.493471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846116f3-0c38-4069-aa84-a14cb1b93ffe None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.498333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.498999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.499277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.499583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.500309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.502226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.532082 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4144/8237] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:13.536956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.547871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7656a41-3547-46c0-afa3-cf6946d8c18d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.607153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.607878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.608166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.608449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.609207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.611490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.635635 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4094/8238] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:13.640117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.652357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803afb76-e5fa-4d3b-a8c9-98a44d5efc48 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.657170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.657893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.658171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.658474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.659201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.661026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.679047 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4145/8239] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:13.680380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.691103 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44fd2-bf5b-4146-b134-589a4f59a9df admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.697012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.697854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.698138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.698407 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.699321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.701743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb1442-e319-4d15-8287-8cbc1215dbd5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.715154 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4095/8240] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:13.719691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.730377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084a28c-bb8e-4cea-8a2f-42f5da7a163e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.735725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.736630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.736918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.737196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] PATH_INFO: `/v3/projects/4e15181a48ed4a52a4e819098b48f837/users/186406777e0145b190da74a5ab22cff0/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.752753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e15181a48ed4a52a4e819098b48f837, user_id=186406777e0145b190da74a5ab22cff0, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.755462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:13.774663 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4146/8241] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:13 2022] PUT /identity/v3/projects/4e15181a48ed4a52a4e819098b48f837/users/186406777e0145b190da74a5ab22cff0/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:13.789793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.790082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.790360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.829266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] MFA Rules not processed for user `186406777e0145b190da74a5ab22cff0`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:13.830822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:13.902014 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4096/8242] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:13.907183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:13.959148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:13.977681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba86f9-7afd-4d61-9257-4b73f185fc24 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:13.983292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:13.984002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:13.984283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:13.984571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:13.985248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:13.987309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.016572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4147/8243] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:13 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:14.020760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.032295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514967-78ca-464c-b047-07d355279ca3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.065362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:14.094139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.094807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.095089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.095358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.096078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.098032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.121790 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4097/8244] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:14 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:14.127253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.138743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0305d-4608-463e-b358-41723be1c337 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.143687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.144344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.144630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.144905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.145632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.147275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.159677 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4148/8245] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:14.164343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.178676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62da5e-f176-41d0-be39-c34b1e009013 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.185764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.186434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.186718 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.187023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.187832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.189855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f378cd9-d5d3-4f98-9427-1ab5e0ae8c5a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.201189 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4098/8246] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:14.205914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.217846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323439c6-b77d-4eb2-aa2b-650aa54d0fe7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.224016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.224915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.225199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.225705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] PATH_INFO: `/v3/projects/fb90a1eb1e5a43bea52e59483d3de794/users/186a55210cf04c8cb426429289ec8f78/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.246982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb90a1eb1e5a43bea52e59483d3de794, user_id=186a55210cf04c8cb426429289ec8f78, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.249695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.267129 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4149/8247] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:14 2022] PUT /identity/v3/projects/fb90a1eb1e5a43bea52e59483d3de794/users/186a55210cf04c8cb426429289ec8f78/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:14.279377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.279717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.280001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.309798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] MFA Rules not processed for user `186a55210cf04c8cb426429289ec8f78`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:14.311110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:14.384593 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4099/8248] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:14.389413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.460865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6cf92-67fd-439e-9eaf-d6314216834a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.465907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.466618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.466909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.467193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.467942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.469878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.499559 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4150/8249] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:14 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:14.502631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.515093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804e7d-5082-4f96-bd94-62ce8a21afc9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.576242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.577164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.577479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.577763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.578514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.581017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.607839 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4100/8250] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:14 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:14.609285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.621061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dab8f-1a09-40c3-bceb-e67a69433e1c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.626211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.626915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.627199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.627483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.628400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.630025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.642216 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4151/8251] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:14.646771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.657473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1151a6-7289-4da2-b604-5a0e434dfb31 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.662287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.663613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.663901 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.664188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] PATH_INFO: `/v3/projects/3303a78c87bf4f2fa41d57e1f6203654/users/9cca0f38b5ec4f6ba88a2dd2242e4520/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.682138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3303a78c87bf4f2fa41d57e1f6203654, user_id=9cca0f38b5ec4f6ba88a2dd2242e4520, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.684859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.699376 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4101/8252] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:14 2022] PUT /identity/v3/projects/3303a78c87bf4f2fa41d57e1f6203654/users/9cca0f38b5ec4f6ba88a2dd2242e4520/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:14.703369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.713775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66b129-0450-48ce-b7f2-a979fd022919 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.775095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.775816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.776100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.776396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.777246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.778871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f512b6-d6db-4aaa-b900-f3c17c6218e7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.790125 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4152/8253] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:24:14.794325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.806188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539e4c1-6c1d-4b3e-896f-b79b1b8d6db7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:14.811257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:14.812178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.812485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.812859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] PATH_INFO: `/v3/projects/3303a78c87bf4f2fa41d57e1f6203654/users/9cca0f38b5ec4f6ba88a2dd2242e4520/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.814843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3303a78c87bf4f2fa41d57e1f6203654, user_id=9cca0f38b5ec4f6ba88a2dd2242e4520, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:14.817588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:14.821710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:14.831347 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4102/8254] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:14 2022] PUT /identity/v3/projects/3303a78c87bf4f2fa41d57e1f6203654/users/9cca0f38b5ec4f6ba88a2dd2242e4520/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:14.843770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:14.844073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:14.844359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:14.852629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:14.875610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] MFA Rules not processed for user `9cca0f38b5ec4f6ba88a2dd2242e4520`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:14.876827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:14.953334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4153/8255] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:14.963566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:14.965522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:15.033386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f0f70-41d4-4f27-854a-3ff6d2455dd2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:15.037396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:15.038145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:15.038432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:15.038707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:15.099090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:15.101177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:15.111196 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4103/8256] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:21.405289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:21.419618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a201-c77f-4bd7-99c2-c5c281af0a7c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:21.424784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:21.425607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:21.426041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:21.426423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:21.443342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:21.444926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:21.457120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4154/8257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:25.106744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=50 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:25.967086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:25.968583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:25.985234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557e66-a798-42a7-8ef6-3cfd306676e0 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:25.989264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:25.989996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:25.990356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:25.990623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:26.050362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:26.051898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86365-343b-4a27-89f3-773b7ac07fa4 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:26.061110 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4104/8258] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:29.966136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:29.968365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:30.036811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486072-03d5-46f6-8deb-67d769e958db service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:30.042160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:30.043057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.043341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.043648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] PATH_INFO: `/v3/users/5fde5b33000144d09e5455986e5c1778` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:30.044859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fde5b33000144d09e5455986e5c1778)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:30.046786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:30.109293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fde5b33000144d09e5455986e5c1778'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.128196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fde5b33000144d09e5455986e5c1778'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.129420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fde5b33000144d09e5455986e5c1778'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.132087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fde5b33000144d09e5455986e5c1778'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.163121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fde5b33000144d09e5455986e5c1778'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.168659 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:30.185923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4155/8259] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:29 2022] DELETE /identity/v3/users/5fde5b33000144d09e5455986e5c1778 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:30.192563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.193186 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.193510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:30.218413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:30.219873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:30.297611 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4105/8260] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:30.306149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:30.307811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:30.370832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908cf9f-4c3a-46a0-beb3-8012e34c2bd3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:30.375800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:30.376579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.376958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.377340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:30.388233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:30.390141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5b86-a4b5-4ddf-97cc-37282674e26f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:30.400354 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4156/8261] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:30.698518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:30.700147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:30.721417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cddd4c-6561-46bb-9857-86f60b9e1e3d None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:30.730726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:30.731644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.731930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.732205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] PATH_INFO: `/v3/projects/e3a0e715b531413fb885be9b4f301f6a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:30.734112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a0e715b531413fb885be9b4f301f6a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:30.736158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:30.795800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a0e715b531413fb885be9b4f301f6a', 'request_id': 'req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.803037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a0e715b531413fb885be9b4f301f6a', 'request_id': 'req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.808993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a0e715b531413fb885be9b4f301f6a', 'request_id': 'req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.829977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] The token cache is being invalidate because project e3a0e715b531413fb885be9b4f301f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:30.830286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.830938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-29e02a3f-9252-4e62-9a8f-998dbb6f99e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:30.832672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4106/8262] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:30 2022] DELETE /identity/v3/projects/e3a0e715b531413fb885be9b4f301f6a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:30.839330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.839690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.839980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:30.862400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:30.863809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:30.960883 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4157/8263] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:30.965241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:30.965241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:30.965241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.000698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:31.002630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:31.018842 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4107/8264] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:31.020251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.031525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72fbf4-3d1a-4583-b30b-f147fac3a7cd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.056594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.057940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.059204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.059502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.060427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:31.060621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.062248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.081289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4158/8265] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:31.085613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.096424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367eef-8f20-42ff-bd0c-c81e5ef5263a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.104374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.106238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.106526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.108120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.108887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.110839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.151902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:31.185322 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4108/8266] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:31 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:31.187197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.200165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7c52-21e2-4a61-ac17-59a0f1c928d1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.296673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.297977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.303037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.303329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.304269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.306804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.334751 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4159/8267] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:31 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:31.339640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.370411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c03b21-86fa-4a3e-82e9-22e0c76f3d93 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.376464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.377411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.378184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.378666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.379643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.382114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.401882 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4109/8268] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:31.405864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.418133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620ac8-4817-4d5f-b930-765405f6cb1f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.427333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.428973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.429568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.429871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.431930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.434676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67a47d-d1db-42d8-b6e3-548cdbaef9c0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.459310 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4160/8269] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:31.460257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.478151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f93b3e-ddca-47c2-ae45-69f2a0367f3a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.483337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.484347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.484642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.484924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] PATH_INFO: `/v3/projects/93bbbe3f781e4813951d03770dea2606/users/084f5ad7fb594747bb54d90dad0c3057/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.514585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bbbe3f781e4813951d03770dea2606, user_id=084f5ad7fb594747bb54d90dad0c3057, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.517303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.549916 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4110/8270] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:31 2022] PUT /identity/v3/projects/93bbbe3f781e4813951d03770dea2606/users/084f5ad7fb594747bb54d90dad0c3057/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:31.551937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.553326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.553908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.564841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:31.590816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] MFA Rules not processed for user `084f5ad7fb594747bb54d90dad0c3057`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:31.592435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:31.708616 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4161/8271] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:31.712905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.794334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf976-93ba-4126-a3bd-9faeee13a3a6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.800166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.801064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.801419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.801767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.803772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.805816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.846775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4111/8272] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:31 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:31.850735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:31.865602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918025c2-b352-448d-bfb8-313a689570c7 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:31.938716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:31.939412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:31.939802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:31.939997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:31.940723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:31.943394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:31.975696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4162/8273] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:31 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:31.976976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.000351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de2cd9-b27f-4177-819d-fd682b2a267b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.006237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.007348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.007823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.008280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.008839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.010572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.025935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4112/8274] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:32.027383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.037819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f932-c19c-431a-a37e-753e3ad880d9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.043329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.044106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.044389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.044665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.045388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.047001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8336b-8a8e-4b90-994f-cc89b086b777 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.063081 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4163/8275] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:32.064878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.077608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34c77-666c-4339-ae03-f55e2d7cef66 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.083110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.084067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.084356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.084638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] PATH_INFO: `/v3/projects/8c6d3ffd29c04707bb090a8a7da06e71/users/23f9ec9dfafb4613b5bc3b222c84a9a2/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.103150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6d3ffd29c04707bb090a8a7da06e71, user_id=23f9ec9dfafb4613b5bc3b222c84a9a2, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.105875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.126999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4113/8276] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:32 2022] PUT /identity/v3/projects/8c6d3ffd29c04707bb090a8a7da06e71/users/23f9ec9dfafb4613b5bc3b222c84a9a2/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:32.137996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2775-e574-4394-af22-90e7d587c166 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.138219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2775-e574-4394-af22-90e7d587c166 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.138499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2775-e574-4394-af22-90e7d587c166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.186572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-4aef2775-e574-4394-af22-90e7d587c166 None None] MFA Rules not processed for user `23f9ec9dfafb4613b5bc3b222c84a9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:32.188178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4aef2775-e574-4394-af22-90e7d587c166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:32.291471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4164/8277] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:32.296842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.345739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.346126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.346575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.354068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.369916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] MFA Rules not processed for user `2356361a22724a45a9213f5b1b4b71fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:32.372015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:32.374313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c465a0d-f3ad-4ffc-abbc-3a8e6d392e61 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.405753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.407125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.407425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.409271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.410131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.412281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.431904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.458519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4114/8279] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:32 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:32.458736 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4165/8279] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:32.459665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.550187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0411f-742c-4b82-8799-383a76422e65 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.560065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.560837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.561118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.561535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.562237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.564313 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.587748 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4115/8280] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:32 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:32.591776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.605900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47fd8-c8f5-4eea-a756-9d622a6cae74 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.612642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.613436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.613835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.614242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.615072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.616896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.631266 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4166/8281] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:32.632706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.643233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688441f5-7099-4fb3-b3c1-ace2d9ab70b5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.647873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.648765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.649097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.649435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] PATH_INFO: `/v3/projects/baa905597ed74f47b1c4f7ad531e65cc/users/1e9ee1c96d894a34a8c46688d56bd3d9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.665230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa905597ed74f47b1c4f7ad531e65cc, user_id=1e9ee1c96d894a34a8c46688d56bd3d9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.668416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.683919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4116/8282] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:32 2022] PUT /identity/v3/projects/baa905597ed74f47b1c4f7ad531e65cc/users/1e9ee1c96d894a34a8c46688d56bd3d9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:32.687975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.698311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51958f3-004f-43a4-bcea-7fdb8bb2a2a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.757462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.758153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.758562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.759004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.759786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.761461 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad4cf9-1b92-4885-b3a8-3cae6469fd8c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.772864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4167/8283] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:24:32.777324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.788577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4b24-b0d7-4d7c-8881-e1d999152e20 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.793729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.794663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.794953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.795246 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] PATH_INFO: `/v3/projects/baa905597ed74f47b1c4f7ad531e65cc/users/1e9ee1c96d894a34a8c46688d56bd3d9/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.797323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa905597ed74f47b1c4f7ad531e65cc, user_id=1e9ee1c96d894a34a8c46688d56bd3d9, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.800023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.811549 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4117/8284] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:32 2022] PUT /identity/v3/projects/baa905597ed74f47b1c4f7ad531e65cc/users/1e9ee1c96d894a34a8c46688d56bd3d9/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:32.823088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.823696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.823958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.831070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.833001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:32.857989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] MFA Rules not processed for user `1e9ee1c96d894a34a8c46688d56bd3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:32.859419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:32.919464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27045d-9e10-4b59-aceb-d2b64e82518c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:32.924304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:32.925501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:32.925501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:32.925780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] PATH_INFO: `/v3/users/186406777e0145b190da74a5ab22cff0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:32.926973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186406777e0145b190da74a5ab22cff0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:32.929467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:32.939851 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4168/8285] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:32.957780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:32.960744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:32.979033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.988936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186406777e0145b190da74a5ab22cff0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:32.989746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186406777e0145b190da74a5ab22cff0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:32.992018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.998963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186406777e0145b190da74a5ab22cff0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:32.999984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186406777e0145b190da74a5ab22cff0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:33.014815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e6b54bb8-eeef-46d7-9509-4398b3bc4343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186406777e0145b190da74a5ab22cff0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:33.032666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4118/8286] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:32 2022] DELETE /identity/v3/users/186406777e0145b190da74a5ab22cff0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:33.036853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:33.037149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:33.037942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:33.056847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:33.058069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.093542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52b333-bd60-4e1b-8a8b-f4216c818be2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:33.131080 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4119/8287] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:24:33.142002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:33.143720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.182181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:33.183055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:33.183402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:33.183811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:33.185974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.209298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0197f5-8512-4a9f-93a8-88a4b28c7c41 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:33.213390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:33.214061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:33.214331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:33.214614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:33.225140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:33.226614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:33.237032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4120/8288] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:24:33.253147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:33.254803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:33.265758 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4169/8289] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:24:33.478288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:33.480009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.561304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:33.565906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758e48a-8174-4121-bda8-c93f648b9671 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:33.572221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:33.572935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:33.573352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:33.573713 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:33.576826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.593260 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:33.594897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:33.609419 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4121/8290] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:33.886219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:33.888123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:33.918757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496e87-ba38-4ea5-85b0-e3e452c89f9d service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:33.931945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:33.934589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:33.934883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:33.935368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] PATH_INFO: `/v3/projects/4e15181a48ed4a52a4e819098b48f837` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:33.938370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e15181a48ed4a52a4e819098b48f837)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:33.940048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:33.974173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:34.008572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e15181a48ed4a52a4e819098b48f837', 'request_id': 'req-c10d28af-c9f3-4950-bba8-fbc7d2623010'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.016248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e15181a48ed4a52a4e819098b48f837', 'request_id': 'req-c10d28af-c9f3-4950-bba8-fbc7d2623010'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.024351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e15181a48ed4a52a4e819098b48f837', 'request_id': 'req-c10d28af-c9f3-4950-bba8-fbc7d2623010'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.039729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] The token cache is being invalidate because project 4e15181a48ed4a52a4e819098b48f837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:34.040216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.043234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.044919 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4170/8291] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:33 2022] DELETE /identity/v3/projects/4e15181a48ed4a52a4e819098b48f837 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:34.049923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:34.065193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82388a1e-1148-4593-98af-b4b7fb56824e service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:34.154881 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:34.155922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:34.156216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:34.156490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] PATH_INFO: `/v3/users/186a55210cf04c8cb426429289ec8f78` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:34.160615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186a55210cf04c8cb426429289ec8f78)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:34.163157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:34.234237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186a55210cf04c8cb426429289ec8f78'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.234953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186a55210cf04c8cb426429289ec8f78'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.244259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186a55210cf04c8cb426429289ec8f78'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.246279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186a55210cf04c8cb426429289ec8f78'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.260990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186a55210cf04c8cb426429289ec8f78'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.275845 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4122/8292] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:34 2022] DELETE /identity/v3/users/186a55210cf04c8cb426429289ec8f78 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:34.581588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:34.583109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:34.598082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d28af-c9f3-4950-bba8-fbc7d2623010 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:34.673409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:34.674484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:34.674815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:34.675219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] PATH_INFO: `/v3/projects/fb90a1eb1e5a43bea52e59483d3de794` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:34.676913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb90a1eb1e5a43bea52e59483d3de794)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:34.679372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:34.741221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb90a1eb1e5a43bea52e59483d3de794', 'request_id': 'req-427ab483-f807-4a25-b830-bb922eba77a5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.748148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb90a1eb1e5a43bea52e59483d3de794', 'request_id': 'req-427ab483-f807-4a25-b830-bb922eba77a5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.753746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb90a1eb1e5a43bea52e59483d3de794', 'request_id': 'req-427ab483-f807-4a25-b830-bb922eba77a5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.770769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] The token cache is being invalidate because project fb90a1eb1e5a43bea52e59483d3de794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:34.771206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.771960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.773577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4171/8293] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:34 2022] DELETE /identity/v3/projects/fb90a1eb1e5a43bea52e59483d3de794 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:34.777986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:34.779529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:34.808601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3888478-9c19-4fb3-83c0-44427e742a45 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:34.908821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:34.909765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:34.910118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:34.910466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] PATH_INFO: `/v3/users/9cca0f38b5ec4f6ba88a2dd2242e4520` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:34.912108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cca0f38b5ec4f6ba88a2dd2242e4520)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:34.914120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:34.927586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:34.989551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cca0f38b5ec4f6ba88a2dd2242e4520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:34.991014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cca0f38b5ec4f6ba88a2dd2242e4520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.000934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cca0f38b5ec4f6ba88a2dd2242e4520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.001798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cca0f38b5ec4f6ba88a2dd2242e4520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.016336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-64f26239-4121-4560-80bc-2346d0f941e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cca0f38b5ec4f6ba88a2dd2242e4520'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.031202 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4123/8294] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:24:34 2022] DELETE /identity/v3/users/9cca0f38b5ec4f6ba88a2dd2242e4520 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:35.694577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:35.697601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:35.714724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ab483-f807-4a25-b830-bb922eba77a5 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:35.803738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:35.830366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:35.831737 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:35.832445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:35.833498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] PATH_INFO: `/v3/projects/3303a78c87bf4f2fa41d57e1f6203654` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:35.834955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3303a78c87bf4f2fa41d57e1f6203654)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:35.837767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:35.911814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3303a78c87bf4f2fa41d57e1f6203654', 'request_id': 'req-b38ce916-2d62-455d-81da-bc37c7015b2a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.919833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3303a78c87bf4f2fa41d57e1f6203654', 'request_id': 'req-b38ce916-2d62-455d-81da-bc37c7015b2a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.927603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3303a78c87bf4f2fa41d57e1f6203654', 'request_id': 'req-b38ce916-2d62-455d-81da-bc37c7015b2a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.956941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] The token cache is being invalidate because project 3303a78c87bf4f2fa41d57e1f6203654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:35.957552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.958407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b38ce916-2d62-455d-81da-bc37c7015b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:35.963315 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4172/8295] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:35 2022] DELETE /identity/v3/projects/3303a78c87bf4f2fa41d57e1f6203654 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:35.968450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:35.969009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:35.969310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.000412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:36.002326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:36.091935 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4124/8296] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:36.096444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.096876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.097296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.126907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:36.129002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:36.149223 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4173/8297] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:36.149449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.168489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1630f-c0bf-4a63-86c6-dd431676a167 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.191154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.191879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.192162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.192440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.193182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:36.193488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.195144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.227862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4125/8298] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:36.231622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.248778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3b7e-b9e2-49a8-9a92-963665721cf1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.257570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.258559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.258822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.259008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.260082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.261322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.262444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.265224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:36.305320 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4174/8299] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:36 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:36.309102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.387332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5261-dd07-4899-a9f3-b9a3be74094a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.403931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883b5b-c8a0-4e4e-9c08-fb069c6c179f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.411086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.412311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.412605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.412892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.413583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.416351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.444743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:36.460984 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4175/8300] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:36 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:24:36.465292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.478252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34454c-a7aa-4dce-8c78-664131e0c569 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.480558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.481232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.481516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.481795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.484146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:36.484785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.485629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.486047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.486462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.487262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.489209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.503355 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4176/8301] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:36.509785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.523637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380ac21-c228-45f1-9225-d836d99d8d5d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.530215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.531753 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.532068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.532353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.535901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.538343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.559870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4177/8302] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:36.561775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.576135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.577596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e524b6-1e2c-4e3c-9ec1-57d2ec6108c1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.578371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a292f49-6880-466f-90af-f7ba2f4e36b6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.588360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.589688 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.590755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.591055 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4126/8303] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:36.591221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] PATH_INFO: `/v3/projects/68b72879eb004292a7ef60960ae2e22e/users/abcd1ec3a3134c8d8670b7f419b9eb4d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.594242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:36.619048 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b72879eb004292a7ef60960ae2e22e, user_id=abcd1ec3a3134c8d8670b7f419b9eb4d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.622571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.669217 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4178/8304] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:36 2022] PUT /identity/v3/projects/68b72879eb004292a7ef60960ae2e22e/users/abcd1ec3a3134c8d8670b7f419b9eb4d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:36.680857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.681205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.681507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.723975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] MFA Rules not processed for user `abcd1ec3a3134c8d8670b7f419b9eb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:36.725240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:36.819666 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4127/8305] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:36.823306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.948861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c455c2-878c-4230-9ab8-86a5274f8b30 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:36.956229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:36.957344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:36.958315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:36.958841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:36.959812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:36.975100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:36.988778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:36.990477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:37.059946 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4179/8306] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:36 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:37.060944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.188760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc41eed-df9a-478e-ba2b-a41fa83a0cf5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.200844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:37.236777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d333-65d5-425a-97cd-05b959803362 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.245662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.247902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.248256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.251023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.252167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.259493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.304821 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4180/8307] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:24:37 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:37.309179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.332303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a04b1-6e3f-4ca6-a436-edd4dd0ec6cc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.333865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.333865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.334791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.335079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.341361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:37.348078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.348862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.349216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.349564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.350394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.353296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.376187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.378685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.382290 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4181/8308] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:37.387114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.409004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7d94-c031-4f0a-815c-2f6f2a0a4b41 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.420130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.421164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.421546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.421934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] PATH_INFO: `/v3/projects/87ce7daf3782476d8a55541cd45afb53/users/ad1e45fe21b448f4bc42ee92144fc2fa/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.425011 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4128/8309] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:24:37.455336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ce7daf3782476d8a55541cd45afb53, user_id=ad1e45fe21b448f4bc42ee92144fc2fa, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.458308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.525772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4182/8310] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:37 2022] PUT /identity/v3/projects/87ce7daf3782476d8a55541cd45afb53/users/ad1e45fe21b448f4bc42ee92144fc2fa/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:24:37.526864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.539224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf1944-8a20-4126-9db9-0d7196475859 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.628826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.629531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.629816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.630689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.630978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.632653 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a8df-f079-4f1d-ab30-1818e704617a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.659498 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4129/8311] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:24:37.663692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.679234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017e6b5-307b-4830-bedb-3a352f8b3d71 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:37.714602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:37.715711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.716100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.716370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] PATH_INFO: `/v3/projects/87ce7daf3782476d8a55541cd45afb53/users/ad1e45fe21b448f4bc42ee92144fc2fa/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.731244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ce7daf3782476d8a55541cd45afb53, user_id=ad1e45fe21b448f4bc42ee92144fc2fa, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:37.734036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:37.761996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df28c9-05d1-498a-aa2d-8af264363931 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:37.762210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df28c9-05d1-498a-aa2d-8af264363931 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:37.762497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df28c9-05d1-498a-aa2d-8af264363931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:37.762671 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4183/8312] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:24:37 2022] PUT /identity/v3/projects/87ce7daf3782476d8a55541cd45afb53/users/ad1e45fe21b448f4bc42ee92144fc2fa/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:37.798833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-16df28c9-05d1-498a-aa2d-8af264363931 None None] MFA Rules not processed for user `ad1e45fe21b448f4bc42ee92144fc2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:37.801252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-16df28c9-05d1-498a-aa2d-8af264363931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:37.901290 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4130/8313] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:37.925199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:37.937396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:38.008116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4d393-17cf-4b20-af30-bbbeaf243c95 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:38.021304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:38.021992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:38.022285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:38.022596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:38.037632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:38.039312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:38.067335 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4184/8314] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:41.857637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:41.858288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:41.858288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:41.883298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] MFA Rules not processed for user `084f5ad7fb594747bb54d90dad0c3057`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:24:41.884709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:41.895645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:41.951483 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4131/8315] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:24:44.815557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:44.968356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0d379-7db9-47bd-8d77-019c061d7769 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:44.983389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:44.984136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:44.984420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:44.985169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:44.988975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:45.025423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:45.027235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:45.067887 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4185/8316] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:45.947828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:45.980576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88a91-2e34-48fc-8519-7df915a70b55 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:45.989451 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1e45fe21b448f4bc42ee92144fc2fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ce7daf3782476d8a55541cd45afb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:46.006782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:46.007284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:46.016212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:46.017508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:46.018007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:46.022264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:46.043614 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4132/8317] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:46.045031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:46.057137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6d3b2-e13d-4858-a391-9b29bb76826e service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:46.068228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1e45fe21b448f4bc42ee92144fc2fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ce7daf3782476d8a55541cd45afb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:46.069422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:46.070295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:46.071860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:46.072921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:46.077380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:46.121795 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4186/8318] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:24:46 2022] POST /identity/v3/projects => generated 349 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:24:46.126197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:46.145035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401797-c28e-4121-b168-33057333dde2 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:46.221337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1e45fe21b448f4bc42ee92144fc2fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ce7daf3782476d8a55541cd45afb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:46.222220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:46.223409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:46.223966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:46.224979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:24:46.225576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:46.227825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:46.242258 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4133/8319] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:24:47.253867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:47.268777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd191ac-cf30-4334-871d-e400d54cefab tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:47.274361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad1e45fe21b448f4bc42ee92144fc2fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ce7daf3782476d8a55541cd45afb53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:47.275278 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:47.275601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:47.275879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] PATH_INFO: `/v3/projects/1fad1f5a80e34674994873aadb885a7c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:47.277268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1fad1f5a80e34674994873aadb885a7c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:47.279498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:47.342306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fad1f5a80e34674994873aadb885a7c', 'request_id': 'req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:47.349710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fad1f5a80e34674994873aadb885a7c', 'request_id': 'req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:47.356537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fad1f5a80e34674994873aadb885a7c', 'request_id': 'req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:47.373362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:47.382991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] The token cache is being invalidate because project 1fad1f5a80e34674994873aadb885a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:24:47.383219 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:47.384007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:24:47.386106 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4187/8320] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:24:47 2022] DELETE /identity/v3/projects/1fad1f5a80e34674994873aadb885a7c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:24:47.397206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:47.399401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:47.466906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d0d6-c6fd-4f6a-8904-1d46c5ab85d4 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:47.524637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:47.525304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:47.525593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:47.525874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:47.527870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:47.538587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:47.573513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:24:47.586745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa78bed-c282-4c1b-8e0c-f5c30f6eaea8 tempest-RoutersIpV6AdminTest-463331162 tempest-RoutersIpV6AdminTest-463331162-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:24:47.590592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:24:47.591365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:24:47.591690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:24:47.592007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:24:47.593828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:24:47.601542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:47.603109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:47.613145 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4134/8321] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:24:47.667553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:24:47.670559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5615-3549-4437-a105-a8a26bef61b5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:24:47.703592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4188/8322] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:24:57.608438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=22 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:57.699914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=35 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:14.002112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:14.003707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:14.071028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffb8c8-d55b-435b-9fd6-74c4e95072fc service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:14.075982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:14.076866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:14.077146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:14.077425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] PATH_INFO: `/v3/users/abcd1ec3a3134c8d8670b7f419b9eb4d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:14.078625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcd1ec3a3134c8d8670b7f419b9eb4d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:14.080595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:14.130075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcd1ec3a3134c8d8670b7f419b9eb4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.130737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcd1ec3a3134c8d8670b7f419b9eb4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.137648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcd1ec3a3134c8d8670b7f419b9eb4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.138280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcd1ec3a3134c8d8670b7f419b9eb4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.151727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcd1ec3a3134c8d8670b7f419b9eb4d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.167431 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4135/8323] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:14 2022] DELETE /identity/v3/users/abcd1ec3a3134c8d8670b7f419b9eb4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:14.172515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:14.173033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:14.173177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:14.191167 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:14.192429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:14.262914 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4189/8324] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:25:14.274056 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:14.276207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:14.347291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfe430-a9c4-4b44-84c1-35fca38af31a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:14.351669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:14.352392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:14.352717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:14.352960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:14.363334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:14.364890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:14.376501 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4136/8325] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:25:14.678842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:14.680640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:14.694620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c84e1-f0fb-4abd-b9d0-3f4f7174f6dd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:14.701168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:14.702881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:14.703454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:14.712296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] PATH_INFO: `/v3/projects/68b72879eb004292a7ef60960ae2e22e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:14.715588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b72879eb004292a7ef60960ae2e22e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:14.717937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:14.775502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b72879eb004292a7ef60960ae2e22e', 'request_id': 'req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.781921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b72879eb004292a7ef60960ae2e22e', 'request_id': 'req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.787673 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b72879eb004292a7ef60960ae2e22e', 'request_id': 'req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.801173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] The token cache is being invalidate because project 68b72879eb004292a7ef60960ae2e22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:14.801466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.802218 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.804036 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4190/8326] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:14 2022] DELETE /identity/v3/projects/68b72879eb004292a7ef60960ae2e22e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:14.808768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:14.818892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549eb85-a86b-4f16-a4cd-ecf007d7f7a5 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:14.840215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:14.882762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:14.883719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:14.884002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:14.884438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] PATH_INFO: `/v3/users/ad1e45fe21b448f4bc42ee92144fc2fa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:14.885668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1e45fe21b448f4bc42ee92144fc2fa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:14.887634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:14.939755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1e45fe21b448f4bc42ee92144fc2fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.940512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1e45fe21b448f4bc42ee92144fc2fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.948829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1e45fe21b448f4bc42ee92144fc2fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.949645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1e45fe21b448f4bc42ee92144fc2fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.963169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1e184711-13f1-432f-9070-dec52aaff2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1e45fe21b448f4bc42ee92144fc2fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:14.978715 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4137/8327] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:14 2022] DELETE /identity/v3/users/ad1e45fe21b448f4bc42ee92144fc2fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:15.168785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.170532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:15.193764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7dc-bf81-4cc1-9033-81b86e3d7835 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.253689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.254538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.254824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.255298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] PATH_INFO: `/v3/projects/87ce7daf3782476d8a55541cd45afb53` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.256572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ce7daf3782476d8a55541cd45afb53)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.258541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.297282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:15.318000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ce7daf3782476d8a55541cd45afb53', 'request_id': 'req-f1314617-5bfe-4372-9681-729a3f4fc0d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:15.325807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ce7daf3782476d8a55541cd45afb53', 'request_id': 'req-f1314617-5bfe-4372-9681-729a3f4fc0d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:15.332271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ce7daf3782476d8a55541cd45afb53', 'request_id': 'req-f1314617-5bfe-4372-9681-729a3f4fc0d7'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:15.346355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] The token cache is being invalidate because project 87ce7daf3782476d8a55541cd45afb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:15.346675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:15.347368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f1314617-5bfe-4372-9681-729a3f4fc0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:15.349038 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4191/8328] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:15 2022] DELETE /identity/v3/projects/87ce7daf3782476d8a55541cd45afb53 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:15.367710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.368262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.368678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.391085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:15.392640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:15.469980 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4138/8329] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:15.478368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.478944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.479424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.515404 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:15.516847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:15.533881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4192/8330] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:15.535655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.547974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84620-df97-4cef-b826-d660cc0fec76 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.564116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.565293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.565772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.566160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.567533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:15.567990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.570024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.585965 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4139/8331] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:25:15.592694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.611784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d219be0-56b3-488e-b6e1-e452e0520225 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.623732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.624473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.624781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.625065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.625844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.628000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.665471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4193/8332] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:15 2022] POST /identity/v3/projects => generated 405 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:15.672322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.684642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65c8e3-b07d-4fce-9f40-2474fdea3d3f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.716145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:15.754816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.755722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.756008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.756287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.756983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.758991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.785760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4140/8333] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:15 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:15.791012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.805169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7a418-a1a8-4462-bb62-19cf8c530e5c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.812942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.813858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.814223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.814640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.820834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.820834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.834519 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4194/8334] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:15.835992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.848894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1ffd-1d7f-4d23-9650-ef3745f96c81 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.856136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.856823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.857104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.857383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.858218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.860130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fbb90-ccdb-4cc9-a977-f557e8c12299 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.879587 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4141/8335] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:15.880995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:15.893632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8092be2-03e1-44f7-8ac1-a0109964876b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:15.900974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:15.902054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.902562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.903427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] PATH_INFO: `/v3/projects/2da44ed4182848b181bac4ee11944fa6/users/f419d5ca13c14e94b10a9640f4c8ea99/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.925273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da44ed4182848b181bac4ee11944fa6, user_id=f419d5ca13c14e94b10a9640f4c8ea99, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:15.928884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:15.945031 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4195/8336] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:15 2022] PUT /identity/v3/projects/2da44ed4182848b181bac4ee11944fa6/users/f419d5ca13c14e94b10a9640f4c8ea99/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:15.956793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:15.957083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:15.957364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:15.994665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] MFA Rules not processed for user `f419d5ca13c14e94b10a9640f4c8ea99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:15.996086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:16.085888 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4142/8337] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:16.091030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.177096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024773d-1f51-4eb3-8052-a8d26c969a70 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.188768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.189782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.190084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.190366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.191155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.193573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.231197 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4196/8338] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:16 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:16.233800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.246904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0860-4038-42d2-911a-1e2799336c19 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.313965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.314714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.315007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.315282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.316090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.318008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.342606 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4143/8339] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:16 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:16.343818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.355407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c6122-8385-4f33-91b5-dcdafae0ba2b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.361258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.362039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.362365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.362725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.363548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.365534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.378009 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4197/8340] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:16.382602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.394223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2208a8-b2e5-4188-a63c-c71a565c499d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.399236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.400237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.400520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.400799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] PATH_INFO: `/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad/users/184e1d97d0c14c08bf0546c069706700/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.417004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14eb6d7d9c94b5fa8b75a5d47f8ecad, user_id=184e1d97d0c14c08bf0546c069706700, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.419852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.433775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4144/8341] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:16 2022] PUT /identity/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad/users/184e1d97d0c14c08bf0546c069706700/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:16.437966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.449829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6bfd0-8ff3-4986-bbdb-c63478c157a0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.471775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:16.525182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.526079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.526359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.526715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.527552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.529790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e87b0-a115-4422-aa09-53bbda66f144 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.541346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4198/8342] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:16.546709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.555012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:16.562808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5afc-f459-4046-82fd-e63e3292e0dd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.568511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.569578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.569925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.570163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] PATH_INFO: `/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad/users/184e1d97d0c14c08bf0546c069706700/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.573115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14eb6d7d9c94b5fa8b75a5d47f8ecad, user_id=184e1d97d0c14c08bf0546c069706700, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.575955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.589899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4145/8343] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:16 2022] PUT /identity/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad/users/184e1d97d0c14c08bf0546c069706700/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:16.604254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.604485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.604776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.647532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] MFA Rules not processed for user `184e1d97d0c14c08bf0546c069706700`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:16.649344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:16.734260 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4199/8344] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:16.747179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:16.749255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:16.817346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419058-668e-40c3-86cc-7434d9efc7c2 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:16.821338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:16.822161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:16.822450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:16.822732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:16.832420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:16.833904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f9c3-6ee0-412b-aa7d-9c54435b9f90 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:16.844245 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4146/8345] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:16.988401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:17.071005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04994dca-46ea-46e1-b36f-22e290b54016 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:17.076249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:17.077176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:17.077540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:17.077869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] PATH_INFO: `/v3/users/f419d5ca13c14e94b10a9640f4c8ea99` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:17.079125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f419d5ca13c14e94b10a9640f4c8ea99)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:17.081308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:17.137648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f419d5ca13c14e94b10a9640f4c8ea99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.139265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:17.148078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f419d5ca13c14e94b10a9640f4c8ea99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.149319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f419d5ca13c14e94b10a9640f4c8ea99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.150284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f419d5ca13c14e94b10a9640f4c8ea99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.165151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f419d5ca13c14e94b10a9640f4c8ea99'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.183080 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4200/8346] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:16 2022] DELETE /identity/v3/users/f419d5ca13c14e94b10a9640f4c8ea99 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:17.188080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:17.188403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:17.188685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:17.207927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:17.209162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:17.286137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4147/8347] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:17.299104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:17.303562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:17.374028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248008a-17b6-4583-80e7-c9c51fcbc805 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:17.378708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:17.378892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:17.379271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:17.379677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:17.391301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:17.392738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:17.402574 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4201/8348] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:17.712426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:17.714041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:17.730497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e839-8744-4be2-9950-4ae820ca1506 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:17.736607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:17.737693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:17.737991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:17.738464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] PATH_INFO: `/v3/projects/2da44ed4182848b181bac4ee11944fa6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:17.739790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da44ed4182848b181bac4ee11944fa6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:17.741941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:17.792681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da44ed4182848b181bac4ee11944fa6', 'request_id': 'req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.799549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da44ed4182848b181bac4ee11944fa6', 'request_id': 'req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.805416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da44ed4182848b181bac4ee11944fa6', 'request_id': 'req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.820596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] The token cache is being invalidate because project 2da44ed4182848b181bac4ee11944fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:17.820886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.821578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.823429 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4148/8349] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:17 2022] DELETE /identity/v3/projects/2da44ed4182848b181bac4ee11944fa6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:17.827926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:17.838905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582343da-0ccd-4ee1-927e-2e3ee81b72aa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:17.901011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:17.901789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:17.902079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:17.902413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] PATH_INFO: `/v3/users/184e1d97d0c14c08bf0546c069706700` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:17.903632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184e1d97d0c14c08bf0546c069706700)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:17.905573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:17.957972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184e1d97d0c14c08bf0546c069706700'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.968126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184e1d97d0c14c08bf0546c069706700'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.969063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184e1d97d0c14c08bf0546c069706700'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.969966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184e1d97d0c14c08bf0546c069706700'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:17.982093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:17.985034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5dce6ac6-5d43-471d-b179-d11d6324b990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184e1d97d0c14c08bf0546c069706700'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.002242 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4202/8350] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:17 2022] DELETE /identity/v3/users/184e1d97d0c14c08bf0546c069706700 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:18.316175 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.317921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:18.338358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8d1e2-051e-4627-b0c9-73909e9d17a9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.351433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:18.410809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.412181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.412467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.412746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] PATH_INFO: `/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.414055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14eb6d7d9c94b5fa8b75a5d47f8ecad)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.416642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.477979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14eb6d7d9c94b5fa8b75a5d47f8ecad', 'request_id': 'req-42c48eff-068d-453b-9a89-770b7dc99e38'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.485261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14eb6d7d9c94b5fa8b75a5d47f8ecad', 'request_id': 'req-42c48eff-068d-453b-9a89-770b7dc99e38'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.491227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14eb6d7d9c94b5fa8b75a5d47f8ecad', 'request_id': 'req-42c48eff-068d-453b-9a89-770b7dc99e38'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.505643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] The token cache is being invalidate because project c14eb6d7d9c94b5fa8b75a5d47f8ecad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:18.506011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.506667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-42c48eff-068d-453b-9a89-770b7dc99e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:18.508442 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4149/8351] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:18 2022] DELETE /identity/v3/projects/c14eb6d7d9c94b5fa8b75a5d47f8ecad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:18.514384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.514948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.515146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.535820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:18.537130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:18.611246 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4203/8352] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:18.619383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.619838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.620178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.641702 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:18.643176 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:18.652338 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4150/8353] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:18.656748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.667925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e225c-b92b-4022-bc99-499e08d53f4e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.672550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.673421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.673711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.674028 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.674996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:18.675314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.677192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.691218 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4204/8354] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:18.695850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.706685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3186a1c-ed1d-4af4-9a15-62e654966cfa None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.711828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.712527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.713291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.713291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.713961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.715932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.745844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4151/8355] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:18 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:18.750676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.762940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635510a1-d447-44cc-9148-5adeecab939c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.826253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.826977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.827266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.827619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.828379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.830680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.855007 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4205/8356] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:18 2022] POST /identity/v3/users => generated 279 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:18.859483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.871236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc71bf-9405-4580-9d9b-32901f55d018 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.877138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.877834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.878117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.878394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.879130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.881124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.894265 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4152/8357] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:18.898806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.910233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda58a-4c42-4c5f-8f8a-7714ac021f14 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.915493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.916366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.916649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.916934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.917833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.919752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f59e-e35a-4b4d-aaf0-25b8a0776356 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.934187 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4206/8358] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:18.935588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:18.947200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666d851-c425-4505-baee-1d59c00ba69a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:18.952672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:18.953597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:18.953879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:18.954182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] PATH_INFO: `/v3/projects/9168cbf2600049e4a1fa2acc0072477f/users/92d327337ecb4f5395eac629f6416c11/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:18.970147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9168cbf2600049e4a1fa2acc0072477f, user_id=92d327337ecb4f5395eac629f6416c11, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:18.973222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:18.987674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4153/8359] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:18 2022] PUT /identity/v3/projects/9168cbf2600049e4a1fa2acc0072477f/users/92d327337ecb4f5395eac629f6416c11/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:19.000012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.000312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.000621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.033661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] MFA Rules not processed for user `92d327337ecb4f5395eac629f6416c11`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:19.035034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:19.081456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:19.108050 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4207/8360] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:19.113245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.164927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:19.185961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e8ba8-0501-4760-b50a-7eaebbc83c01 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.190973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.191743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.192050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.192401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.193206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.195275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.228510 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4154/8361] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:19 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:19.230121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.242318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7679c6-1f24-4be6-9f94-1d79cb106ecf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.301855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.302574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.302892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.303206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.304162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.306448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.335117 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4208/8362] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:19 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:19.338293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.349526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f3384-d1e4-4210-84dd-49814c99324f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.355358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.356113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.356371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.356691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.357455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.359113 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.374668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4155/8363] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:19.376033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.387281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af331-16cf-468f-af09-9e468244769a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.392764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.393743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.394050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.394328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] PATH_INFO: `/v3/projects/586f4acdc42542bb809a145ec68d5c59/users/4cfc87932847450481ad25556a423fd2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.414026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586f4acdc42542bb809a145ec68d5c59, user_id=4cfc87932847450481ad25556a423fd2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.417900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.433441 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4209/8364] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:19 2022] PUT /identity/v3/projects/586f4acdc42542bb809a145ec68d5c59/users/4cfc87932847450481ad25556a423fd2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:19.438006 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.448515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ad8-c5ab-49b9-8d0a-9f3977ea7616 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.527446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.528161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.528448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.528728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.529529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.531184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4040b-db1a-47ea-84ff-7ad2210ebefd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.542909 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4156/8365] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:19.548051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.561834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e9d41-2304-4515-afc7-19b0230fb0a2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.568024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.568924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.569245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.569524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] PATH_INFO: `/v3/projects/586f4acdc42542bb809a145ec68d5c59/users/4cfc87932847450481ad25556a423fd2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.571932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=586f4acdc42542bb809a145ec68d5c59, user_id=4cfc87932847450481ad25556a423fd2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.574751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.587338 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4210/8366] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:19 2022] PUT /identity/v3/projects/586f4acdc42542bb809a145ec68d5c59/users/4cfc87932847450481ad25556a423fd2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:19.599095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.599464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.599786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.631645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] MFA Rules not processed for user `4cfc87932847450481ad25556a423fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:19.633152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:19.711649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4157/8367] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:19.725691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.728019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:19.798570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c7ad5-af03-4952-89a6-d42fcbc3e5cf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.802775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.803534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.803818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.804091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.815031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.816548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b51b5-c928-4006-8ce7-037f45ecb0c1 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:19.828374 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4211/8368] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:19.908928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:19.923242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b62c3-e300-4462-91e5-ae8abe361e0a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:19.927024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:19.927714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:19.928051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:19.928334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:19.968667 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:19.996558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:19.998021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:20.008668 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4158/8369] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:19 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:25:29.822458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:30.003694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:33.925108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:33.925698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:33.925698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:33.952886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] MFA Rules not processed for user `084f5ad7fb594747bb54d90dad0c3057`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:33.955011 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:34.037360 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4212/8370] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:34.371012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:34.372519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:34.441805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81a335-4517-4a4e-8298-36a89a4b6b41 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:34.446449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:34.447184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:34.447669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:34.448048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:34.450773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:34.469367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:34.471187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446ec9-439d-49d4-af22-3c823f718553 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:34.485360 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4159/8371] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:35.505457 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:35.579784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55cda1-c545-4866-b10f-c8291dc13ffd None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:35.588020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:35.593251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:35.593716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:35.594202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] PATH_INFO: `/v3/users/92d327337ecb4f5395eac629f6416c11` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:35.597027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d327337ecb4f5395eac629f6416c11)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:35.600630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:35.678297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d327337ecb4f5395eac629f6416c11'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:35.687015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d327337ecb4f5395eac629f6416c11'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:35.687972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d327337ecb4f5395eac629f6416c11'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:35.688671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d327337ecb4f5395eac629f6416c11'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:35.705301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d327337ecb4f5395eac629f6416c11'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:35.723223 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4213/8372] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:35 2022] DELETE /identity/v3/users/92d327337ecb4f5395eac629f6416c11 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:35.728164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:35.729055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:35.729489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:35.753312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:35.754871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:35.835091 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4160/8373] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:35.841921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:35.844304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:35.877015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:35.914097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6525718-26ac-4b4b-a146-499ab0f203a6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:35.918179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:35.918841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:35.919129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:35.919412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:35.930545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:35.933266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:35.944042 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4214/8374] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:36.425387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:36.426948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:36.442661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145dda-bb27-47bc-9e1f-a4f769a40ebd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:36.448848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:36.449833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:36.450188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:36.450539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] PATH_INFO: `/v3/projects/9168cbf2600049e4a1fa2acc0072477f` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:36.452320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9168cbf2600049e4a1fa2acc0072477f)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:36.454794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:36.514216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9168cbf2600049e4a1fa2acc0072477f', 'request_id': 'req-1aca0ac5-e70c-4154-bb83-8af227f4574d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.521568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9168cbf2600049e4a1fa2acc0072477f', 'request_id': 'req-1aca0ac5-e70c-4154-bb83-8af227f4574d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.528129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9168cbf2600049e4a1fa2acc0072477f', 'request_id': 'req-1aca0ac5-e70c-4154-bb83-8af227f4574d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.544815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] The token cache is being invalidate because project 9168cbf2600049e4a1fa2acc0072477f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:36.545413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.545941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.548352 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4161/8375] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:36 2022] DELETE /identity/v3/projects/9168cbf2600049e4a1fa2acc0072477f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:36.552907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:36.568621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7b2e1-abe4-4f30-afc0-77e656ff2f20 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:36.675307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:36.676495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:36.676897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:36.677476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] PATH_INFO: `/v3/users/4cfc87932847450481ad25556a423fd2` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:36.679033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cfc87932847450481ad25556a423fd2)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:36.681738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:36.764711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cfc87932847450481ad25556a423fd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.774567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cfc87932847450481ad25556a423fd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.776391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cfc87932847450481ad25556a423fd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.777180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cfc87932847450481ad25556a423fd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.795765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-01c44115-5fe3-4ee6-8e01-025af1b29942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cfc87932847450481ad25556a423fd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:36.818876 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4215/8376] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:36 2022] DELETE /identity/v3/users/4cfc87932847450481ad25556a423fd2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:37.157017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.158691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:37.184167 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0ac5-e70c-4154-bb83-8af227f4574d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.232476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:37.287609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.288599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.289089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.289467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] PATH_INFO: `/v3/projects/586f4acdc42542bb809a145ec68d5c59` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.290906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=586f4acdc42542bb809a145ec68d5c59)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.300435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.379847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586f4acdc42542bb809a145ec68d5c59', 'request_id': 'req-b866dc52-e1b1-4900-aa01-688fb3a2ebca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:37.391995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586f4acdc42542bb809a145ec68d5c59', 'request_id': 'req-b866dc52-e1b1-4900-aa01-688fb3a2ebca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:37.399784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586f4acdc42542bb809a145ec68d5c59', 'request_id': 'req-b866dc52-e1b1-4900-aa01-688fb3a2ebca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:37.419414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] The token cache is being invalidate because project 586f4acdc42542bb809a145ec68d5c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:37.420088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:37.421225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b866dc52-e1b1-4900-aa01-688fb3a2ebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:37.423218 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4162/8377] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:37 2022] DELETE /identity/v3/projects/586f4acdc42542bb809a145ec68d5c59 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:37.428664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.429032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.429640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.452352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:37.453727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:37.516654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:37.550432 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4216/8378] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:25:37.552621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.552916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.553238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.583367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:37.584990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:37.594634 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4163/8379] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:37.599996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.614511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2ec1c-75c0-4e29-81cc-1bd4724ccd67 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.619595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.620290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.620575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.620853 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.621601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:37.621912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.623818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.637323 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4217/8380] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:37.642252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.652464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0d08-cc53-45c9-9bfd-8b50015b6ce3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.658143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.659001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.659557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.659692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.660298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.662339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.703147 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4164/8381] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:37 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:37.704565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.715242 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3922a-8317-411b-be51-23f878f06e61 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.774963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.775684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.775973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.776277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.776953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.778891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.803089 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4218/8382] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:37 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:37.807042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.818689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928ecb9-d462-4445-b92d-e037f45f57ef admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.825399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.826479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.827069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.827622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.828488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.830285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.845800 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4165/8383] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:37.847120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.858316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e119bd-04e9-45c6-9e40-a30139d50757 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.863801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.864474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.864762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.865035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.865837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.867382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd0eb8-2cdf-45c8-bad5-1d4cb22c1e7f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.882564 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4219/8384] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:37.886800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:37.900301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd745-57d2-409a-9757-588e1cc86649 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:37.906179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:37.907136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.908234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.908531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] PATH_INFO: `/v3/projects/5ad17bcc26fe4abb99037ad0d1487dd0/users/e0e29f1ab3b54aaf9cb993597f8b6538/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.927890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad17bcc26fe4abb99037ad0d1487dd0, user_id=e0e29f1ab3b54aaf9cb993597f8b6538, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:37.930599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:37.951158 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4166/8385] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:37 2022] PUT /identity/v3/projects/5ad17bcc26fe4abb99037ad0d1487dd0/users/e0e29f1ab3b54aaf9cb993597f8b6538/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:37.962293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:37.962557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:37.962702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:37.996525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] MFA Rules not processed for user `e0e29f1ab3b54aaf9cb993597f8b6538`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:37.997929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:38.086471 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4220/8386] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:38.091281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.150845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:38.164825 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2c3c5-6f51-45a0-bfe2-6371999d309c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.172808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.173504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.173788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.174073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.174791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.177287 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.216032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4167/8387] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:38 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:38.220196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.231710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16e3aa-a271-4908-bca0-57e07d11ccb2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.286452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:38.309017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.309815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.310208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.311748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.313824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.315958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.339275 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4221/8388] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:38 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:38.343425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.354744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5ec8-4384-47ad-90b5-7d8ab596386a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.359769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.360449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.360734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.361019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.361757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.363389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.378007 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4168/8389] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:38.380159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.392774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddf2b-abf2-415d-8d15-a0130b550db6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.397971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.398942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.399192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.399471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] PATH_INFO: `/v3/projects/6986a9920cff482499fd8f7135d2a47b/users/03a80865ed2540b5b1a349e7f67d7f26/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.415685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6986a9920cff482499fd8f7135d2a47b, user_id=03a80865ed2540b5b1a349e7f67d7f26, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.418389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.439554 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4222/8390] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:38 2022] PUT /identity/v3/projects/6986a9920cff482499fd8f7135d2a47b/users/03a80865ed2540b5b1a349e7f67d7f26/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:38.441223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.452966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04ae74-17b4-497f-947d-392ad364ce64 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.516149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.516963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.517428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.517798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.518592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.520320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0f01d-b472-47fc-b6f6-d1bfbaa030b0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.531162 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4169/8391] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:38.535454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.547193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a864-0888-4514-9e6b-58208401b3bb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.552455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.553437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.553795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.554142 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] PATH_INFO: `/v3/projects/6986a9920cff482499fd8f7135d2a47b/users/03a80865ed2540b5b1a349e7f67d7f26/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.556536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6986a9920cff482499fd8f7135d2a47b, user_id=03a80865ed2540b5b1a349e7f67d7f26, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.559494 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.571847 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4223/8392] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:38 2022] PUT /identity/v3/projects/6986a9920cff482499fd8f7135d2a47b/users/03a80865ed2540b5b1a349e7f67d7f26/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:38.583484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.583923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.584362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.613890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] MFA Rules not processed for user `03a80865ed2540b5b1a349e7f67d7f26`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:38.615104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:38.689280 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4170/8393] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:38.700230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.702141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:38.766645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb5e31-7ec1-4bf8-8695-67b1647f518d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.770689 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.771326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.771640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.771910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.782213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:38.783738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:38.794399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4224/8394] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:38.879386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:38.880936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:38.946155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:38.980309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7bd7-08a4-4408-b79d-f3974c699a88 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:38.986551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:38.987329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:38.987541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:38.987828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:38.989813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:39.005888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:39.007766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8934ac3-bc79-4a61-8db2-a8b1a1ebb924 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:39.026507 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4171/8395] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:40.292906 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:40.359350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15761322-e83a-4194-942b-a8e1e9747f12 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:40.364499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:40.365381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:40.365668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:40.365943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] PATH_INFO: `/v3/users/e0e29f1ab3b54aaf9cb993597f8b6538` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:40.367193 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e29f1ab3b54aaf9cb993597f8b6538)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:40.369182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:40.424850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:40.436001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e29f1ab3b54aaf9cb993597f8b6538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:40.445308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e29f1ab3b54aaf9cb993597f8b6538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:40.446635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e29f1ab3b54aaf9cb993597f8b6538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:40.446878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e29f1ab3b54aaf9cb993597f8b6538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:40.461376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e29f1ab3b54aaf9cb993597f8b6538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:40.478940 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4225/8396] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:40 2022] DELETE /identity/v3/users/e0e29f1ab3b54aaf9cb993597f8b6538 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:40.484266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:40.485121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:40.485411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:40.665022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:40.666321 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:40.758640 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4172/8397] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:40.771271 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:40.772821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:40.845052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427bbb-7818-44c0-a569-0df33d61a605 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:40.849450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:40.850202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:40.850415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:40.850675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:40.861772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:40.863429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:40.874872 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4226/8398] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:41.210253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:41.211971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:41.225967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23390a-6b5c-48fd-8eb3-9533881c583e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:41.234812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:41.236083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:41.236771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:41.237220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] PATH_INFO: `/v3/projects/5ad17bcc26fe4abb99037ad0d1487dd0` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:41.238632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad17bcc26fe4abb99037ad0d1487dd0)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:41.241062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:41.301473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad17bcc26fe4abb99037ad0d1487dd0', 'request_id': 'req-376a2fd7-76de-4882-8026-3987d8e63cf5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.308207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad17bcc26fe4abb99037ad0d1487dd0', 'request_id': 'req-376a2fd7-76de-4882-8026-3987d8e63cf5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.314483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad17bcc26fe4abb99037ad0d1487dd0', 'request_id': 'req-376a2fd7-76de-4882-8026-3987d8e63cf5'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.330275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] The token cache is being invalidate because project 5ad17bcc26fe4abb99037ad0d1487dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:41.330560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.331200 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.333103 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4173/8399] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:41 2022] DELETE /identity/v3/projects/5ad17bcc26fe4abb99037ad0d1487dd0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:41.338063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:41.350733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e07a30-61d8-4548-a438-e42b5a9ded61 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:41.421817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:41.422813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:41.423098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:41.423379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] PATH_INFO: `/v3/users/03a80865ed2540b5b1a349e7f67d7f26` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:41.424650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a80865ed2540b5b1a349e7f67d7f26)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:41.426731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:41.481055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a80865ed2540b5b1a349e7f67d7f26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.489755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a80865ed2540b5b1a349e7f67d7f26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.490537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a80865ed2540b5b1a349e7f67d7f26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.491223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a80865ed2540b5b1a349e7f67d7f26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.496380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:41.507612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b562a1b2-4fe6-47b6-987a-d1ba3a5e770a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a80865ed2540b5b1a349e7f67d7f26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.524160 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4227/8400] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:41 2022] DELETE /identity/v3/users/03a80865ed2540b5b1a349e7f67d7f26 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:41.836277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:41.837819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:41.856692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a2fd7-76de-4882-8026-3987d8e63cf5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:41.913914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:41.926549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:41.927818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:41.928057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:41.928432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] PATH_INFO: `/v3/projects/6986a9920cff482499fd8f7135d2a47b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:41.929963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6986a9920cff482499fd8f7135d2a47b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:41.932366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:41.988335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6986a9920cff482499fd8f7135d2a47b', 'request_id': 'req-21f4a777-7f04-4e3d-93a6-603f5a3926d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:41.995996 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6986a9920cff482499fd8f7135d2a47b', 'request_id': 'req-21f4a777-7f04-4e3d-93a6-603f5a3926d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:42.002651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6986a9920cff482499fd8f7135d2a47b', 'request_id': 'req-21f4a777-7f04-4e3d-93a6-603f5a3926d3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:42.019015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] The token cache is being invalidate because project 6986a9920cff482499fd8f7135d2a47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:42.028205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:42.029098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-21f4a777-7f04-4e3d-93a6-603f5a3926d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:42.035362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4174/8401] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:41 2022] DELETE /identity/v3/projects/6986a9920cff482499fd8f7135d2a47b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:42.037444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.037768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.038092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.064934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:42.067953 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:42.139758 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4228/8402] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:42.148459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.148841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.149192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.171383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:42.172675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:42.182447 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4175/8403] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:42.187629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.199693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a383bd-3689-4c12-86c1-c642452571d9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.208275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.209273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.209638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.210068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.211180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:42.211692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.213903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.229379 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4229/8404] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:42.233892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.244296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0af2f-887a-4989-b095-97bb78fa277a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.250417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.251085 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.251367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.251683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.252454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.254519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.284898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4176/8405] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:42.290794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.302397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6266318-7669-482d-952b-7e2598211550 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.368594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.369358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.369640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.369982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.370824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.372929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.398470 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4230/8406] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:42.402984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.414791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b95a4f-8d2e-417d-9246-b4c876f62453 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.420481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.421256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.421567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.421939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.422829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.424754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.438303 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4177/8407] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:42.442623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.455686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a22c1f-909c-4886-a1dd-5202780656f8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.461384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.462096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.462424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.462744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.463662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.465315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da915c8d-dcf3-4a40-9e41-4e9cc460af6a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.478510 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4231/8408] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:42.483486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.494294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed665-385b-42d0-867b-b5777a630994 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.500155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.500972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.501255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.501536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] PATH_INFO: `/v3/projects/dde8249b3f204026a8bad3be532da3f0/users/9f4e05841dac4708a8ba31fc69ff27fa/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.518102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde8249b3f204026a8bad3be532da3f0, user_id=9f4e05841dac4708a8ba31fc69ff27fa, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.520892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.536471 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4178/8409] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:42 2022] PUT /identity/v3/projects/dde8249b3f204026a8bad3be532da3f0/users/9f4e05841dac4708a8ba31fc69ff27fa/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:42.548558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.549153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.549839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.588371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] MFA Rules not processed for user `9f4e05841dac4708a8ba31fc69ff27fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:42.589636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:42.624422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:42.664723 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4232/8410] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:42.671565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.755280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc3ed-814b-4509-98e9-d4cab6eec770 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.761629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.762506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.762858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.763683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.765245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.767208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.804999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4179/8411] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:42.806807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.819329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a909e1-1a5b-4e3f-995e-fd1cbfcff251 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.902140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.902950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.903239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.903600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.904402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.906670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.946859 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4233/8412] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:42 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:42.951180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:42.958872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:42.964797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b96-17a1-4cb2-99bc-c28a184968dd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:42.973227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:42.974437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:42.974999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:42.975617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:42.977100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:42.978786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:42.991487 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4180/8413] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:42.995327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:43.008000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6f21-9f18-4c6c-a5b8-7a6bba8cc944 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:43.015113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:43.016069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.016357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.016651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] PATH_INFO: `/v3/projects/a699747898f24c10976aa96fec1273d5/users/eadbd9b8d8154a66befbeb13cd335da6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.034917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a699747898f24c10976aa96fec1273d5, user_id=eadbd9b8d8154a66befbeb13cd335da6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:43.037880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:43.054069 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4234/8414] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:42 2022] PUT /identity/v3/projects/a699747898f24c10976aa96fec1273d5/users/eadbd9b8d8154a66befbeb13cd335da6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:43.059234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:43.071609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fa2c-a42a-4af7-86cc-5bdb95a92aa3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:43.137257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:43.137932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.138592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.139067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.140005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:43.141562 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6931-4a53-4f97-9a8c-8ea46ed0039d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:43.152906 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4181/8415] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:43.157420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:43.169319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b286f-4333-4a1f-954f-df96fe0578fe admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:43.175987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:43.177147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.177473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.177756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] PATH_INFO: `/v3/projects/a699747898f24c10976aa96fec1273d5/users/eadbd9b8d8154a66befbeb13cd335da6/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.180027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a699747898f24c10976aa96fec1273d5, user_id=eadbd9b8d8154a66befbeb13cd335da6, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:43.182728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:43.196726 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4235/8416] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:43 2022] PUT /identity/v3/projects/a699747898f24c10976aa96fec1273d5/users/eadbd9b8d8154a66befbeb13cd335da6/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:43.208816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.209154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.209444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.240782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] MFA Rules not processed for user `eadbd9b8d8154a66befbeb13cd335da6`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:43.242133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:43.315834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4182/8417] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:25:43.328402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:43.330192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:43.405678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbbab-3070-4966-b3d4-6b35cdaeeb40 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:43.409903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:43.410653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.410936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.411247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.422952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:43.424658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:43.436385 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4236/8418] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:43.483868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:43.485363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:43.500862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdee02-4c71-40a2-b79c-7238920fe545 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:43.504437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:43.505146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:43.505428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:43.505777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:43.570013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:43.571691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:43.581584 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4183/8419] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:45.095727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:45.098726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:45.138833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:45.187188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2029ef-4d25-4f10-8f2d-149d50ecf16a service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:45.190564 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:45.191411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:45.191721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:45.192113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:45.194345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:45.210653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:45.212335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506f9ce-fadb-4c03-8de3-a9cbc4104ba2 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:45.229975 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4237/8420] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:47.033147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:47.047150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:47.106836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7550f-dd1b-4cae-9483-a3d1c080af96 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:47.112744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:47.113684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:47.113964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:47.114239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] PATH_INFO: `/v3/users/9f4e05841dac4708a8ba31fc69ff27fa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:47.115557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4e05841dac4708a8ba31fc69ff27fa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:47.117701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:47.172896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4e05841dac4708a8ba31fc69ff27fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.173558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4e05841dac4708a8ba31fc69ff27fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.181163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4e05841dac4708a8ba31fc69ff27fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.181959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4e05841dac4708a8ba31fc69ff27fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.195095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4e05841dac4708a8ba31fc69ff27fa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.208973 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4184/8421] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:47 2022] DELETE /identity/v3/users/9f4e05841dac4708a8ba31fc69ff27fa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:47.213577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:47.214078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:47.214207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:47.232153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:47.233352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:47.297833 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4238/8422] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:47.308565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:47.310335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:47.385877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa424-a54f-43cc-824d-2ae99cd4a5b9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:47.390497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:47.391210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:47.391693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:47.391971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:47.403922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:47.405408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:47.418415 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4185/8423] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:47.742403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:47.744454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:47.768500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b04e-1617-4ae2-b5b5-25a30ddf0380 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:47.775022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:47.776326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:47.776649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:47.777234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] PATH_INFO: `/v3/projects/dde8249b3f204026a8bad3be532da3f0` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:47.778869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde8249b3f204026a8bad3be532da3f0)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:47.781654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:47.844687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde8249b3f204026a8bad3be532da3f0', 'request_id': 'req-eb717d50-9641-4d1b-8216-340a7eb50d97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.857241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde8249b3f204026a8bad3be532da3f0', 'request_id': 'req-eb717d50-9641-4d1b-8216-340a7eb50d97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.866859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde8249b3f204026a8bad3be532da3f0', 'request_id': 'req-eb717d50-9641-4d1b-8216-340a7eb50d97'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.883733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] The token cache is being invalidate because project dde8249b3f204026a8bad3be532da3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:47.884309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.885129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:47.887308 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4239/8424] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:47 2022] DELETE /identity/v3/projects/dde8249b3f204026a8bad3be532da3f0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:47.891605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:47.904193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128393da-a9e5-4a31-82fe-23c9338df408 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:47.955078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:47.989773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:47.990701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:47.990980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:47.991253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] PATH_INFO: `/v3/users/eadbd9b8d8154a66befbeb13cd335da6` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:47.992490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadbd9b8d8154a66befbeb13cd335da6)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:47.994402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:48.048603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadbd9b8d8154a66befbeb13cd335da6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.049341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadbd9b8d8154a66befbeb13cd335da6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.058541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadbd9b8d8154a66befbeb13cd335da6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.059304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadbd9b8d8154a66befbeb13cd335da6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.075308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-72444be1-5c68-4cdb-861a-933469355904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadbd9b8d8154a66befbeb13cd335da6'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.090451 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4186/8425] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:47 2022] DELETE /identity/v3/users/eadbd9b8d8154a66befbeb13cd335da6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:48.486031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:48.487810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:48.504678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb717d50-9641-4d1b-8216-340a7eb50d97 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:48.555378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:48.577063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:48.579478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:48.580094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:48.580672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] PATH_INFO: `/v3/projects/a699747898f24c10976aa96fec1273d5` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:48.582696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a699747898f24c10976aa96fec1273d5)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:48.585034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:48.636050 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a699747898f24c10976aa96fec1273d5', 'request_id': 'req-19d80d62-688a-4d7b-886f-3fb30b98957e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.642703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a699747898f24c10976aa96fec1273d5', 'request_id': 'req-19d80d62-688a-4d7b-886f-3fb30b98957e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.648444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a699747898f24c10976aa96fec1273d5', 'request_id': 'req-19d80d62-688a-4d7b-886f-3fb30b98957e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.663006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] The token cache is being invalidate because project a699747898f24c10976aa96fec1273d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:48.663325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.664060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-19d80d62-688a-4d7b-886f-3fb30b98957e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:48.665813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4240/8426] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:48 2022] DELETE /identity/v3/projects/a699747898f24c10976aa96fec1273d5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:48.671197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:48.671494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:48.671955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:48.691961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:48.693191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:48.762920 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4187/8427] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:48.773409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:48.774061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:48.774760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:48.797575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:48.798855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:48.808535 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4241/8428] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:48.812925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:48.824910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42d0c-9f14-45c6-9182-8b2f421f6284 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:48.830169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:48.831940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:48.832228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:48.832469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:48.833169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:48.833437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:48.835281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:48.854180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4188/8429] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:25:48.856355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:48.867739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40896bc7-fc4a-4c14-ab5a-18b0ff08af13 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:48.873584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:48.874307 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:48.874678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:48.874952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:48.875777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:48.877772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:48.907623 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4242/8430] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:48 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:48.910554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:48.921466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e847-35ad-450a-b053-cccc73b29b0d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:48.978976 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:49.004467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.005210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.005524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.005814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.006554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.008807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.032734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4189/8431] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:48 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:49.037434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.048876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040b630-69ae-413c-b9e0-b3c7d0e1c3e8 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.054606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.055304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.055621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.055878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.056611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.058280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.069515 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4243/8432] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:49.073655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.085111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c360d-7400-4f7b-a352-4596ade7c01a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.091272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.092253 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.092531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.092861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.093733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.095489 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9be3f-4c74-46a2-983c-cdb843a3fdd8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.107190 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4190/8433] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:49.111945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.122484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0044e-f0cd-4a46-95e2-29dc8a06bbcb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.127856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.128726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.129018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.129280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] PATH_INFO: `/v3/projects/ef0e7b73f38c4c70a4a36b4c35ac632e/users/29baa28bd0424a70a43266f851c0b10a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.146114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0e7b73f38c4c70a4a36b4c35ac632e, user_id=29baa28bd0424a70a43266f851c0b10a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.148947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.164878 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4244/8434] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:49 2022] PUT /identity/v3/projects/ef0e7b73f38c4c70a4a36b4c35ac632e/users/29baa28bd0424a70a43266f851c0b10a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:49.178415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.178742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.179114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.208956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] MFA Rules not processed for user `29baa28bd0424a70a43266f851c0b10a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:49.210190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:49.282250 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4191/8435] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:49.287051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.355827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4ed1-b6ac-45c9-8280-ae91d8eac5ec admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.361211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.362007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.362366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.362823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.363421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.365594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.381484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:49.401127 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4245/8436] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:49.402835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.414993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd69ee-fc2a-44b4-9372-2b41f0546083 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.476098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.476782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.477093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.477369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.478137 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.480098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.503264 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4192/8437] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:49 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:49.507755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.520488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e34e5-55c5-49c2-9168-f16b66e612f0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.525761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.526667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.526959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.527490 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.528506 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.530328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.546884 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4246/8438] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:49.548261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.559244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8afbc-2d49-49b2-b17f-5a074af22eb1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.564832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.565810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.566099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.566378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] PATH_INFO: `/v3/projects/7a51cd18ae034e979b1ec53b8182430d/users/6a531bc76baf436a904ac7c318ad7e67/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.593136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a51cd18ae034e979b1ec53b8182430d, user_id=6a531bc76baf436a904ac7c318ad7e67, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.596017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.616893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4193/8439] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:49 2022] PUT /identity/v3/projects/7a51cd18ae034e979b1ec53b8182430d/users/6a531bc76baf436a904ac7c318ad7e67/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:49.617505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.628996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb0619-491f-45d4-b191-1604a54505bf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.692243 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.692930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.693210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.693484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.694206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.696521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8db94-31bb-4c2f-a00f-6f8f182bcf42 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.712909 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4247/8440] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:49.714529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.730217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185983-cdc1-42dc-80df-63ae84d73d03 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.735374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.736378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.736723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.737060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] PATH_INFO: `/v3/projects/7a51cd18ae034e979b1ec53b8182430d/users/6a531bc76baf436a904ac7c318ad7e67/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.739654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a51cd18ae034e979b1ec53b8182430d, user_id=6a531bc76baf436a904ac7c318ad7e67, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.742380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.748841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:49.754092 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4194/8441] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:49 2022] PUT /identity/v3/projects/7a51cd18ae034e979b1ec53b8182430d/users/6a531bc76baf436a904ac7c318ad7e67/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:49.764582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.764875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.765155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.794381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] MFA Rules not processed for user `6a531bc76baf436a904ac7c318ad7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:49.795746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:49.873845 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4248/8442] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:49.887799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:49.890133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:49.966482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c193-102c-43f7-9ce7-e13a05134581 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:49.970421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:49.971079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:49.971391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:49.971729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:49.983265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:49.984803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334369ff-fcd2-4545-84d0-915d91bf43aa service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:49.994758 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4195/8443] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:50.143158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:50.218996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9eb91-242f-4161-87eb-8a5fd31cb3ba None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:50.224951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:50.225761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:50.226044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:50.226331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] PATH_INFO: `/v3/users/29baa28bd0424a70a43266f851c0b10a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:50.227820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29baa28bd0424a70a43266f851c0b10a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:50.229731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:50.235298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:50.284413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29baa28bd0424a70a43266f851c0b10a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:50.291814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29baa28bd0424a70a43266f851c0b10a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:50.293249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29baa28bd0424a70a43266f851c0b10a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:50.293409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29baa28bd0424a70a43266f851c0b10a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:50.306416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29baa28bd0424a70a43266f851c0b10a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:50.321938 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4249/8444] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:50 2022] DELETE /identity/v3/users/29baa28bd0424a70a43266f851c0b10a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:50.327436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:50.328063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:50.328423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:50.347697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:50.349039 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:50.421149 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4196/8445] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:50.432427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:50.433882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:50.502514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa22fa6-4834-4e3e-9798-46d4d29e2e5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:50.507261 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:50.507985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:50.508573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:50.508573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:50.520101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:50.522052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:50.533343 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4250/8446] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:50.896093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:50.898565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:50.915780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58715ecd-23f1-4dfb-abfa-bb57da2112fd None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:50.925230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:50.926983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:50.927526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:50.927705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] PATH_INFO: `/v3/projects/ef0e7b73f38c4c70a4a36b4c35ac632e` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:50.929163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0e7b73f38c4c70a4a36b4c35ac632e)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:50.931438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:50.993668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0e7b73f38c4c70a4a36b4c35ac632e', 'request_id': 'req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.001092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0e7b73f38c4c70a4a36b4c35ac632e', 'request_id': 'req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.008529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0e7b73f38c4c70a4a36b4c35ac632e', 'request_id': 'req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.023957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] The token cache is being invalidate because project ef0e7b73f38c4c70a4a36b4c35ac632e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:51.024252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.024998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.026651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4197/8447] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:50 2022] DELETE /identity/v3/projects/ef0e7b73f38c4c70a4a36b4c35ac632e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:51.031549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:51.042406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed376a8-2465-4adf-b1dd-20e4a63778b2 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:51.106134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:51.107446 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:51.107793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:51.108071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] PATH_INFO: `/v3/users/6a531bc76baf436a904ac7c318ad7e67` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:51.109516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a531bc76baf436a904ac7c318ad7e67)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:51.111671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:51.146296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:51.167425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a531bc76baf436a904ac7c318ad7e67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.176259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a531bc76baf436a904ac7c318ad7e67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.177182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a531bc76baf436a904ac7c318ad7e67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.177907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a531bc76baf436a904ac7c318ad7e67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.194302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-64ce6d0c-5406-4cef-b4d4-66e9231695b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a531bc76baf436a904ac7c318ad7e67'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.209066 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4251/8448] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:51 2022] DELETE /identity/v3/users/6a531bc76baf436a904ac7c318ad7e67 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:51.580089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:51.583578 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:51.602133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ed7c0-f5b2-4541-9ee0-c46e333a77f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:51.638002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:51.693043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:51.694209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:51.694495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:51.694781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] PATH_INFO: `/v3/projects/7a51cd18ae034e979b1ec53b8182430d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:51.701601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a51cd18ae034e979b1ec53b8182430d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:51.703598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:51.786415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a51cd18ae034e979b1ec53b8182430d', 'request_id': 'req-0aee165b-a240-449f-afb9-4203069d56ab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.793680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a51cd18ae034e979b1ec53b8182430d', 'request_id': 'req-0aee165b-a240-449f-afb9-4203069d56ab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.802051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a51cd18ae034e979b1ec53b8182430d', 'request_id': 'req-0aee165b-a240-449f-afb9-4203069d56ab'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.821748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] The token cache is being invalidate because project 7a51cd18ae034e979b1ec53b8182430d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:51.822293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.823059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0aee165b-a240-449f-afb9-4203069d56ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:51.827593 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4198/8449] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:51 2022] DELETE /identity/v3/projects/7a51cd18ae034e979b1ec53b8182430d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:51.830462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:51.830965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:51.831081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:51.850680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:51.852342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:51.929687 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4252/8450] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:51.937966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:51.938239 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:51.938533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:51.964657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:51.966148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:51.976006 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4199/8451] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:51.980331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:51.994582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0286e-e843-4afb-b99d-8b698d181cbf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.000068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.000963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.001417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.002016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.003991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:52.004627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.006534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.021190 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4253/8452] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:52.025753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.042027 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b904f-4fb8-4683-ba0b-75d276b6a19e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.047417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.048403 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.048793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.049204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.050063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.052703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.116325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4200/8453] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:52 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:52.117537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.128273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64fd1-6fb9-4a96-bc42-13add13ee2ea admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.196204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.197113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.197426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.197703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.198485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.200470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.223596 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4254/8454] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:52 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:52.228528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.240442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffbfd3-44c5-4db4-b9fe-3394f10f9658 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.245549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.246226 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.246510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.246784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.247815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.249203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.260357 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4201/8455] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:52.264940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.276121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccc0e9-097b-40e0-884a-1673df1da0b9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.281942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.282635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.282918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.283197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.283962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.285664 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903ac4f-fedc-43a6-af51-59c358d600b9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.296760 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4255/8456] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:52.300944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.311051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a2e3-7bf5-42b4-bbb2-399ff3177620 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.315671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.316538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.316820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.317129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] PATH_INFO: `/v3/projects/1ff6a70ab252474eb233932690c55bb5/users/c1ace4a18dc44c0da395cf98011b82fc/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.332227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff6a70ab252474eb233932690c55bb5, user_id=c1ace4a18dc44c0da395cf98011b82fc, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.334855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.352277 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4202/8457] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:52 2022] PUT /identity/v3/projects/1ff6a70ab252474eb233932690c55bb5/users/c1ace4a18dc44c0da395cf98011b82fc/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:52.466866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.467312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.467792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.491388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:52.503903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] MFA Rules not processed for user `c1ace4a18dc44c0da395cf98011b82fc`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:52.506019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:52.607567 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4256/8458] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:52.611714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.678240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:52.688457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a7c09-12d0-46fc-bb2c-b0740a6bff38 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.695335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.696571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.697127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.697912 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.698882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.703613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.735968 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4203/8459] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:52 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:52.740254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.751590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d2e5-b846-4358-a513-b039c5af0f55 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.819081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.819721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.820004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.820281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.820985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.822955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.849514 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4257/8460] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:52 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:25:52.850715 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.868768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6ddec-7d37-4165-958f-0174aee27324 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.880915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.881634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.881916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.882194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.883079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.884762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.901903 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4204/8461] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:52.903676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.915568 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65eeee-dd80-4065-acbe-c5b40eabacca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:52.920599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:52.921622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:52.921994 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:52.922481 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] PATH_INFO: `/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195/users/3b928195cca54e3bb5644260be40d52a/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:52.943089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1bf3ba5eff47398d98bd2426c8c195, user_id=3b928195cca54e3bb5644260be40d52a, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:52.946634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:52.964837 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4258/8462] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:52 2022] PUT /identity/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195/users/3b928195cca54e3bb5644260be40d52a/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:52.975320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:52.987404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed4a31-ad89-404f-a0c8-7eaf472bed15 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.057104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.057791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.058074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.058352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.059088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.060741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc598e3-fc70-4eab-9999-332ba7f6254c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.071060 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4205/8463] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:53.075352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.087309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e7b20-aab9-47e1-a6b3-8166035fc0b1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.092537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.093602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.094022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.094439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] PATH_INFO: `/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195/users/3b928195cca54e3bb5644260be40d52a/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.096621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1bf3ba5eff47398d98bd2426c8c195, user_id=3b928195cca54e3bb5644260be40d52a, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.099586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.111415 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4259/8464] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:53 2022] PUT /identity/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195/users/3b928195cca54e3bb5644260be40d52a/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:53.122046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.122324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.122597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.153072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] MFA Rules not processed for user `3b928195cca54e3bb5644260be40d52a`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:53.154406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:53.236174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4206/8465] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:25:53.249254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.251021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:53.317279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b543-2662-473c-af8c-d2f2bca57d56 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.322393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.322646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.322930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.323206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.332554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:53.335257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.336916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.351014 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4260/8466] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:53.696191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.706490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3ee5-c796-4d34-969c-c716a26e1c19 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.711319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b928195cca54e3bb5644260be40d52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed1bf3ba5eff47398d98bd2426c8c195', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.712033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.712324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.712611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.713392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:53.713710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.715329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.729679 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4207/8467] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:53.734061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.744428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa149f5-c16e-4da1-852b-49cc13806592 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.749893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b928195cca54e3bb5644260be40d52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed1bf3ba5eff47398d98bd2426c8c195', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.750558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.750841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.751288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.752030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.754290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.784572 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4261/8468] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:53 2022] POST /identity/v3/projects => generated 354 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:53.789073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.799706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4fbfe-4fd6-4fc9-8471-24fd63c0611e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.832905 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:53.859129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b928195cca54e3bb5644260be40d52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed1bf3ba5eff47398d98bd2426c8c195', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.859896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.860179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.860512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.861344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:53.861659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.863426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.879257 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4208/8469] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:25:53.912993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:53.924130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259579f5-b93f-42c4-9b3b-5c2fad748aac tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:53.929572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b928195cca54e3bb5644260be40d52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed1bf3ba5eff47398d98bd2426c8c195', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:53.930987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:53.931342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:53.931650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] PATH_INFO: `/v3/projects/70f626aa72ab42b38e0d676370b9b36b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:53.933002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=70f626aa72ab42b38e0d676370b9b36b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:53.935200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:53.986972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f626aa72ab42b38e0d676370b9b36b', 'request_id': 'req-9d22d62d-96ce-432b-a75a-274f28cf64eb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:53.999166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f626aa72ab42b38e0d676370b9b36b', 'request_id': 'req-9d22d62d-96ce-432b-a75a-274f28cf64eb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.007653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f626aa72ab42b38e0d676370b9b36b', 'request_id': 'req-9d22d62d-96ce-432b-a75a-274f28cf64eb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.022893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] The token cache is being invalidate because project 70f626aa72ab42b38e0d676370b9b36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:54.023240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.023965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.025753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4262/8470] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:53 2022] DELETE /identity/v3/projects/70f626aa72ab42b38e0d676370b9b36b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:54.105651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:54.107501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:54.217644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45523c-e1e2-431b-b2b2-7c7e448f503e tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:54.302365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:54.302511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:54.302788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:54.303064 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:54.303948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:54.305117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:54.305639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:54.322382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:54.324025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8faca2-e9a1-4b84-ace6-f1f7302306c8 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:54.343873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4209/8471] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:54.431145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22d62d-96ce-432b-a75a-274f28cf64eb tempest-VolumeQuotaClassesTest-514542321 tempest-VolumeQuotaClassesTest-514542321-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:54.437038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:54.438010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:54.438293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:54.439675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] PATH_INFO: `/v3/users/c1ace4a18dc44c0da395cf98011b82fc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:54.440265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ace4a18dc44c0da395cf98011b82fc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:54.442790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:54.505455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ace4a18dc44c0da395cf98011b82fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.513067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ace4a18dc44c0da395cf98011b82fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.514413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ace4a18dc44c0da395cf98011b82fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.515102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ace4a18dc44c0da395cf98011b82fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.517520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:54.531390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ace4a18dc44c0da395cf98011b82fc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:54.547024 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4263/8472] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:54 2022] DELETE /identity/v3/users/c1ace4a18dc44c0da395cf98011b82fc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:54.551820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:54.552199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:54.552568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:54.576420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:54.577951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:54.632166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:54.645986 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4210/8473] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:54.656225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:54.657977 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:54.725974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac82b6e-e6c0-4bdb-bf31-7249993ecbc0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:54.730327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:54.730991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:54.731273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:54.731547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:54.742583 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:54.744078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:54.754696 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4264/8474] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:55.044481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:55.045845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:55.059337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb03d-77b3-4b71-8911-d0e265fc1a70 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:55.064213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:55.065108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:55.065543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:55.065822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] PATH_INFO: `/v3/projects/1ff6a70ab252474eb233932690c55bb5` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:55.067193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff6a70ab252474eb233932690c55bb5)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:55.069152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:55.120572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff6a70ab252474eb233932690c55bb5', 'request_id': 'req-ceb9fb55-e75a-4ee4-b9ea-788809601d27'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.126907 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff6a70ab252474eb233932690c55bb5', 'request_id': 'req-ceb9fb55-e75a-4ee4-b9ea-788809601d27'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.133232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff6a70ab252474eb233932690c55bb5', 'request_id': 'req-ceb9fb55-e75a-4ee4-b9ea-788809601d27'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.149166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] The token cache is being invalidate because project 1ff6a70ab252474eb233932690c55bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:55.149436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.150098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.151902 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4211/8475] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:55 2022] DELETE /identity/v3/projects/1ff6a70ab252474eb233932690c55bb5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:55.156085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:55.166793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0974e65-ad22-4a86-9a97-f77ba31bf16d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:55.225580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:55.226623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:55.226915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:55.227196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] PATH_INFO: `/v3/users/3b928195cca54e3bb5644260be40d52a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:55.228611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b928195cca54e3bb5644260be40d52a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:55.230563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:55.286371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b928195cca54e3bb5644260be40d52a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.296334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b928195cca54e3bb5644260be40d52a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.297104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b928195cca54e3bb5644260be40d52a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.297903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b928195cca54e3bb5644260be40d52a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.311934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8667995b-7c42-4b0c-9cea-18fb7cc99678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b928195cca54e3bb5644260be40d52a'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:55.324390 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:55.331179 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4265/8476] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:25:55 2022] DELETE /identity/v3/users/3b928195cca54e3bb5644260be40d52a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:55.966763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:55.968351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:55.988699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9fb55-e75a-4ee4-b9ea-788809601d27 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.064308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.065326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.065705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.065975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] PATH_INFO: `/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.067225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1bf3ba5eff47398d98bd2426c8c195)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.069269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.123538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1bf3ba5eff47398d98bd2426c8c195', 'request_id': 'req-ab99ed08-de4c-48cf-ae16-21b30a3ae934'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:56.130429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1bf3ba5eff47398d98bd2426c8c195', 'request_id': 'req-ab99ed08-de4c-48cf-ae16-21b30a3ae934'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:56.136279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1bf3ba5eff47398d98bd2426c8c195', 'request_id': 'req-ab99ed08-de4c-48cf-ae16-21b30a3ae934'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:56.150368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] The token cache is being invalidate because project ed1bf3ba5eff47398d98bd2426c8c195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:25:56.150651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:56.151259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ab99ed08-de4c-48cf-ae16-21b30a3ae934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:25:56.152866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4212/8477] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:25:55 2022] DELETE /identity/v3/projects/ed1bf3ba5eff47398d98bd2426c8c195 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:56.157900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.158412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.158514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.178482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:56.180133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:56.247881 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4266/8478] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:56.255987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.256383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.256733 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.271255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:56.277177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:56.278798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:56.288052 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4213/8479] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:56.292587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.303047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb20ca9-caaa-4a48-8912-a61fec388d3a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.307808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.308467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.308750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.309023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.309742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:25:56.310104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.311725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.324908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4267/8480] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:25:56.329469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.339987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612302-25da-4dc0-b55f-046a5c9b63d2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.345725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.346358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.346649 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.346987 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.347720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.349647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.385603 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4214/8481] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:56.390066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.400944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b6563-8ef5-4518-8c07-4401adc68bc4 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.475560 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.476269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.476553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.476886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.477601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.479750 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.508210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4268/8482] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:56.512415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.524249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e12781-a508-4ecb-aa8f-e48b0e763ce9 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.529061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.529938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.530227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.530531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.531272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.533073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.554710 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4215/8483] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:56.555995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.567948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebecef-0ca7-4161-afb3-597581c00d5e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.573859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.574606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.575070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.575197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.575919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.577991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a00575-addd-4cc3-a586-3fe305c487f8 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.592158 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4269/8484] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:56.596444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.608636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5721243-36c4-4485-9e9a-96ae4a44029a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.614233 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.615101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.615409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.615754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] PATH_INFO: `/v3/projects/16d905982a934fbcac1fc21043da6e08/users/506ae29c67d847b2ba60a17f4916378f/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.631375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d905982a934fbcac1fc21043da6e08, user_id=506ae29c67d847b2ba60a17f4916378f, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.633981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.648676 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4216/8485] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:56 2022] PUT /identity/v3/projects/16d905982a934fbcac1fc21043da6e08/users/506ae29c67d847b2ba60a17f4916378f/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:56.660555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.660886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.661217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.691897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] MFA Rules not processed for user `506ae29c67d847b2ba60a17f4916378f`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:56.693165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:56.758575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:56.771477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4270/8486] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:56.776268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.841926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a94a-6f1b-4a1b-99ce-503c665e431d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.848209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.848927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.849242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.849595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.850402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.852508 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:56.883826 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4217/8487] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:56.888663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:56.900397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d08634-c39e-49c1-99f6-307e2b38ac1f None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:56.976715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:56.977403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:56.977680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:56.978021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:56.978739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:56.980791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.009466 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4271/8488] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:25:56 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:25:57.010752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.028022 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952c167-c8a0-41b3-9eda-fc2e4d1ac01c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.033377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.034472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.034990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.035274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.037076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.039194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.054862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4218/8489] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:25:57.056601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.068704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d9c4-0559-4850-a759-86dd26ee5a58 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.074630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.076112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.076621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.077079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] PATH_INFO: `/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626/users/5e8935140d394a39b1aaeafc7a090562/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.101600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2c63dddcd9430cbbd8ca6e3de4f626, user_id=5e8935140d394a39b1aaeafc7a090562, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.104479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.123595 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4272/8490] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:57 2022] PUT /identity/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626/users/5e8935140d394a39b1aaeafc7a090562/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:25:57.127180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.139194 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128426-28f6-46b2-af1e-c4d616f61c9e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.215094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.215818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.216121 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.216382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.217125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.218820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9e8a7-697b-4184-9151-5a7f80bd9e97 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.229499 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4219/8491] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:25:57.234284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.246528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d784-047c-43d5-b86f-829a5ef18c77 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.251711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.252604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.252899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.253205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] PATH_INFO: `/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626/users/5e8935140d394a39b1aaeafc7a090562/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.255318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2c63dddcd9430cbbd8ca6e3de4f626, user_id=5e8935140d394a39b1aaeafc7a090562, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.258296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.272237 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4273/8492] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:25:57 2022] PUT /identity/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626/users/5e8935140d394a39b1aaeafc7a090562/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:25:57.283628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.283991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.284262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.310929 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:57.314218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] MFA Rules not processed for user `5e8935140d394a39b1aaeafc7a090562`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:25:57.316055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:57.412677 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4220/8493] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:25:57.426061 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.428122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:25:57.500175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aedeae-0478-4a5b-9a20-4bb5df43a096 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.504301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.504959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.505199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.505686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.516746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.518188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.529986 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4274/8494] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:25:57.639019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:25:57.652808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1315e-14df-427c-a986-7a048debf0d5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:25:57.657001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:25:57.657729 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:25:57.658038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:25:57.658447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:25:57.726213 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:25:57.727930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65ad58-bfaa-4625-9f60-4170641c0cc3 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:25:57.739362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4221/8495] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:00.424501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:00.485546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:00.503727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651b36-e2eb-4c2e-8d1e-3544b9320bb1 service cinder] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:00.509024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:00.509975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:00.510310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:00.510588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] PATH_INFO: `/v3/users/506ae29c67d847b2ba60a17f4916378f` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:00.512410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506ae29c67d847b2ba60a17f4916378f)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:00.514740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:00.573492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506ae29c67d847b2ba60a17f4916378f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:00.583316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506ae29c67d847b2ba60a17f4916378f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:00.584290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506ae29c67d847b2ba60a17f4916378f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:00.585121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506ae29c67d847b2ba60a17f4916378f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:00.601863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506ae29c67d847b2ba60a17f4916378f'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:00.633611 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4275/8496] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:00 2022] DELETE /identity/v3/users/506ae29c67d847b2ba60a17f4916378f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:00.639754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:00.640405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:00.640405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:00.673529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:00.675032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:00.783072 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4222/8497] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:00.792919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:00.795063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:00.889534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac8d6e-5050-4258-b51f-07b327092192 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:00.894214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:00.895108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:00.895397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:00.895693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:00.910371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:00.912020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:00.927921 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4276/8498] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:01.589417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:01.591127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.652087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:01.697728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957f46d-6217-4808-93a6-3131288d5ea9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:01.704709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:01.705835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:01.706421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:01.706968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:01.711386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.743415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:01.743415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:01.743910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:01.743910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.755570 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4223/8499] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:01.756989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:01.759080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.760516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b0a5-9fd6-488d-a526-b76ef9d320d7 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:01.766980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:01.768075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:01.768604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:01.769984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] PATH_INFO: `/v3/projects/16d905982a934fbcac1fc21043da6e08` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:01.771881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d905982a934fbcac1fc21043da6e08)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:01.774419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:01.775919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0024-19d6-4c0b-8d8f-124d0745af78 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:01.783888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:01.786041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:01.786324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:01.786600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] PATH_INFO: `/v3/users/084f5ad7fb594747bb54d90dad0c3057` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:01.788616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] RBAC: Authorizing `identity:delete_user(user_id=084f5ad7fb594747bb54d90dad0c3057)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:01.792885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:01.854219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084f5ad7fb594747bb54d90dad0c3057'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.854896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084f5ad7fb594747bb54d90dad0c3057'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.859718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d905982a934fbcac1fc21043da6e08', 'request_id': 'req-d93d2701-9f7e-4cce-a738-22a5857a5901'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.863783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084f5ad7fb594747bb54d90dad0c3057'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.864637 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084f5ad7fb594747bb54d90dad0c3057'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.867451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d905982a934fbcac1fc21043da6e08', 'request_id': 'req-d93d2701-9f7e-4cce-a738-22a5857a5901'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.873496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d905982a934fbcac1fc21043da6e08', 'request_id': 'req-d93d2701-9f7e-4cce-a738-22a5857a5901'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.876228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:01.880856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6d21802e-20c2-4598-b232-0f71db98934f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084f5ad7fb594747bb54d90dad0c3057'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.890840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] The token cache is being invalidate because project 16d905982a934fbcac1fc21043da6e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:01.891190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.892402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:01.894688 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4277/8500] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:01 2022] DELETE /identity/v3/projects/16d905982a934fbcac1fc21043da6e08 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:01.898966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:01.901385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.911067 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4224/8501] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:01 2022] DELETE /identity/v3/users/084f5ad7fb594747bb54d90dad0c3057 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:01.916012 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:01.916504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:01.916504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:01.943626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:01.946181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:01.986447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d2701-9f7e-4cce-a738-22a5857a5901 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.023786 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4225/8502] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:02.040310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.042144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.066347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.067327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.067632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.067902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] PATH_INFO: `/v3/users/5e8935140d394a39b1aaeafc7a090562` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.069175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8935140d394a39b1aaeafc7a090562)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.071152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.096244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:02.116755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa90b5-cd50-43db-a3df-82cf1f3d34c7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.120741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.121603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.122025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.122391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.129204 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8935140d394a39b1aaeafc7a090562'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.134166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.135892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.136903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8935140d394a39b1aaeafc7a090562'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.137692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8935140d394a39b1aaeafc7a090562'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.138749 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8935140d394a39b1aaeafc7a090562'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.147239 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4226/8503] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:26:02.157121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8935140d394a39b1aaeafc7a090562'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.176115 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4278/8504] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:01 2022] DELETE /identity/v3/users/5e8935140d394a39b1aaeafc7a090562 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:02.418997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.420796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.435807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab993-feae-47aa-bbe4-bc3e44583ddf service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.517629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.519444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.519772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.520136 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] PATH_INFO: `/v3/projects/93bbbe3f781e4813951d03770dea2606` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.521793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bbbe3f781e4813951d03770dea2606)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.525460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.526859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.528548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.543268 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d0fb9-ac46-4b20-9646-1b6160dfae22 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.548284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.549339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.549695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.549984 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] PATH_INFO: `/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.551302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2c63dddcd9430cbbd8ca6e3de4f626)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.553525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.573206 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:02.597764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bbbe3f781e4813951d03770dea2606', 'request_id': 'req-adf415ab-0651-4100-8a80-35d8807a0fc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.606500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bbbe3f781e4813951d03770dea2606', 'request_id': 'req-adf415ab-0651-4100-8a80-35d8807a0fc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.613452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bbbe3f781e4813951d03770dea2606', 'request_id': 'req-adf415ab-0651-4100-8a80-35d8807a0fc0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.615289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2c63dddcd9430cbbd8ca6e3de4f626', 'request_id': 'req-f6ec5d1a-15e2-4ca0-babd-340f82721810'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.622923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2c63dddcd9430cbbd8ca6e3de4f626', 'request_id': 'req-f6ec5d1a-15e2-4ca0-babd-340f82721810'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.629280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] The token cache is being invalidate because project 93bbbe3f781e4813951d03770dea2606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:02.629643 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.630292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.630435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2c63dddcd9430cbbd8ca6e3de4f626', 'request_id': 'req-f6ec5d1a-15e2-4ca0-babd-340f82721810'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.631938 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4227/8505] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:02 2022] DELETE /identity/v3/projects/93bbbe3f781e4813951d03770dea2606 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:02.636335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.637805 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.648105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] The token cache is being invalidate because project 8c2c63dddcd9430cbbd8ca6e3de4f626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:02.648397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.649024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-f6ec5d1a-15e2-4ca0-babd-340f82721810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.650842 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4279/8506] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:02 2022] DELETE /identity/v3/projects/8c2c63dddcd9430cbbd8ca6e3de4f626 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:02.655976 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589205-6c58-45b5-9ce0-612eafd58e0a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.656266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589205-6c58-45b5-9ce0-612eafd58e0a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.656546 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589205-6c58-45b5-9ce0-612eafd58e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.676424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-51589205-6c58-45b5-9ce0-612eafd58e0a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:02.678044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51589205-6c58-45b5-9ce0-612eafd58e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.710888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf415ab-0651-4100-8a80-35d8807a0fc0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.730818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:02.752213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4280/8507] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:02.755696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.756000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.756283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.775264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:02.776565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.780969 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.782001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.782295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.782576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] PATH_INFO: `/v3/users/23f9ec9dfafb4613b5bc3b222c84a9a2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.784127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f9ec9dfafb4613b5bc3b222c84a9a2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.789061 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4281/8508] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:02.789234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.790129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.799474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4d867-3e34-432b-80e1-ecd93f4735ce None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.804727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.805415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.805707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.806020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.806743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:26:02.807223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.808743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.822002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4282/8509] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:26:02.827117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.837304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f9ec9dfafb4613b5bc3b222c84a9a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.837919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e177-3d57-4480-907b-b6395846775d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:02.838086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f9ec9dfafb4613b5bc3b222c84a9a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.843195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:02.843890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:02.844176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:02.844455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:02.845203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:02.845397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f9ec9dfafb4613b5bc3b222c84a9a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.845984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f9ec9dfafb4613b5bc3b222c84a9a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.847642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:02.860248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f9ec9dfafb4613b5bc3b222c84a9a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:02.877566 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4228/8510] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:02 2022] DELETE /identity/v3/users/23f9ec9dfafb4613b5bc3b222c84a9a2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:02.878387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4283/8511] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:02 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:02.884874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:02.886368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:02.963210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c68c3-ebcc-4023-adbc-eb71ffdb6a7b admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.015422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:03.032924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.033623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.034081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.034354 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.035293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.037363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.063547 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4229/8512] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:02 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:03.066014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.078399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83060f4-05c9-4041-965e-4a355eb71f46 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.084244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.085102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.085393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.085703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.086617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.088502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.103538 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4284/8513] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:03.105914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.117556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975755a4-06e2-4d1a-9fd2-c6414390d8da admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.123346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.124148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.124569 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.124861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.125635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.127861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.139649 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4230/8514] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:03.144730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.157883 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a656176-cfc0-4eb5-b0fc-bb9e06d072af admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.163610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.164570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.164904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.165315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] PATH_INFO: `/v3/projects/1c69336ebd3943489ec2db027a05b463/users/64643e0ace0e44a883c341d905a6900a/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.184859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c69336ebd3943489ec2db027a05b463, user_id=64643e0ace0e44a883c341d905a6900a, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.188017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bcd2d-e614-4c3f-9c1d-620b879c396d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.204024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.206422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.210819 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4285/8515] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:03 2022] PUT /identity/v3/projects/1c69336ebd3943489ec2db027a05b463/users/64643e0ace0e44a883c341d905a6900a/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:03.220913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0908e-2ff4-435b-8a0f-2f4538e6ff67 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.222643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.224013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.224995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.262044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] MFA Rules not processed for user `64643e0ace0e44a883c341d905a6900a`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:03.263854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.278609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:03.293357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.294269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.294573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.294930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] PATH_INFO: `/v3/projects/8c6d3ffd29c04707bb090a8a7da06e71` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.296222 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6d3ffd29c04707bb090a8a7da06e71)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.298398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.345609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4286/8516] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:03.346835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.351722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6d3ffd29c04707bb090a8a7da06e71', 'request_id': 'req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.358982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548270cd-3451-4afa-a7d7-6d26739d77d4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.360210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6d3ffd29c04707bb090a8a7da06e71', 'request_id': 'req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.369549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6d3ffd29c04707bb090a8a7da06e71', 'request_id': 'req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.388007 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] The token cache is being invalidate because project 8c6d3ffd29c04707bb090a8a7da06e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:03.388762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.389424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.391039 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4231/8517] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:03 2022] DELETE /identity/v3/projects/8c6d3ffd29c04707bb090a8a7da06e71 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:03.395708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.397278 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.429093 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.430095 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.430329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.430765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.431605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.434388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.469270 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4287/8518] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:03 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:03.470342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:03.470859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.473098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4519fb-7883-45a5-81e4-c3c0f2f222a0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.473451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.538499 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.539482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.539803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.540031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] PATH_INFO: `/v3/users/1e9ee1c96d894a34a8c46688d56bd3d9` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.541306 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9ee1c96d894a34a8c46688d56bd3d9)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.543341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.549027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12c4bb-9e6f-4e7a-8bfa-85dd935961e0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.554333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.555020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.555391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.555840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.556536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.558545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.582698 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4288/8519] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:03 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:03.587340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.601274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9ee1c96d894a34a8c46688d56bd3d9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.602309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9ee1c96d894a34a8c46688d56bd3d9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.607085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64eba3-8918-4c93-9254-67ea8026abaa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.610890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9ee1c96d894a34a8c46688d56bd3d9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.611609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9ee1c96d894a34a8c46688d56bd3d9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.620656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.623224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.623623 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.623909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.626247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.629713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.629860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9ee1c96d894a34a8c46688d56bd3d9'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:03.648213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4289/8520] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:03.649393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.649939 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4232/8521] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:03 2022] DELETE /identity/v3/users/1e9ee1c96d894a34a8c46688d56bd3d9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:03.651116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.664940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df40bd-0b4f-4897-87ff-d3f0646cf21c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.683117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:03.735069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.738845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.739090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.739408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] PATH_INFO: `/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d/users/b923b23c2a1549468086949a9834151d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.757520 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86ecf258f7f4cd18f7f757b93a8a38d, user_id=b923b23c2a1549468086949a9834151d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.761561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.780259 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4290/8522] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:03 2022] PUT /identity/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d/users/b923b23c2a1549468086949a9834151d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:03.784775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.797322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0f55-b658-4e1d-94c9-da1f99287955 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.857417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.859823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:03.883324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.884473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.884765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.885124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.886091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.889728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.905030 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4233/8523] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:03.909618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:03.920665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d919b3-c232-44e4-bf32-54d8e7227edc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.926124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:03.927031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.927317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.927638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] PATH_INFO: `/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d/users/b923b23c2a1549468086949a9834151d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.930614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86ecf258f7f4cd18f7f757b93a8a38d, user_id=b923b23c2a1549468086949a9834151d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:03.933469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868d9a-fd80-4ca7-8d80-7e5268325d0a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:03.947010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4234/8524] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:03 2022] PUT /identity/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d/users/b923b23c2a1549468086949a9834151d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:03.951136 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147d7b-3c66-4d93-94c1-45892896ccb6 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:03.958138 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:03.958438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:03.958726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:03.966267 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:03.991118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] MFA Rules not processed for user `b923b23c2a1549468086949a9834151d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:03.992395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.023292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.025007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.025929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.026230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] PATH_INFO: `/v3/projects/baa905597ed74f47b1c4f7ad531e65cc` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.027554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa905597ed74f47b1c4f7ad531e65cc)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.029572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.073468 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4235/8525] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:04.082962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa905597ed74f47b1c4f7ad531e65cc', 'request_id': 'req-4750d5f1-daf1-45b2-a47a-ca39b724b970'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.084992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.085447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:04.086411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.090599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa905597ed74f47b1c4f7ad531e65cc', 'request_id': 'req-4750d5f1-daf1-45b2-a47a-ca39b724b970'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.099631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa905597ed74f47b1c4f7ad531e65cc', 'request_id': 'req-4750d5f1-daf1-45b2-a47a-ca39b724b970'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.115057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] The token cache is being invalidate because project baa905597ed74f47b1c4f7ad531e65cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:04.115344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.116190 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-4750d5f1-daf1-45b2-a47a-ca39b724b970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.117989 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4291/8526] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:03 2022] DELETE /identity/v3/projects/baa905597ed74f47b1c4f7ad531e65cc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:04.123173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938dc0-fa0d-4417-b699-968dfa633f6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.123485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938dc0-fa0d-4417-b699-968dfa633f6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.123817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a938dc0-fa0d-4417-b699-968dfa633f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.144170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9a938dc0-fa0d-4417-b699-968dfa633f6b None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:04.145339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9a938dc0-fa0d-4417-b699-968dfa633f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.152739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d0ff7-c2eb-4643-af90-a1d3c41971d3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.203821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.204681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.204973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.205272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.207647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.221406 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4292/8527] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:04.229892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.230310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.230548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.252304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:04.254513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.264864 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4293/8528] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:04.270078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.281159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79c76-94f1-433a-b8a8-481bc56ed389 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.282831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:04.286735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.287344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.288161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.288444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.288619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.288742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.289495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:26:04.289820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.291758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.299413 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4236/8529] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:26:04.305311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4294/8530] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:26:04.309903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.322411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873c354-9e8e-4d79-afae-e67433c31107 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.328410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.329087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.329374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.329656 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.330370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.332638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.371936 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4237/8531] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:04.378915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.391016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c89b-9831-42d9-9203-644541d47d41 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.458052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.458828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.459117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.459423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.460340 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.462458 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.486578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4295/8532] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:04.492114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.507070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3876952-1ee5-4c12-9c48-993bb8efa289 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.512764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.513949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.514241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.514511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.515437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.517197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.531150 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4238/8533] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:04.533592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.548157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5368a-6f31-4bb3-8bb0-b8980131a4a1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.553813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.554550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.554830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.555107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.555885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.557505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d278f-66a1-486f-a5be-a11d3fd0bc78 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.571579 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4296/8534] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:04.575769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.588660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fcae4-95a6-4cf9-b483-f276679323cf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.600465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.601554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.601841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.602139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] PATH_INFO: `/v3/projects/8209f333d47d4a9e8a0f5e8754927807/users/013cb638ecc6411e943c2056b813059d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.619832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8209f333d47d4a9e8a0f5e8754927807, user_id=013cb638ecc6411e943c2056b813059d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.623230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.640362 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4239/8535] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:04 2022] PUT /identity/v3/projects/8209f333d47d4a9e8a0f5e8754927807/users/013cb638ecc6411e943c2056b813059d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:04.649101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.649101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.649101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.666531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:04.667871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.703166 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:04.726009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.728109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.734725 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4297/8536] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:04.742762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a5dfd-7b29-4a0d-bd3f-8095e517b639 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.745040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.746608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.748775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.749672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.749972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.750256 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] PATH_INFO: `/v3/users/64643e0ace0e44a883c341d905a6900a` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.751564 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64643e0ace0e44a883c341d905a6900a)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.753834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.807911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64643e0ace0e44a883c341d905a6900a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.808792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64643e0ace0e44a883c341d905a6900a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.816649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec24912-478e-45c5-b604-823abc8017f2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:04.817164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64643e0ace0e44a883c341d905a6900a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.817574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64643e0ace0e44a883c341d905a6900a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.820859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:04.821547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.821834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.822121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.824152 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.832412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c1ecf856-49fe-4de8-b2d3-b395215c72c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64643e0ace0e44a883c341d905a6900a'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:04.839103 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:04.840825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:04.847586 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4240/8537] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:04 2022] DELETE /identity/v3/users/64643e0ace0e44a883c341d905a6900a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:04.852430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:04.852957 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4298/8538] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:26:04.855789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:04.856099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:04.875120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:04.876437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.947201 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4241/8539] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:04.958198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:04.960161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:04.975663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399c7c3-91b6-4216-b227-2552d7c82ba0 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:05.032364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:05.033182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:05.033474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:05.034183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:05.047063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:05.048679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:05.060082 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4299/8540] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:26:05.526008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:05.528014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:05.542266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437118a-0ae4-42dc-a937-da73cf4dfe43 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:05.548744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:05.550009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:05.550294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:05.550722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] PATH_INFO: `/v3/projects/1c69336ebd3943489ec2db027a05b463` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:05.552189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c69336ebd3943489ec2db027a05b463)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:05.554443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:05.564142 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:05.621116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c69336ebd3943489ec2db027a05b463', 'request_id': 'req-748b7adb-747f-4d5a-991f-2416badcfeda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.627781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c69336ebd3943489ec2db027a05b463', 'request_id': 'req-748b7adb-747f-4d5a-991f-2416badcfeda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.635690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c69336ebd3943489ec2db027a05b463', 'request_id': 'req-748b7adb-747f-4d5a-991f-2416badcfeda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.653393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] The token cache is being invalidate because project 1c69336ebd3943489ec2db027a05b463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:05.653806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.654584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.656672 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4242/8541] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:05 2022] DELETE /identity/v3/projects/1c69336ebd3943489ec2db027a05b463 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:05.663354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:05.671854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c93fe-95a4-404f-b092-0fd12de71109 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:05.750110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:05.755387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:05.755387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:05.755387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] PATH_INFO: `/v3/users/b923b23c2a1549468086949a9834151d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:05.757026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b923b23c2a1549468086949a9834151d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:05.760075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:05.802417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:05.825532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b923b23c2a1549468086949a9834151d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.837665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b923b23c2a1549468086949a9834151d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.838241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b923b23c2a1549468086949a9834151d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.838911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b923b23c2a1549468086949a9834151d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.855769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79f04a74-2fd1-4962-969a-0c054d38b812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b923b23c2a1549468086949a9834151d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:05.874922 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4300/8542] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:05 2022] DELETE /identity/v3/users/b923b23c2a1549468086949a9834151d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:06.203337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.204862 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:06.221938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7adb-747f-4d5a-991f-2416badcfeda admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.302769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.303845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.304203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.304595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] PATH_INFO: `/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.305866 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86ecf258f7f4cd18f7f757b93a8a38d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.308048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.381615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86ecf258f7f4cd18f7f757b93a8a38d', 'request_id': 'req-245e8036-1c79-4b92-8baa-358f767236f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:06.390382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86ecf258f7f4cd18f7f757b93a8a38d', 'request_id': 'req-245e8036-1c79-4b92-8baa-358f767236f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:06.397155 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86ecf258f7f4cd18f7f757b93a8a38d', 'request_id': 'req-245e8036-1c79-4b92-8baa-358f767236f7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:06.413262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] The token cache is being invalidate because project a86ecf258f7f4cd18f7f757b93a8a38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:06.413547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:06.414374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-245e8036-1c79-4b92-8baa-358f767236f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:06.416332 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4243/8543] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:06 2022] DELETE /identity/v3/projects/a86ecf258f7f4cd18f7f757b93a8a38d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:06.421230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.421528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.421815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.451127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:06.452434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:06.549842 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4301/8544] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:06.564974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.565466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.565648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.587316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:06.588592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:06.600865 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4244/8545] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:06.605770 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.618980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32fbc-665c-46f3-8d6b-4daea36d9cab None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.625477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.626320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.626707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.627083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.628052 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:26:06.628524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.630270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.645852 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4302/8546] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:26:06.650387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.663169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb489d-d39e-4da0-be21-fd2b51f7eaaf None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.668657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.669348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.669631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.669906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.670608 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.672583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.695352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:06.722913 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4245/8547] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:06 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:06.723138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.737354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca638e8f-0019-4fb9-ac28-c7c2b5aeb7ca admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.815731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.816574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.816934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.817283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.818350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.820557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.847139 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4303/8548] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:06 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:06.848396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.859158 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda89cb-718e-4ee7-8d88-6c95f0c1b823 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.866439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.867325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.867629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.867906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.868639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.870282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.885841 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4246/8549] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:26:06.887447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.899176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74691f60-ccf8-42df-a41c-a90f310e8df3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.905117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.905807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.906234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.906530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.907273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.909175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3172ad-f68b-4c1f-9329-39cb9e93d4f0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.921615 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4304/8550] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:26:06.925710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:06.936507 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905f017-7cdc-484a-a532-9109b50cb8f1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:06.941613 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:06.942619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.942915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.943197 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] PATH_INFO: `/v3/projects/411a1993ad0843d1becebbbe8f3bcc72/users/10c980625b724bcebaf0257c570c1d32/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:06.959712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411a1993ad0843d1becebbbe8f3bcc72, user_id=10c980625b724bcebaf0257c570c1d32, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:06.966483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:06.986536 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4247/8551] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:06 2022] PUT /identity/v3/projects/411a1993ad0843d1becebbbe8f3bcc72/users/10c980625b724bcebaf0257c570c1d32/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:06.997625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e11d-8755-4ee3-8f2d-0dd120ccd639 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:06.997905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e11d-8755-4ee3-8f2d-0dd120ccd639 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:06.998189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e11d-8755-4ee3-8f2d-0dd120ccd639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:07.019334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:07.029068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5258e11d-8755-4ee3-8f2d-0dd120ccd639 None None] MFA Rules not processed for user `10c980625b724bcebaf0257c570c1d32`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:07.031351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5258e11d-8755-4ee3-8f2d-0dd120ccd639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:07.098807 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4305/8552] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:07.115684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:07.117701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:07.186170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40035fb3-f2fe-441a-8593-bd6bdbcf4671 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:07.189924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:07.190767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:07.191249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:07.191730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:07.201153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:07.202601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:07.213406 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4248/8553] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:09.298270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.298848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.298848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.330396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] MFA Rules not processed for user `013cb638ecc6411e943c2056b813059d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:09.331723 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:09.405488 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4306/8554] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:09.410123 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.411672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:09.483982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689121-be9e-4e10-acdf-18f70a4408a8 service cinder] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.488615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.489290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.489574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.489852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.490557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.492513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.523594 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4249/8555] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:09 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:09.525923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.537874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886705-a046-469d-87e9-55222e72f4f3 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.596325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.597146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.597438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.597715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.598413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.600460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.624281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4307/8556] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:09 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:09.625714 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.636726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb6c52-ad90-412a-94d1-494650b393e4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.641748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.642424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.642716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.642993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.643804 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.645512 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.656899 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4250/8557] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:09.661241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.672578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c64a-0853-4444-8499-897eba8ba0cb admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.678416 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.679309 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.679632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.679910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] PATH_INFO: `/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b/users/f5e3bab5fd474f7299824cf24d681f9d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.697511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2ef5ca282d4fddae5309968b2b8b2b, user_id=f5e3bab5fd474f7299824cf24d681f9d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.700269 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.703537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:09.717484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4308/8558] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:09 2022] PUT /identity/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b/users/f5e3bab5fd474f7299824cf24d681f9d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:09.721696 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.733068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af06758-d2c5-41f9-8a25-58d32fbf11aa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.766769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:09.790392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.791078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.791383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.791684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.792444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.794055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4a746-ebab-439e-a0a3-835ce38d91a4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.804296 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4251/8559] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:09.809067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:09.819826 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01572-3ac4-44dc-b2dc-345704f5c082 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:09.824566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:09.825434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:09.825713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:09.825987 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] PATH_INFO: `/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b/users/f5e3bab5fd474f7299824cf24d681f9d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:09.828009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2ef5ca282d4fddae5309968b2b8b2b, user_id=f5e3bab5fd474f7299824cf24d681f9d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:09.830786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:09.840966 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4309/8560] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:09 2022] PUT /identity/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b/users/f5e3bab5fd474f7299824cf24d681f9d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:15.309873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:15.310983 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:15.311454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:15.342811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] MFA Rules not processed for user `f5e3bab5fd474f7299824cf24d681f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:15.344583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:15.428938 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4252/8561] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:15.448669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:15.450929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:15.534454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d026b19-e943-4482-9a06-316db7861cfa admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:15.540044 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:15.540712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:15.540995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:15.541272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:15.600844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:15.602378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467759b1-0a30-4942-b115-4051bbbd7f65 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:15.612532 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4310/8562] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:16.038526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:16.105750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f488fdc-f6f1-4771-8c29-94bff6ec6d24 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:16.112955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:16.113855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:16.114135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:16.114411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] PATH_INFO: `/v3/users/10c980625b724bcebaf0257c570c1d32` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:16.115685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c980625b724bcebaf0257c570c1d32)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:16.117646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:16.170745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c980625b724bcebaf0257c570c1d32'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:16.171661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c980625b724bcebaf0257c570c1d32'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:16.181727 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c980625b724bcebaf0257c570c1d32'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:16.182571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c980625b724bcebaf0257c570c1d32'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:16.187810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:16.199689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c980625b724bcebaf0257c570c1d32'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:16.217914 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4253/8563] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:16 2022] DELETE /identity/v3/users/10c980625b724bcebaf0257c570c1d32 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:16.222632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3c19a-dd98-4957-acf1-47a1abdf86e0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:16.222957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3c19a-dd98-4957-acf1-47a1abdf86e0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:16.223405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3c19a-dd98-4957-acf1-47a1abdf86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:16.246059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9fd3c19a-dd98-4957-acf1-47a1abdf86e0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:16.247341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9fd3c19a-dd98-4957-acf1-47a1abdf86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:16.327569 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4311/8564] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:16.335956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:16.337576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:16.438519 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa92f9-1f07-471b-be8e-4605cf6e2279 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:16.445316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:16.446493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:16.446997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:16.447481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:16.465388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:16.468228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:16.480996 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4254/8565] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:16.921429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3347-fab8-4420-9ec0-945068410864 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:16.922004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3347-fab8-4420-9ec0-945068410864 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:16.922091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c3347-fab8-4420-9ec0-945068410864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:16.947071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-572c3347-fab8-4420-9ec0-945068410864 None None] MFA Rules not processed for user `013cb638ecc6411e943c2056b813059d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:16.949058 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-572c3347-fab8-4420-9ec0-945068410864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:16.972096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:17.028703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.030435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:17.045974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92b7e1-5d44-41de-902c-0ee7e1e52af9 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.055000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.056128 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.056511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.056839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] PATH_INFO: `/v3/projects/411a1993ad0843d1becebbbe8f3bcc72` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.058554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=411a1993ad0843d1becebbbe8f3bcc72)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.061084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.067021 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4312/8566] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:17.138603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411a1993ad0843d1becebbbe8f3bcc72', 'request_id': 'req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:17.147806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411a1993ad0843d1becebbbe8f3bcc72', 'request_id': 'req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:17.154279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411a1993ad0843d1becebbbe8f3bcc72', 'request_id': 'req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:17.172707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] The token cache is being invalidate because project 411a1993ad0843d1becebbbe8f3bcc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:17.173183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:17.173875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-ed5b5a38-1e8c-4fe1-9ca1-9dd2603ecd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:17.176522 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4255/8567] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:17 2022] DELETE /identity/v3/projects/411a1993ad0843d1becebbbe8f3bcc72 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:26:17.182413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.182708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.183216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.210349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:17.212251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:17.285325 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4313/8568] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:17.294736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.295024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.295310 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.316203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:17.317437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:17.325987 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4256/8569] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:17.329950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.340745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6c28d-5271-4fbe-aa4a-69c0981d87e1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.346267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.348302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.348648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.348872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.349620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:26:17.351667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.353365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.389862 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4314/8570] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 21:26:17.394875 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.410154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285b6c8-c43b-4b18-9941-9ff7b59aaea2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.416344 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.417365 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.418065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.418364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.419089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.421269 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.459220 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4257/8571] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:17 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:17.464832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.476042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b302b-d4e6-4977-bed0-d8e25030b177 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.546601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.547299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.547615 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.547941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.548592 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.550917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.577628 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4315/8572] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:17 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:26:17.581878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.592890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8948d18-53ab-4c1f-b981-0c0ed38371fd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.597659 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.598428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.598807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.599171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.600031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.601725 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.612698 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4258/8573] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:26:17.617318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.629170 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05f954-4f81-459d-9e3d-f5dfb3b15877 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.634013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.634702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.635036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.635273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.636046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.637684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391d3a-5172-46ff-9465-43a5d8dbab61 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.650852 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4316/8574] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:26:17.654956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.671957 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dff86-d8d6-4b2f-ae84-f97efa65f2a3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:17.678083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:17.680600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.680793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.681075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] PATH_INFO: `/v3/projects/09267f58c3a6428f9377739c93006777/users/621162cfb6d34ecc99d38689c3690d75/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.699838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09267f58c3a6428f9377739c93006777, user_id=621162cfb6d34ecc99d38689c3690d75, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:17.702782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:17.715116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:17.721359 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4259/8575] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:17 2022] PUT /identity/v3/projects/09267f58c3a6428f9377739c93006777/users/621162cfb6d34ecc99d38689c3690d75/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:17.731397 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:17.731793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:17.732082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:17.761907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] MFA Rules not processed for user `621162cfb6d34ecc99d38689c3690d75`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:17.763999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:17.785901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:17.864922 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4317/8576] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:17.872680 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:17.874924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:18.004320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6750ae-a24f-4615-99db-1ac2862df796 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:18.013689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57831f8b23c243ff9223b08588949da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:18.014375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:18.014760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:18.015088 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:18.025813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:18.027280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905e903-143e-47c2-809c-9a1d2a9b27a3 service cinder] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:18.038184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4260/8577] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:26.195693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:26.266873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58182d-3c00-43be-93be-45bb5b79718a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:26.271459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:26.272444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:26.272724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:26.273263 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] PATH_INFO: `/v3/users/621162cfb6d34ecc99d38689c3690d75` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:26.274821 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621162cfb6d34ecc99d38689c3690d75)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:26.276822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:26.329633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621162cfb6d34ecc99d38689c3690d75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.342475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621162cfb6d34ecc99d38689c3690d75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.343212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621162cfb6d34ecc99d38689c3690d75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.343869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621162cfb6d34ecc99d38689c3690d75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.357792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621162cfb6d34ecc99d38689c3690d75'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.373287 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4318/8578] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:26:26 2022] DELETE /identity/v3/users/621162cfb6d34ecc99d38689c3690d75 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:26.377993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:26.378531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:26.378531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:26.396762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:26.397959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:26.460791 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4261/8579] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:26.471146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:26.472836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:26.520466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:26.539936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020dc18-5258-454f-aa65-ebefba9a5809 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:26.544047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:26.544721 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:26.545002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:26.545276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:26.554887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:26.556386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f130-81d1-461e-a36f-c7922b12b250 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:26.565971 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4319/8580] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:26.850636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:26.852275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:26.868289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb20d-35d6-45d2-b12f-6751fcd78034 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:26.874609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:26.875752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:26.876238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:26.876482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] PATH_INFO: `/v3/projects/09267f58c3a6428f9377739c93006777` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:26.877894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] RBAC: Authorizing `identity:delete_project(project_id=09267f58c3a6428f9377739c93006777)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:26.879918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:26.932182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09267f58c3a6428f9377739c93006777', 'request_id': 'req-e9ac3e0c-72f1-4f95-b370-544b0753ceda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.938543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09267f58c3a6428f9377739c93006777', 'request_id': 'req-e9ac3e0c-72f1-4f95-b370-544b0753ceda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.944345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09267f58c3a6428f9377739c93006777', 'request_id': 'req-e9ac3e0c-72f1-4f95-b370-544b0753ceda'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.959873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] The token cache is being invalidate because project 09267f58c3a6428f9377739c93006777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:26:26.960162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.960817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e9ac3e0c-72f1-4f95-b370-544b0753ceda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:26:26.962454 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4262/8581] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:26:26 2022] DELETE /identity/v3/projects/09267f58c3a6428f9377739c93006777 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:26.967912 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:26.968171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:26.968454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:26.987744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:26.988926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:27.051146 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4320/8582] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:27.059161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.059452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.059761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.078280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:27.079462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:27.088165 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4263/8583] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:27.092668 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.103123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4757-e2bb-4f50-a00c-581c8408c11a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.108825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.109552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.109839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.110110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.110877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:26:27.111180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.112831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.126375 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4321/8584] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:26:27.130913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.141824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78241a-a75d-4ea7-adc0-e0123784dc45 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.147072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.147765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.148049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.148326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.149021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.150955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.172748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:27.181642 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4264/8585] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:27.185134 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.195670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52f97d-8756-48aa-aec1-e51dcee28a29 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.253509 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.254221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.254466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.254742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.255465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.257479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.280669 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4322/8586] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:27.285014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.296304 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69d31-b245-4f2b-ac2b-44a5d1700a7f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.302268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.302972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.303257 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.303536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.304296 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.305909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.316976 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4265/8587] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:27.321729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.332904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf94678-32a1-47df-b34e-7fe012a6a320 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.339232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.340129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.340513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.340885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.341847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.343769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e92a-29af-42c3-a103-d804412d1074 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.355026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4323/8588] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:27.359452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.373872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505c16-49ba-43ce-9a73-57326ce5ca1c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.382933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.383927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.384212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.384586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] PATH_INFO: `/v3/projects/487d2d29adde413baa30ed91635c0591/users/e9add19ab3754964b66d1d5a7facc5e8/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.401528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487d2d29adde413baa30ed91635c0591, user_id=e9add19ab3754964b66d1d5a7facc5e8, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.404271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.420449 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4266/8589] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:27 2022] PUT /identity/v3/projects/487d2d29adde413baa30ed91635c0591/users/e9add19ab3754964b66d1d5a7facc5e8/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:27.432118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.432569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.432945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.467868 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] MFA Rules not processed for user `e9add19ab3754964b66d1d5a7facc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:27.469291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:27.522507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:27.552074 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4324/8590] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:26:27.556690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.621921 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9dc1-9129-4ba1-993d-8f38b5d22bc5 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.628869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.629591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.629908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.630221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.630988 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.633045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.664908 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4267/8591] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:27.669100 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.686774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f3d8c-3a6e-4c86-a559-d117262d739d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.746110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.747471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.747784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.748063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.748776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.750730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.773830 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4325/8592] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:26:27 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:26:27.778290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.789179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab66bb-21a8-42be-91b1-266b348c34a0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.795052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.795769 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.796049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.796413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.797054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.799083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.811443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4268/8593] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:26:27.815943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.826920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a8258-52d4-4cd0-bc5a-e6fa7143e8a1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.832573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.833477 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.833759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.834030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] PATH_INFO: `/v3/projects/629b5e4cfba945fc8761667732bd0b05/users/22b3579138134855aaa83a5c8de93c26/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.850214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b5e4cfba945fc8761667732bd0b05, user_id=22b3579138134855aaa83a5c8de93c26, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.853260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.869517 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4326/8594] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:27 2022] PUT /identity/v3/projects/629b5e4cfba945fc8761667732bd0b05/users/22b3579138134855aaa83a5c8de93c26/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:27.874050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.884203 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7465-fe23-4bec-b78f-4fecfaef096c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.944587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.945252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.945533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.945913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.946837 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.948935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9cad5-3896-490a-903d-16d1f0523ccb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:27.959239 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4269/8595] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:26:27.964179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:27.979133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4780ba-09da-4f31-8a71-0c21c6964cef admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:27.984874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:27.985772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:27.986053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:27.986330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] PATH_INFO: `/v3/projects/629b5e4cfba945fc8761667732bd0b05/users/22b3579138134855aaa83a5c8de93c26/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:27.988507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629b5e4cfba945fc8761667732bd0b05, user_id=22b3579138134855aaa83a5c8de93c26, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:27.991158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:28.004220 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4327/8596] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:26:27 2022] PUT /identity/v3/projects/629b5e4cfba945fc8761667732bd0b05/users/22b3579138134855aaa83a5c8de93c26/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:26:28.015343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:28.015673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:28.015955 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:28.046431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] MFA Rules not processed for user `22b3579138134855aaa83a5c8de93c26`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:28.047743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:28.075845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:28.129862 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4270/8597] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:28.151666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:28.153857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:28.237259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c812b85-3405-40c3-9a19-1bb9cb1e73c9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:28.244187 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:28.244845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:28.245139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:28.245465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:28.278257 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:28.310797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:28.312353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:28.321234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4328/8598] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:30.595771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:30.597369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:30.662284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6f293-b721-4a31-91f5-53486639e4d5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:30.666856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:30.667349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:30.668003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:30.668283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:30.670116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:30.738320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:30.739765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74947-f6a1-46e6-bec1-0f62056f6b5c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:30.750572 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4271/8599] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:32.407493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:26:32.409475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:32.425996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162984c-208c-4190-8eb6-a0828a4dc0cf service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:26:32.431228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:26:32.432281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:32.432714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:32.432975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:32.444870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:26:32.446368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:26:32.458530 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4329/8600] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:26:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:26:36.361179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:26:36.361740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:26:36.361740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:26:36.384328 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] MFA Rules not processed for user `e9add19ab3754964b66d1d5a7facc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:26:36.385636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:26:36.395428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4272/8601] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:26:42.452897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=21 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:46.375598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=72 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:03.516467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:03.531188 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caf856-60fc-44f7-92f4-1ca3184517e4 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:03.536060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:03.536646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:03.536934 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:03.537217 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:03.539247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:03.551948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:03.553292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:03.563715 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4330/8602] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:13.558541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:25.698828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:25.711894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b8287-e83e-4201-9a12-22f0fcf1fe71 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:25.715527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:25.716191 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:25.716471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:25.716775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:25.718526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:25.730846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:25.732307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:25.743380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4273/8603] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:27:25.775641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:25.777211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:25.866924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6a98-a3bd-418d-af18-5caabaa53f38 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:25.871164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:25.872175 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:25.872871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:25.873161 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:25.873472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:25.875259 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:25.882687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dbcb7-030b-4335-9e02-7d44a45ed529 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:25.886281 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:25.886925 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:25.887206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:25.888640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:25.890389 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:25.890905 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:25.892637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:25.906678 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4331/8604] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:25.963790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:25.965250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2fab0-d9f4-4efe-a352-28649f89f386 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:25.976989 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4274/8605] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:26.068639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:26.085394 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc6da9-ae09-4007-8879-ee1346337813 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:26.089419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:26.090070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:26.090349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:26.090657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:26.092525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:26.106252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:26.107792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211f9c6-fd7d-47ed-809a-df3f38bb9ed0 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:26.120806 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4332/8606] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:27:26.212302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbf9f-726e-45e8-9a18-f7466c3997a8 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:26.212529 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbf9f-726e-45e8-9a18-f7466c3997a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:26.212742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbf9f-726e-45e8-9a18-f7466c3997a8 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:26.214382 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4275/8607] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:27:26.219147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:26.219444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:26.219760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:26.240900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:27:26.242816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:26.255870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4333/8608] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:27:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:27:26.277991 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fbf9f-726e-45e8-9a18-f7466c3997a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:26.294726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fbf9f-726e-45e8-9a18-f7466c3997a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:26.300057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:26.300705 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:26.300985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:26.301634 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:26.311707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:26.313318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:26.323610 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4276/8609] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:26.502030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:26.515451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f559f9-b671-4de3-af46-970810e77b6b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:26.519914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:26.520571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:26.520879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:26.521139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:26.523734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:26.540950 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:26.542418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:26.557578 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4334/8610] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:32.583464 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:32.595910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf4502-0228-4d65-a42d-f17a6d25383b service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:32.600017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:32.600803 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:32.601180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:32.601523 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:32.603332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:32.634664 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:32.638612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:32.658037 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4277/8611] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:32.775931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:32.791654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a7d-f2f5-45a1-a7b5-fd7db600b92b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:32.798467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:32.799616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:32.800102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:32.800376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:32.802410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:32.818507 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:32.820405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:32.839861 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4335/8612] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:32.860145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:32.863319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:32.879181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396c40-37db-4bf1-b868-dba67fc1da35 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:32.889030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:32.890739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:32.891030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:32.891484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] PATH_INFO: `/v3/users/2356361a22724a45a9213f5b1b4b71fb` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:32.907722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2356361a22724a45a9213f5b1b4b71fb)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:32.909697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:32.956786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2356361a22724a45a9213f5b1b4b71fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:32.957452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2356361a22724a45a9213f5b1b4b71fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:32.964673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2356361a22724a45a9213f5b1b4b71fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:32.965311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2356361a22724a45a9213f5b1b4b71fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:32.976900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2356361a22724a45a9213f5b1b4b71fb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:32.991769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4278/8613] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:27:32 2022] DELETE /identity/v3/users/2356361a22724a45a9213f5b1b4b71fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:27:33.183500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:33.196334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578581a-2fec-4623-a7ea-57f7ed40b133 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:33.255913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:33.256824 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:33.257110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:33.257391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] PATH_INFO: `/v3/projects/fc6af5f33fb64a17906872b7edb1e049` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:33.268379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6af5f33fb64a17906872b7edb1e049)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:33.270316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:33.309314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:33.319013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6af5f33fb64a17906872b7edb1e049', 'request_id': 'req-8d10a5c9-96f1-49d3-b722-69b9d40782ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.325879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6af5f33fb64a17906872b7edb1e049', 'request_id': 'req-8d10a5c9-96f1-49d3-b722-69b9d40782ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.332004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6af5f33fb64a17906872b7edb1e049', 'request_id': 'req-8d10a5c9-96f1-49d3-b722-69b9d40782ed'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.346827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] The token cache is being invalidate because project fc6af5f33fb64a17906872b7edb1e049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:27:33.347113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.347792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.349364 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4336/8614] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:27:33 2022] DELETE /identity/v3/projects/fc6af5f33fb64a17906872b7edb1e049 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:27:33.354419 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:33.356211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:33.373080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548def71-dfc3-42be-9233-2bb2125b5f9e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:33.386410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:33.435935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:33.436984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:33.437272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:33.437541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] PATH_INFO: `/v3/users/d31d03063af6409a890cb9c3cf7a9a50` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:33.451820 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31d03063af6409a890cb9c3cf7a9a50)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:33.453754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:33.505661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31d03063af6409a890cb9c3cf7a9a50'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.506326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31d03063af6409a890cb9c3cf7a9a50'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.513625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31d03063af6409a890cb9c3cf7a9a50'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.514247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31d03063af6409a890cb9c3cf7a9a50'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.526790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31d03063af6409a890cb9c3cf7a9a50'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.542224 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4279/8615] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:27:33 2022] DELETE /identity/v3/users/d31d03063af6409a890cb9c3cf7a9a50 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:27:33.727971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:33.729812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:33.746153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c9-96f1-49d3-b722-69b9d40782ed admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:33.805179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:33.806072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:33.806361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:33.806639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] PATH_INFO: `/v3/projects/8915bacd5c394cca8b774743453f6585` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:33.817558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8915bacd5c394cca8b774743453f6585)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:33.819598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:33.868640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8915bacd5c394cca8b774743453f6585', 'request_id': 'req-92b45eee-1f71-4842-bba2-3db1c20b494b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.875604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8915bacd5c394cca8b774743453f6585', 'request_id': 'req-92b45eee-1f71-4842-bba2-3db1c20b494b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.881424 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8915bacd5c394cca8b774743453f6585', 'request_id': 'req-92b45eee-1f71-4842-bba2-3db1c20b494b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.898084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] The token cache is being invalidate because project 8915bacd5c394cca8b774743453f6585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:27:33.898365 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.899007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-92b45eee-1f71-4842-bba2-3db1c20b494b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:27:33.900753 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4337/8616] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:27:33 2022] DELETE /identity/v3/projects/8915bacd5c394cca8b774743453f6585 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:27:33.968711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:27:33.970570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:34.039441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a81902-374b-491b-910b-ce65a8ce2501 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:27:34.082889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:34.097952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:27:34.098623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:27:34.098902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:27:34.099172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:27:34.101152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:27:34.200416 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:27:34.201984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:27:34.218318 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4280/8617] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:27:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:27:43.894990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=66,keystone:DELETE=11,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:44.209477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=36 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:34.208548 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:28:34.209108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:28:34.209108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:28:34.227185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] MFA Rules not processed for user `e9add19ab3754964b66d1d5a7facc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:28:34.228430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:28:34.289631 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4338/8618] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:28:37.229021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:28:37.230699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:28:37.246178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4dfd3-f88d-43e6-9791-e871307d0ba1 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:28:37.250555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:28:37.251560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:28:37.252014 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:28:37.252514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:28:37.254568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:28:37.273297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:28:37.274868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26adbf-ff88-40ba-82af-f9d32dd6cfac service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:28:37.287814 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4281/8619] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:28:42.585536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:28:42.587209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:28:42.609366 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bb981-148e-406b-8664-2f7b07bb4cb9 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:28:42.614053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:28:42.614699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:28:42.614978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:28:42.615252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:28:42.617364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:28:42.629943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:28:42.631386 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349b92-8d09-461f-8af6-91442e3901d6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:28:42.642208 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4339/8620] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:28:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:28:47.282716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:52.636362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=31 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:22.269755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.270400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.270400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.271753 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4282/8621] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:29:22.276959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e93e-84e0-443b-88b9-91f7927682df None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.277415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e93e-84e0-443b-88b9-91f7927682df None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.277630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554e93e-84e0-443b-88b9-91f7927682df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.317348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-5554e93e-84e0-443b-88b9-91f7927682df None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:29:22.318574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5554e93e-84e0-443b-88b9-91f7927682df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:22.383886 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4340/8622] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:29:22.407541 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:29:22.409514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:22.430353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666c18-e6f0-4c84-8fce-d520688a45cb None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:29:22.440205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:29:22.440786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.441067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.441345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.450913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:29:22.452631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ff3c-4a36-4dc2-8acd-2bbe96521395 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:29:22.464116 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4283/8623] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:29:22.756661 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a65c-afb1-43e0-886b-72783453742a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.757181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a65c-afb1-43e0-886b-72783453742a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.757471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a65c-afb1-43e0-886b-72783453742a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.758936 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4341/8624] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:29:22.765783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d793d-8556-4056-a044-1883b29794af None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.765783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d793d-8556-4056-a044-1883b29794af None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.766230 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d793d-8556-4056-a044-1883b29794af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.789217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c36d793d-8556-4056-a044-1883b29794af None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:29:22.790484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c36d793d-8556-4056-a044-1883b29794af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:22.801809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4284/8625] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:29:22.826865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6a65c-afb1-43e0-886b-72783453742a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:29:22.844715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6a65c-afb1-43e0-886b-72783453742a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:29:22.850369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be314349-d970-4756-a30f-09ba048936eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:29:22.851016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314349-d970-4756-a30f-09ba048936eb service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:22.851304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314349-d970-4756-a30f-09ba048936eb service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:22.851624 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314349-d970-4756-a30f-09ba048936eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:22.861693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be314349-d970-4756-a30f-09ba048936eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:29:22.863301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be314349-d970-4756-a30f-09ba048936eb service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:29:22.873713 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4342/8626] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:29:32.785048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=9 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:32.869104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=41 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:42.460161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d793d-8556-4056-a044-1883b29794af None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:29:42.462384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c36d793d-8556-4056-a044-1883b29794af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:42.486814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d793d-8556-4056-a044-1883b29794af None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:29:42.492546 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:29:42.493223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:42.493513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:42.493774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:42.495590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:42.516060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:29:42.518838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53bb25-7612-4952-93ec-f23dc49b586c service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:29:42.533844 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4285/8627] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:29:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:29:48.457957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be314349-d970-4756-a30f-09ba048936eb service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:29:48.459832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be314349-d970-4756-a30f-09ba048936eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:48.479888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be314349-d970-4756-a30f-09ba048936eb service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:29:48.486434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:29:48.487228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:29:48.487433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:29:48.487674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:29:48.489626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:29:48.506260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:29:48.507917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:29:48.522645 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4343/8628] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:29:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:29:52.526173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:58.515020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:39.875008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:30:39.875626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:30:39.875626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:30:39.895870 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] MFA Rules not processed for user `e9add19ab3754964b66d1d5a7facc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:30:39.897126 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:39.905412 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4286/8629] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:30:40.612803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:30:40.628940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96487-7974-4614-a420-d9c0907b2c5b service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:30:40.634681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:30:40.635809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:30:40.636185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:30:40.636559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:30:40.638648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:40.668784 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:30:40.670581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:30:40.684231 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4344/8630] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:30:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:30:45.857420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:30:45.873435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ae68c-7cff-4d24-9e33-8a1237d67f54 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:30:45.879343 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:30:45.880045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:30:45.880330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:30:45.880626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:30:45.882693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:45.898092 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:30:45.899754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:30:45.912489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4287/8631] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:30:50.677003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:52.221039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:30:52.222645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:52.239803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560857b4-091e-41bf-8be9-2e575ed11639 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:30:52.246675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:30:52.247648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:30:52.248019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:30:52.248364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:30:52.251106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:52.267064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:30:52.269147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:30:52.282048 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4345/8632] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:30:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:30:54.757427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:30:54.774406 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837198-6072-4189-bc89-086530fd4a05 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:30:54.784312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:30:54.784989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:30:54.785279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:30:54.785561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:30:54.787470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:30:54.806275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:30:54.808127 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:30:54.827585 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4288/8633] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:30:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:02.275178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:04.816524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=15 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:12.797908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:12.810718 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfae7a-d955-4894-96b7-e7ca9bee2e97 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:12.814762 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:12.815832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:12.816301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:12.816590 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:12.818542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:12.888765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:12.890574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:12.900527 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4346/8634] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:16.159091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:16.180211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd436f-ace1-4211-8252-b0037ba70ea4 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:16.185761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:16.186759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:16.187293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:16.187676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:16.189810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:16.210494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:16.212184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:16.241112 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4289/8635] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:19.631128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:19.632820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:19.646302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2a432-9e91-44a3-b3be-00cdf4fa561e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:19.651577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:19.652525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:19.652867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:19.653203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] PATH_INFO: `/v3/users/013cb638ecc6411e943c2056b813059d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:19.654512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] RBAC: Authorizing `identity:delete_user(user_id=013cb638ecc6411e943c2056b813059d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:19.656561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:19.711015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013cb638ecc6411e943c2056b813059d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:19.718066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013cb638ecc6411e943c2056b813059d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:19.718731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013cb638ecc6411e943c2056b813059d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:19.719360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013cb638ecc6411e943c2056b813059d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:19.732952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013cb638ecc6411e943c2056b813059d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:19.748120 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4347/8636] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:31:19 2022] DELETE /identity/v3/users/013cb638ecc6411e943c2056b813059d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:31:19.954298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:19.966928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6901be-82b4-4ed8-a781-0a816e75a9aa service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:20.027965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:20.028802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:20.029082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:20.029356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] PATH_INFO: `/v3/projects/8209f333d47d4a9e8a0f5e8754927807` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:20.030611 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8209f333d47d4a9e8a0f5e8754927807)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:20.032563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:20.082699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8209f333d47d4a9e8a0f5e8754927807', 'request_id': 'req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.088812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8209f333d47d4a9e8a0f5e8754927807', 'request_id': 'req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.094781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8209f333d47d4a9e8a0f5e8754927807', 'request_id': 'req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.113551 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] The token cache is being invalidate because project 8209f333d47d4a9e8a0f5e8754927807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:31:20.113833 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.114592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.116965 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4290/8637] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:31:19 2022] DELETE /identity/v3/projects/8209f333d47d4a9e8a0f5e8754927807 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:31:20.121260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:20.122812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:20.137929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0153246-8d00-4b68-adf9-c0403fc4559b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:20.204594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:20.205510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:20.205860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:20.206069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] PATH_INFO: `/v3/users/f5e3bab5fd474f7299824cf24d681f9d` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:20.207327 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e3bab5fd474f7299824cf24d681f9d)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:20.209384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:20.215001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:20.260605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e3bab5fd474f7299824cf24d681f9d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.267931 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e3bab5fd474f7299824cf24d681f9d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.268635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e3bab5fd474f7299824cf24d681f9d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.269233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e3bab5fd474f7299824cf24d681f9d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.280915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e3bab5fd474f7299824cf24d681f9d'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.297192 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4348/8638] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:31:20 2022] DELETE /identity/v3/users/f5e3bab5fd474f7299824cf24d681f9d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:31:20.494894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:20.496423 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:20.509444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168f3d-4cd4-42c1-8021-b30e4149c5ba admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:20.567392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:20.568337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:20.568614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:20.568896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] PATH_INFO: `/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:20.570111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2ef5ca282d4fddae5309968b2b8b2b)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:20.572079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:20.592590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:20.620019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2ef5ca282d4fddae5309968b2b8b2b', 'request_id': 'req-0f9aa2b8-5225-4091-8b85-d9f7892388ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.626000 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2ef5ca282d4fddae5309968b2b8b2b', 'request_id': 'req-0f9aa2b8-5225-4091-8b85-d9f7892388ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.632391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2ef5ca282d4fddae5309968b2b8b2b', 'request_id': 'req-0f9aa2b8-5225-4091-8b85-d9f7892388ca'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.648703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] The token cache is being invalidate because project 5b2ef5ca282d4fddae5309968b2b8b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:31:20.648993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.649650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-0f9aa2b8-5225-4091-8b85-d9f7892388ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:31:20.651250 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4291/8639] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:31:20 2022] DELETE /identity/v3/projects/5b2ef5ca282d4fddae5309968b2b8b2b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:31:29.245666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:29.247094 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:29.329919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99d87-d824-4754-a16a-2d3c68d62ca0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:29.405980 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:29.406634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:29.406935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:29.407210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:29.409092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:29.429732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:29.471032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:29.472832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5af1d2-5eb1-4ebd-ac75-4160039e727d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:29.483417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4349/8640] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:30.645597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:31.437360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:31.437624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:31.437906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:31.439327 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4292/8641] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:31:31.445221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:31.445752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:31.445752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:31.465254 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:31:31.466496 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:31.540324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4350/8642] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:31:31.560852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:31.562716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:31.583614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2a945-3aed-474c-b404-a039fb468f1a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:31.589424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:31.590072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:31.590361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:31.590669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:31.599545 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:31.601133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c346e4-2971-4791-b13f-731010d1b0b7 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:31.610949 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4293/8643] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:35.478775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:31:35.480751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:35.550417 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffe3af-fedc-4143-aa18-797f38a3da87 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:31:35.554938 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:31:35.555658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:35.555937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:35.556211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:35.558331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:35.625023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:31:35.626493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:31:35.636944 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4351/8644] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:31:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:31:41.607112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:45.631837 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:57.090178 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e823af-b991-48b7-9914-ac564c71124f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:31:57.090721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e823af-b991-48b7-9914-ac564c71124f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:31:57.090721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e823af-b991-48b7-9914-ac564c71124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:31:57.111784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-90e823af-b991-48b7-9914-ac564c71124f None None] MFA Rules not processed for user `e9add19ab3754964b66d1d5a7facc5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:31:57.113210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-90e823af-b991-48b7-9914-ac564c71124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:31:57.120663 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4294/8645] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:32:07.106033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:38.091895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:32:38.093558 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:32:38.201450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424a7c-ffc5-49a4-9381-f30455c612aa service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:32:38.205805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:32:38.207138 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:32:38.207465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:32:38.207692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:32:38.209672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:32:38.251823 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:32:38.253428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:32:38.267958 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4352/8646] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:32:38.495312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e823af-b991-48b7-9914-ac564c71124f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:32:38.496897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-90e823af-b991-48b7-9914-ac564c71124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:32:38.533841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e823af-b991-48b7-9914-ac564c71124f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:32:38.538143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:32:38.538720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:32:38.539059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:32:38.539332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:32:38.541470 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:32:38.558580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:32:38.560072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4789c8-545a-42ea-aa1b-e4d2657b9b4f service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:32:38.573704 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4295/8647] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:32:48.259862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=53 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:48.566414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=12 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:30.597132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:30.599341 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:30.703617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736c1d-78fd-4030-b0b8-f8e234e796ae service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:30.708621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:30.709572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:30.709887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:30.710160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] PATH_INFO: `/v3/users/e9add19ab3754964b66d1d5a7facc5e8` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:30.711455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9add19ab3754964b66d1d5a7facc5e8)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:30.713453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:30.765191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9add19ab3754964b66d1d5a7facc5e8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:30.772663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9add19ab3754964b66d1d5a7facc5e8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:30.773381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9add19ab3754964b66d1d5a7facc5e8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:30.774017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9add19ab3754964b66d1d5a7facc5e8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:30.787088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9add19ab3754964b66d1d5a7facc5e8'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:30.802400 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4353/8648] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:33:30 2022] DELETE /identity/v3/users/e9add19ab3754964b66d1d5a7facc5e8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:30.807254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:30.807847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:30.807961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:30.839124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:30.840387 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:30.922700 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4296/8649] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:33:30.932662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:30.934216 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:31.005949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:31.013476 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414b2d-aecb-4108-8dd7-20206bcc5dc7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:31.018343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:31.019003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:31.019425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:31.019939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:31.029075 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:31.030528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:31.040892 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4354/8650] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:33:31.237188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:31.239165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:31.253431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aed7-81fc-4e41-8807-9c383a757d4f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:31.258448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:31.259398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:31.259801 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:31.260169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] PATH_INFO: `/v3/projects/487d2d29adde413baa30ed91635c0591` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:31.261439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=487d2d29adde413baa30ed91635c0591)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:31.263593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:31.313187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487d2d29adde413baa30ed91635c0591', 'request_id': 'req-5dc148bb-c0ef-47a2-94d7-3a69631efedb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.319821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487d2d29adde413baa30ed91635c0591', 'request_id': 'req-5dc148bb-c0ef-47a2-94d7-3a69631efedb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.325285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487d2d29adde413baa30ed91635c0591', 'request_id': 'req-5dc148bb-c0ef-47a2-94d7-3a69631efedb'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.339763 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] The token cache is being invalidate because project 487d2d29adde413baa30ed91635c0591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:33:31.340051 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.340675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.342745 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4297/8651] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:33:31 2022] DELETE /identity/v3/projects/487d2d29adde413baa30ed91635c0591 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:31.347674 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:31.357694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed93be-a1a0-42e3-a67b-5765443fb41d service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:31.419973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:31.420748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:31.421033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:31.421311 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] PATH_INFO: `/v3/users/22b3579138134855aaa83a5c8de93c26` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:31.422521 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b3579138134855aaa83a5c8de93c26)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:31.424597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:31.476923 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b3579138134855aaa83a5c8de93c26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.484197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b3579138134855aaa83a5c8de93c26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.485182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b3579138134855aaa83a5c8de93c26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.486432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b3579138134855aaa83a5c8de93c26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.498267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-89af75ba-9af1-4847-8a48-0ad5a19ef60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b3579138134855aaa83a5c8de93c26'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.512812 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4355/8652] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:33:31 2022] DELETE /identity/v3/users/22b3579138134855aaa83a5c8de93c26 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:31.715248 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:31.716742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:31.733434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc148bb-c0ef-47a2-94d7-3a69631efedb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:31.793778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:31.794651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:31.794924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:31.795218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] PATH_INFO: `/v3/projects/629b5e4cfba945fc8761667732bd0b05` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:31.796544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=629b5e4cfba945fc8761667732bd0b05)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:31.799067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:31.821675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:31.851652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629b5e4cfba945fc8761667732bd0b05', 'request_id': 'req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.857930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629b5e4cfba945fc8761667732bd0b05', 'request_id': 'req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.863799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629b5e4cfba945fc8761667732bd0b05', 'request_id': 'req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.878325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] The token cache is being invalidate because project 629b5e4cfba945fc8761667732bd0b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:33:31.878726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.879599 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-b3d985b5-aa69-42cc-b3cb-0bbad97b8dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:33:31.881730 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4298/8653] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:33:31 2022] DELETE /identity/v3/projects/629b5e4cfba945fc8761667732bd0b05 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:31.889355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:31.889893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:31.890001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:31.943376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:31.944616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:31.987145 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:32.008511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4356/8654] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:33:32.018026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.018312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.018623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.038356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:32.039614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:32.049137 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4299/8655] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:33:32.053551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.064258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3e93-3368-400c-ad0c-40d5fe550721 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.070037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.070704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.070990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.071270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.072036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:33:32.072349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.073973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.086733 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4357/8656] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:33:32.091424 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.102098 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602aa7dc-176c-46c3-8b46-df72e9f9ff50 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.108065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.108781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.109068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.109348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.110063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.112084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.156174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4300/8657] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:33:32.160785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.171697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed58343-8a45-4d92-b1e9-b433643a8c63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.232879 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.233565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.233852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.234133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.234832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.236820 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.258756 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4358/8658] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:33:32.262933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.274109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afaf7c-85ed-45ac-877a-a808609a58f7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.279314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.280009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.280289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.280560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.281284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.283311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.293937 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4301/8659] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:33:32.297988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.309025 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843979f-6d2b-4ed7-ba18-6252a168e631 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.315601 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.316632 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.316982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.317349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.318415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.320922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ae3c3-85f2-40f0-b24e-ed69ee1c9d4a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.332583 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4359/8660] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:33:32.338619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.351752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1285e-9693-48cb-abd4-1a2a784aef12 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.357986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.358914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.359193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.359471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] PATH_INFO: `/v3/projects/35e9e2025977459bafb89c97180bc199/users/efa3530b7b2b4dcfac5a43d1d1750067/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.375312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e9e2025977459bafb89c97180bc199, user_id=efa3530b7b2b4dcfac5a43d1d1750067, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.378293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.393980 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4302/8661] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:33:32 2022] PUT /identity/v3/projects/35e9e2025977459bafb89c97180bc199/users/efa3530b7b2b4dcfac5a43d1d1750067/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:32.404858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.405156 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.405436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.434533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] MFA Rules not processed for user `efa3530b7b2b4dcfac5a43d1d1750067`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:32.435780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:32.513989 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4360/8662] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:33:32.519398 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.582944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1411c7-10ca-4a70-9a5e-47013ad762fe admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.587867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.588558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.588844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.589124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.589815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.591750 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.619256 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4303/8663] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:33:32.623529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.634618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff03f3-48ab-4535-80eb-b187543c4cc4 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.677021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:32.700098 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.701400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.701827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.702273 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.703400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.705908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.728521 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4361/8664] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:33:32.732841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.744758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d43099-8c64-4580-9667-7b2cd4070b1c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.750408 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.751111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.751838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.752111 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.752829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.754442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.765785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4304/8665] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:33:32.770657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.782090 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021fe2-7f8d-464e-ba7e-281db7576412 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.787433 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.788408 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.788676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.788954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] PATH_INFO: `/v3/projects/050f45bd29de475abad1adbff5eb9752/users/5634b55f1029495880a14b27549b042d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.805621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050f45bd29de475abad1adbff5eb9752, user_id=5634b55f1029495880a14b27549b042d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.808370 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.824510 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4362/8666] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:33:32 2022] PUT /identity/v3/projects/050f45bd29de475abad1adbff5eb9752/users/5634b55f1029495880a14b27549b042d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:32.828950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.840275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3e779-c0de-4c93-9a3e-3f8fe268376f admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.845865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:32.901094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.901766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.902063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.902320 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.903050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.904697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d390aa-3da9-452b-8bcf-4aafc38d664a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.914898 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4305/8667] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:33:32.919235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:32.930264 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b155-4358-4748-bca7-7576232e0207 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:32.936234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:32.937213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.937499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.937781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] PATH_INFO: `/v3/projects/050f45bd29de475abad1adbff5eb9752/users/5634b55f1029495880a14b27549b042d/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.940675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=050f45bd29de475abad1adbff5eb9752, user_id=5634b55f1029495880a14b27549b042d, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:32.943491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:32.955178 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4363/8668] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:33:32 2022] PUT /identity/v3/projects/050f45bd29de475abad1adbff5eb9752/users/5634b55f1029495880a14b27549b042d/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:33:32.966642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:32.966937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:32.967219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:32.996242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] MFA Rules not processed for user `5634b55f1029495880a14b27549b042d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:32.997468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:33.071242 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4306/8669] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:33:33.083658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:33.085711 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:33.148367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee44a8c-e03e-45c7-9dad-40740e86f67b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:33.152561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:33.153186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:33.153495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:33.153779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:33.215000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:33.216529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47960579-2290-46fc-8873-74b37fb46d4f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:33.226154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4364/8670] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:33:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:33:35.327273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:35.340346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19570da5-7fbd-458c-aa1f-b54657e9616e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:35.343915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:35.344566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:35.344878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:35.345277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:35.354585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:35.356109 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:35.366592 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4307/8671] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:33:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:33:39.943663 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:39.944159 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:39.944265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:39.969730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] MFA Rules not processed for user `efa3530b7b2b4dcfac5a43d1d1750067`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:33:39.971229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:39.978872 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4365/8672] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:33:40.316373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:40.328518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2bfe-baa2-4c06-92d2-ecf4c9ada40c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:40.332772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:40.333506 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:40.333791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:40.334095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:40.336376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:40.349962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:40.351445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b841b-c73a-43c4-bc96-98627d90844c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:40.362875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4308/8673] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:33:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:33:42.495736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:33:42.497220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:42.514562 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b566-455d-4cd5-a1b3-022a1d2b52a0 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:33:42.518759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:33:42.519405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:33:42.519727 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:33:42.520010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:33:42.521833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:33:42.536742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:33:42.538276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:33:42.550442 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4366/8674] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:33:50.356217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=71 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:52.543610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:28.345722 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:34:28.346265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:34:28.346265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:34:28.366556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] MFA Rules not processed for user `efa3530b7b2b4dcfac5a43d1d1750067`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:34:28.367829 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:34:28.376487 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4309/8675] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:34:31.020475 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:34:31.045024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8244-b8f9-4772-9118-797a605e23dd service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:34:31.049682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:34:31.049825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:34:31.050096 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:34:31.050412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:34:31.053207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:34:31.067898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:34:31.069781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314a29-db2c-46d8-8648-72dc49651c40 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:34:31.082577 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4367/8676] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:34:38.363307 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:41.077774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:13.998217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:35:14.001485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:14.149723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e31c7e-d392-4a17-9b61-1203d92da535 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:35:14.156531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:35:14.157236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:14.157516 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:14.157790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:14.160420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:14.180240 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:35:14.181999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:35:14.199068 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4310/8677] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:35:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:35:24.191609 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=46 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:26.231739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:26.232222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:26.232333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:26.257460 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] MFA Rules not processed for user `efa3530b7b2b4dcfac5a43d1d1750067`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:35:26.258993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:26.267492 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4368/8678] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:35:26.651209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:35:26.667005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99da9aa-5d67-48d8-b37d-d75c826a971d service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:35:26.670819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:35:26.671620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:26.671867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:26.672204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:26.674630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:26.688867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:35:26.690300 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:35:26.702664 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4311/8679] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:35:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:35:33.884374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:35:33.886500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:33.906312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c376b2-54be-428d-b1ef-a132576735d5 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:35:33.912783 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:35:33.913448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:33.913732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:33.914008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:33.916047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:33.931731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:35:33.933347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:35:33.947660 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4369/8680] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:35:36.695774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:43.939952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:50.868140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:35:50.869719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:50.976017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d34d86-16e6-4a00-861b-4ea12d0d0609 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:35:50.981855 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:35:50.982510 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:50.982792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:50.983172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:50.985188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:51.000054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:35:51.001630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:35:51.014294 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4312/8681] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:35:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:35:57.106334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:35:57.108055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:57.126071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e328a-a0c2-441c-bebc-6e98088f7f9b service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:35:57.132685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:35:57.133333 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:35:57.133611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:35:57.133888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:35:57.136008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:35:57.150704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:35:57.152342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:35:57.165213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4370/8682] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:35:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:01.007461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=41 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:07.158563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:13.133430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:13.151853 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4e777-95c3-4650-8cbb-3eeac26dac6f service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:13.159340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:13.160048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:13.160319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:13.160595 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:13.162480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:13.178285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:13.179917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:13.194534 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4313/8683] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:36:17.187755 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:17.201550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45482a42-4cff-4945-9886-f3c2786a5561 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:17.207631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:17.208274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:17.208545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:17.208828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:17.210670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:17.225911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:17.227608 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fa650-0912-48ef-a8a8-70559194c8dd service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:17.243592 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4371/8684] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:17.252823 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:17.331129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0ded-f1f0-4484-9329-dcee813e3edc service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:17.336235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:17.337132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:17.337477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:17.337756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] PATH_INFO: `/v3/users/efa3530b7b2b4dcfac5a43d1d1750067` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:17.338950 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa3530b7b2b4dcfac5a43d1d1750067)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:17.340963 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:17.406273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa3530b7b2b4dcfac5a43d1d1750067'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.407030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa3530b7b2b4dcfac5a43d1d1750067'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.425584 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa3530b7b2b4dcfac5a43d1d1750067'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.426517 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa3530b7b2b4dcfac5a43d1d1750067'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.439807 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa3530b7b2b4dcfac5a43d1d1750067'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.456604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4314/8685] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:36:17 2022] DELETE /identity/v3/users/efa3530b7b2b4dcfac5a43d1d1750067 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:17.461791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:17.461981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:17.462346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:17.480335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:17.481543 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:17.544773 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4372/8686] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:17.557514 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:17.559132 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:17.626119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370614-c684-4a16-a636-628cc6cd8d7a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:17.630383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:17.631038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:17.631327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:17.631647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:17.641528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:17.642891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:17.648338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:17.654996 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4315/8687] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:17.841909 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:17.843355 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:17.856088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a965-bea6-4150-a43b-df08a17d84b1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:17.861897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:17.862805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:17.863057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:17.863328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] PATH_INFO: `/v3/projects/35e9e2025977459bafb89c97180bc199` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:17.864650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e9e2025977459bafb89c97180bc199)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:17.866710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:17.922589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e9e2025977459bafb89c97180bc199', 'request_id': 'req-cb7f3059-eb1e-4dd6-941d-bacad60d909b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.929729 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e9e2025977459bafb89c97180bc199', 'request_id': 'req-cb7f3059-eb1e-4dd6-941d-bacad60d909b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.936299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e9e2025977459bafb89c97180bc199', 'request_id': 'req-cb7f3059-eb1e-4dd6-941d-bacad60d909b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.953515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] The token cache is being invalidate because project 35e9e2025977459bafb89c97180bc199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:36:17.953817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.955301 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:17.957024 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4373/8688] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:36:17 2022] DELETE /identity/v3/projects/35e9e2025977459bafb89c97180bc199 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:17.961258 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:17.972044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a1f5-762c-4f4f-b537-fc819cca93dc service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:18.038259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:18.039339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:18.039663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:18.039959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] PATH_INFO: `/v3/users/5634b55f1029495880a14b27549b042d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:18.041181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5634b55f1029495880a14b27549b042d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:18.043110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:18.093671 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5634b55f1029495880a14b27549b042d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.094325 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5634b55f1029495880a14b27549b042d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.101503 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5634b55f1029495880a14b27549b042d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.102129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5634b55f1029495880a14b27549b042d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.113728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-7b1984f5-483c-4138-9698-ca41481aca8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5634b55f1029495880a14b27549b042d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.129919 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4316/8689] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:36:17 2022] DELETE /identity/v3/users/5634b55f1029495880a14b27549b042d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:18.415765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:18.417331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:18.430426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f3059-eb1e-4dd6-941d-bacad60d909b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:18.487825 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:18.488738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:18.489023 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:18.489302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] PATH_INFO: `/v3/projects/050f45bd29de475abad1adbff5eb9752` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:18.490515 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050f45bd29de475abad1adbff5eb9752)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:18.492504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:18.504186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:18.541644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050f45bd29de475abad1adbff5eb9752', 'request_id': 'req-d603291b-af33-4c2c-9a70-37a5e494cbd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.547645 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050f45bd29de475abad1adbff5eb9752', 'request_id': 'req-d603291b-af33-4c2c-9a70-37a5e494cbd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.553553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050f45bd29de475abad1adbff5eb9752', 'request_id': 'req-d603291b-af33-4c2c-9a70-37a5e494cbd2'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.567947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] The token cache is being invalidate because project 050f45bd29de475abad1adbff5eb9752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:36:18.568251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.568864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-d603291b-af33-4c2c-9a70-37a5e494cbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:18.570477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4374/8690] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:36:18 2022] DELETE /identity/v3/projects/050f45bd29de475abad1adbff5eb9752 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:28.126035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:28.564796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:29.200939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.201573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.201573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.221029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:29.222813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:29.290490 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4317/8691] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:29.300348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.301183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.301473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.320914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:29.322116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:29.330598 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4375/8692] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:29.335447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.345249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed32f3e-862b-4248-ade9-a9e8e27c16c8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.351337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.352038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.352324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.352603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.353340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:36:29.353654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.355268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.368638 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4318/8693] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:36:29.377835 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.387882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063ec5-d29c-4979-86e2-28a46227c8cb None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.393110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.393774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.394662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.394997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.395773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.397698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.428291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4376/8694] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:29.436457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.448009 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871ed8-327d-43fe-895f-32fddc8559bd admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.516567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.517192 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.517475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.517753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.518446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.520898 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.542775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4319/8695] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:29.546997 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.561226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924c219-0c6c-476d-b6b1-027349c233a2 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.569074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.569736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.570022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.570346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.571338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.573531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.587460 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4377/8696] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:29.591717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.602483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4ad5-dcbd-45e8-8d54-23f62013d8b1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.608293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.608985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.609264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.609515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.610245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.611900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c76ab-54dd-46fe-9209-9343eb80b261 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.622455 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4320/8697] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:29.626843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.637317 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27cca6-3cb4-430c-9366-3b97cb70340c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.642440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.643329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.643656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.644380 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] PATH_INFO: `/v3/projects/0e6b163300524060964aa4a02f874d3b/users/1dd3f612bd90491183b03cf3e19c4607/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.660842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6b163300524060964aa4a02f874d3b, user_id=1dd3f612bd90491183b03cf3e19c4607, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.663545 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.679477 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4378/8698] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:36:29 2022] PUT /identity/v3/projects/0e6b163300524060964aa4a02f874d3b/users/1dd3f612bd90491183b03cf3e19c4607/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:29.693094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.693346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.693650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.721618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] MFA Rules not processed for user `1dd3f612bd90491183b03cf3e19c4607`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:29.723107 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:29.780741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:29.791491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4321/8699] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:29.796556 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.871798 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528fab-5a48-4497-b4a5-70c418db1bfc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.877235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.877927 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.878214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.878958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.880027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.882033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:29.912097 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4379/8700] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:29.916488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:29.928220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6161-fa0b-461b-a565-93d14f819779 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:29.986114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:29.986795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:29.987069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:29.987351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:29.988254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:29.990353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.011777 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4322/8701] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:36:29 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:30.015985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:30.027088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84eb223-944c-40df-9215-77dfc6d603a9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:30.032810 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:30.033420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.033728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.034012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.034822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:30.036602 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.048015 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4380/8702] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:30.053187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:30.068371 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229b6e-96ff-4507-aa62-04422f8875ab admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:30.074573 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:30.075468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.075783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.076054 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] PATH_INFO: `/v3/projects/97e8a75585fc432a9fb7ae1a035923ac/users/47f426d736504f198aedc66a514d24a2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.091384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e8a75585fc432a9fb7ae1a035923ac, user_id=47f426d736504f198aedc66a514d24a2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:30.094043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.108962 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4323/8703] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:36:30 2022] PUT /identity/v3/projects/97e8a75585fc432a9fb7ae1a035923ac/users/47f426d736504f198aedc66a514d24a2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:30.113256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:30.124322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bacd5-cfb5-4530-861e-bc77a9609645 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:30.187110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:30.187817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.188114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.188389 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.189117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:30.191033 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95726d03-a825-4520-9eba-05f8a883f1cb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.207346 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4381/8704] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:30.213612 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:30.226438 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2aa9fc-09a6-4de8-a9cf-b900b0217aa1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:30.232762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:30.233654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.233915 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.234215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] PATH_INFO: `/v3/projects/97e8a75585fc432a9fb7ae1a035923ac/users/47f426d736504f198aedc66a514d24a2/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.236602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e8a75585fc432a9fb7ae1a035923ac, user_id=47f426d736504f198aedc66a514d24a2, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:30.240065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f30a42-7467-41e4-bfe6-5607340574ad admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.252428 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4324/8705] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:36:30 2022] PUT /identity/v3/projects/97e8a75585fc432a9fb7ae1a035923ac/users/47f426d736504f198aedc66a514d24a2/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:36:30.263554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.263839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.264128 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.278567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:30.294447 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] MFA Rules not processed for user `47f426d736504f198aedc66a514d24a2`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:30.295642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:30.373931 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4382/8706] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:30.386346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.386610 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.386914 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.406600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] MFA Rules not processed for user `1dd3f612bd90491183b03cf3e19c4607`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:30.407848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:30.475805 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4325/8707] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:30.489911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:30.491612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:30.572192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91961e85-b0f5-45ac-9756-65a081b18433 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:30.578547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:30.579191 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:30.579470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:30.579779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:30.588930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:30.590555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:30.599982 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4383/8708] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:31.124090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:31.126026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:31.184822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:31.205785 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6a4ec-ef86-4a34-b247-73bc22796765 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:31.210997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:31.211684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:31.212002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:31.212282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:31.214252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:31.230079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:31.231707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458de2d-c429-4528-a4bf-f5a5221617df service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:31.246050 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4326/8709] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:40.572533 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:40.586725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c94b-93cc-4a65-a944-759153396715 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:40.592946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:40.593591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:40.593901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:40.594181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:40.604297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:40.605917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:40.616311 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4384/8710] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:40.630618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09203-edd3-40dc-9a18-0296621364e2 None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:40.631072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09203-edd3-40dc-9a18-0296621364e2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:40.631209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09203-edd3-40dc-9a18-0296621364e2 None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:40.632861 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4327/8711] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:36:40.637367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:36:40.653304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:40.662109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab08278-3633-4ded-a9b0-6f61d24b4457 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:40.668740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f426d736504f198aedc66a514d24a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e8a75585fc432a9fb7ae1a035923ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:40.669606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:40.669891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:40.670172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] PATH_INFO: `/v3/projects/97e8a75585fc432a9fb7ae1a035923ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:40.671604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: Authorizing `identity:get_project(project_id=97e8a75585fc432a9fb7ae1a035923ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:40.673374 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:40.675175 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4385/8712] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:36:40 2022] GET /identity/v3/projects/97e8a75585fc432a9fb7ae1a035923ac => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:36:40.989561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54016-f5bf-4dd5-8779-2acbd1584bab None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:40.989841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54016-f5bf-4dd5-8779-2acbd1584bab None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:40.990112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54016-f5bf-4dd5-8779-2acbd1584bab None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:40.991658 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4328/8713] 10.222.0.18 () {54 vars in 912 bytes} [Sat Jun 4 21:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:36:40.996859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Authenticating service token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 04 21:36:40.999057 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:41.019707 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:41.028920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa2f6a-ada2-4b42-88ff-6ee77f0ce090 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:41.034531 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f426d736504f198aedc66a514d24a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e8a75585fc432a9fb7ae1a035923ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:41.035402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:41.035722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:41.035999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] PATH_INFO: `/v3/projects/97e8a75585fc432a9fb7ae1a035923ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:41.037342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: Authorizing `identity:get_project(project_id=97e8a75585fc432a9fb7ae1a035923ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:41.039462 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2bff-e70a-47f6-b45f-9e79f44fdb53 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:41.041234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4386/8714] 10.222.0.18 () {58 vars in 1443 bytes} [Sat Jun 4 21:36:40 2022] GET /identity/v3/projects/97e8a75585fc432a9fb7ae1a035923ac => generated 393 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:36:41.237484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=8 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:43.888101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54016-f5bf-4dd5-8779-2acbd1584bab None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:43.955163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54016-f5bf-4dd5-8779-2acbd1584bab None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:43.960621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:43.961531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:43.961813 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:43.962208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] PATH_INFO: `/v3/users/1dd3f612bd90491183b03cf3e19c4607` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:43.963596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd3f612bd90491183b03cf3e19c4607)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:43.965555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:44.018374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd3f612bd90491183b03cf3e19c4607'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.019055 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd3f612bd90491183b03cf3e19c4607'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.027020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd3f612bd90491183b03cf3e19c4607'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.027721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd3f612bd90491183b03cf3e19c4607'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.040494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd3f612bd90491183b03cf3e19c4607'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.060062 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4329/8715] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:36:43 2022] DELETE /identity/v3/users/1dd3f612bd90491183b03cf3e19c4607 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:44.066210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:44.066713 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:44.066830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:44.086189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:44.087594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:44.130958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=100 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:44.151414 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4387/8716] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:44.161619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:44.163081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:44.224149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668142a6-acbe-4af5-a2aa-4d903d294b53 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:44.228099 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:44.228745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:44.229026 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:44.229324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:44.238868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:44.240334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:44.249741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4330/8717] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:44.434952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:44.436470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:44.448925 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e960c2-f96f-416d-8b37-1326288e4808 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:44.454158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:44.455117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:44.455401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:44.455712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] PATH_INFO: `/v3/projects/0e6b163300524060964aa4a02f874d3b` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:44.456914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6b163300524060964aa4a02f874d3b)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:44.458806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:44.512315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6b163300524060964aa4a02f874d3b', 'request_id': 'req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.518444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6b163300524060964aa4a02f874d3b', 'request_id': 'req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.524612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6b163300524060964aa4a02f874d3b', 'request_id': 'req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.538347 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] The token cache is being invalidate because project 0e6b163300524060964aa4a02f874d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:36:44.538636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.539918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.541587 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4388/8718] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:36:44 2022] DELETE /identity/v3/projects/0e6b163300524060964aa4a02f874d3b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:44.545792 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:44.556067 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb5ff0-f600-463d-a1bd-52065c706e6b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:44.574442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:44.615495 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:44.616435 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:44.616720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:44.616997 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] PATH_INFO: `/v3/users/47f426d736504f198aedc66a514d24a2` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:44.618247 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f426d736504f198aedc66a514d24a2)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:44.620254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:44.673309 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f426d736504f198aedc66a514d24a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.673964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f426d736504f198aedc66a514d24a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.681327 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f426d736504f198aedc66a514d24a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.682047 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f426d736504f198aedc66a514d24a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.694231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-085afb81-f3c8-4223-993f-39fc609fb6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f426d736504f198aedc66a514d24a2'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:44.709578 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4331/8719] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:36:44 2022] DELETE /identity/v3/users/47f426d736504f198aedc66a514d24a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:44.994606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:44.996497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:45.010849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0ebce-47cd-4ae2-9a6b-f54e91d7270c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.080402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.081302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.081588 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.081843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] PATH_INFO: `/v3/projects/97e8a75585fc432a9fb7ae1a035923ac` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.083144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e8a75585fc432a9fb7ae1a035923ac)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.085147 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.140054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e8a75585fc432a9fb7ae1a035923ac', 'request_id': 'req-733ad4d1-2ffb-4343-998d-87cc95aeada5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:45.146989 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e8a75585fc432a9fb7ae1a035923ac', 'request_id': 'req-733ad4d1-2ffb-4343-998d-87cc95aeada5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:45.153346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e8a75585fc432a9fb7ae1a035923ac', 'request_id': 'req-733ad4d1-2ffb-4343-998d-87cc95aeada5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:45.164744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:45.170769 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] The token cache is being invalidate because project 97e8a75585fc432a9fb7ae1a035923ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:36:45.171056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:45.172139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-733ad4d1-2ffb-4343-998d-87cc95aeada5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:36:45.174766 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4389/8720] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:36:44 2022] DELETE /identity/v3/projects/97e8a75585fc432a9fb7ae1a035923ac => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:45.180999 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.181635 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.182169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.201211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:45.202426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:45.264159 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4332/8721] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:45.273180 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.273468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.273740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.294226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:45.295418 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:45.303813 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4390/8722] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:36:45.308231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.317936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34613e4-e616-4c30-83a7-f1515c6524a0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.323013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.323706 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.323986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.324259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.324977 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:36:45.325282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.327082 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.339174 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4333/8723] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:36:45.343607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.353607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89cc0f-0303-4a22-b022-d37ce52388df None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.359319 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.360018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.360304 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.360585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.361274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.363214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.391274 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4391/8724] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:36:45 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:45.395928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.406359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec4f2d-0781-421e-bec4-1cb7c1ffe6e3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.432557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:45.466084 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.466752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.467035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.467308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.468072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.470016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.494734 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4334/8725] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:36:45 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:36:45.495926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.506796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec0df-8ed6-4145-b21d-d48d24fff281 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.512005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.512693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.512982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.513258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.514032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.515695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.527447 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4392/8726] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:45.531647 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.542322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2384fb-8d4f-4336-80df-057c59eb14c3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.548274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.548966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.549261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.549533 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.550244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.551902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0eef3-98bc-4116-af0b-f9d4c31a0010 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.562501 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4335/8727] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:36:45.566941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.577344 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c501a1-d4a7-4f16-a6ec-87460d1e5553 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.582260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.583154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.583436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.583748 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] PATH_INFO: `/v3/projects/0c9da76d6d254fe0995e9642e330bad7/users/ca6ec0768b414f93861ebb3da7615753/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.598346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9da76d6d254fe0995e9642e330bad7, user_id=ca6ec0768b414f93861ebb3da7615753, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.601118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.622923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4393/8728] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:36:45 2022] PUT /identity/v3/projects/0c9da76d6d254fe0995e9642e330bad7/users/ca6ec0768b414f93861ebb3da7615753/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:36:45.629262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e69e36-5071-4337-a4cb-8b76f94e5aa9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.629751 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e69e36-5071-4337-a4cb-8b76f94e5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.630227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e69e36-5071-4337-a4cb-8b76f94e5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.651811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-84e69e36-5071-4337-a4cb-8b76f94e5aa9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:45.653110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-84e69e36-5071-4337-a4cb-8b76f94e5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:45.717476 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4336/8729] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:36:45.727586 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:45.729708 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:45.794358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2051-85f2-48d1-bbee-eca4c3ad6641 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:45.798517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:45.799171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:45.799454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:45.799764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:45.810971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:45.812919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d13cc-b7e0-46e9-81c1-afbfdb81bdf6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:45.827899 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4394/8730] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:36:46.806802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:46.807364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:46.807364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:46.836008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] MFA Rules not processed for user `ca6ec0768b414f93861ebb3da7615753`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:46.837689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:46.909045 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4337/8731] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:46.922834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:46.923372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:46.924360 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:46.941705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] MFA Rules not processed for user `ca6ec0768b414f93861ebb3da7615753`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:46.942991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:46.950002 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4395/8732] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:46.961845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:46.963701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:47.008678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:47.045303 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d8553-80e1-4ca8-a86c-81e035018a0c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:47.055433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:47.056501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:47.056975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:47.056975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:47.070630 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:47.072926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335409d-acf0-43d6-ae23-499a0dafb017 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:47.082051 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4338/8733] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:56.074791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:56.076295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:56.091876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107806c-22b3-4e4e-8462-93a5078c0850 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:56.096009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:56.096662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:56.096949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:56.097230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:56.099230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:56.112830 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:56.114329 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736b95-2220-4ba4-975a-7b4254066fdd service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:56.125657 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4396/8734] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:56.206368 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:56.206913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:56.206913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:56.208330 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4339/8735] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:36:56.213466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:56.213834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:56.214186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:56.242486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:36:56.243660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:56.321622 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4397/8736] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:36:56.342588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:56.344483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:56.365726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3529e-f46b-4170-b60f-39c6fa6e298a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:56.371995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:56.372658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:56.372944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:56.373221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:56.382908 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:56.384555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:56.395180 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4340/8737] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:36:56.578851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:36:56.592245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2711d-1a67-4645-bf95-42bc398acb13 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:36:56.596842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:36:56.597491 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:36:56.597777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:36:56.598043 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:36:56.600002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:36:56.610952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:56.618676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:36:56.620773 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:36:56.634804 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4398/8738] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:06.390672 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=23 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:06.627744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:33.885711 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:33.897199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d4011-68f1-47b1-b373-b1fe449f6dcb service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:33.902319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:33.903202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:33.903485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:33.903799 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] PATH_INFO: `/v3/users/ca6ec0768b414f93861ebb3da7615753` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:33.905053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6ec0768b414f93861ebb3da7615753)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:33.906982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:33.957031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6ec0768b414f93861ebb3da7615753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:33.958443 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6ec0768b414f93861ebb3da7615753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:33.965846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6ec0768b414f93861ebb3da7615753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:33.966527 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6ec0768b414f93861ebb3da7615753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:33.978317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-acf05045-cb14-40dc-a5e5-d1999e1027e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6ec0768b414f93861ebb3da7615753'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:33.993045 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4341/8739] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:37:33 2022] DELETE /identity/v3/users/ca6ec0768b414f93861ebb3da7615753 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:37:34.184780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.196322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85345e2-1bd8-484c-aefc-d1e5dcf09356 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.255088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.256053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.256337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.256616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] PATH_INFO: `/v3/projects/0c9da76d6d254fe0995e9642e330bad7` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.257922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9da76d6d254fe0995e9642e330bad7)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.259917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.312215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9da76d6d254fe0995e9642e330bad7', 'request_id': 'req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:34.319085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9da76d6d254fe0995e9642e330bad7', 'request_id': 'req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:34.324644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9da76d6d254fe0995e9642e330bad7', 'request_id': 'req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:34.338945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] The token cache is being invalidate because project 0c9da76d6d254fe0995e9642e330bad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:37:34.339231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:34.339873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-96fdde8f-205c-4d0f-bc7d-c34b96c41afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:37:34.341725 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4399/8740] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:37:34 2022] DELETE /identity/v3/projects/0c9da76d6d254fe0995e9642e330bad7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:37:34.346890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.347188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.347471 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.367708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:34.368848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:34.434386 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4342/8741] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:37:34.442817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.443107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.443388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.462406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:34.463985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:34.473679 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4400/8742] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:37:34.478339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.488973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838544e-fdb3-49f4-8629-208016bdb2bc None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.494334 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.495008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.495318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.495695 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.496431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:37:34.496742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.498362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.512568 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4343/8743] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:37:34.518619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.529678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c91790-89f3-46d0-9554-0d23701dc239 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.535343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.536148 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.536429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.536698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.537497 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.539409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.569581 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4401/8744] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:37:34 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:37:34.575904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.590576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbfac5-740f-4edb-ac5e-4644b4c244ca admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.659861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.660450 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.660791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.661124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.661822 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.663766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.670549 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:34.690809 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4344/8745] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:37:34 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:37:34.692173 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.707144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cd560-4b61-4edd-8839-2f91aad694d3 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.712585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.713267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.713550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.713829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.714572 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.716235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.727675 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4402/8746] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:37:34.731968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.742498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0822c-21fe-44a0-a0dd-ac5b5cacdecc admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.747544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.748211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.748498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.748779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.749540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.751184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d48d2-0bd6-4c4e-912e-3bba28299d28 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.762912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4345/8747] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:37:34.767603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.778970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a1433-a973-47e1-92aa-b8ee27b51380 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.784478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.785369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.785651 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.785948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] PATH_INFO: `/v3/projects/6ed5588bf9fd4a94b2cfa302d7cdd02a/users/3a55fa711a6146b5a30c456c33f2c01c/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.800763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed5588bf9fd4a94b2cfa302d7cdd02a, user_id=3a55fa711a6146b5a30c456c33f2c01c, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:34.803587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:34.820744 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4403/8748] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:37:34 2022] PUT /identity/v3/projects/6ed5588bf9fd4a94b2cfa302d7cdd02a/users/3a55fa711a6146b5a30c456c33f2c01c/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:37:34.826049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4a16-4618-4718-bbd4-20428d8c7f57 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.826340 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4a16-4618-4718-bbd4-20428d8c7f57 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.826673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a4a16-4618-4718-bbd4-20428d8c7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:34.845355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ee3a4a16-4618-4718-bbd4-20428d8c7f57 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:34.846552 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ee3a4a16-4618-4718-bbd4-20428d8c7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:34.910812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4346/8749] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:37:34.921657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:34.923631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:34.956701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:34.992379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115d167-e02c-4a58-8e38-e238e8b3b059 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:34.997060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:34.997060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:34.997265 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:34.997464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:35.010626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:35.012157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0d0d3-75bb-465e-b7ae-e6762a6f29e9 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:35.023490 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4404/8750] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:35.692432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:35.692790 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:35.693083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:35.722324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] MFA Rules not processed for user `3a55fa711a6146b5a30c456c33f2c01c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:35.723966 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:35.790645 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4347/8751] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:37:35.802367 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:35.802965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:35.802965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:35.820604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] MFA Rules not processed for user `3a55fa711a6146b5a30c456c33f2c01c`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:35.821793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:35.829131 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4405/8752] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:37:35.842497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:35.844025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:35.921556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e2e4-5573-40b5-8abd-f9954e3528e2 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:35.927500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:35.928179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:35.928462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:35.928762 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:35.933644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:35.937582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:35.939886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:35.950015 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4348/8753] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:37.623007 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:37.625027 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:37.640042 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df1e3a-d4d3-464c-96e2-bdbddf50cea8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:37.643795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:37.644445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:37.645384 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:37.645671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:37.647653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:37.666014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:37.667474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a152ac-7e05-43f4-8043-4f22ef9a27c1 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:37.682779 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4406/8754] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:37:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:38.792631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:38.805478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a802fd-10e9-470d-836c-bf8de6d5dc54 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:38.809245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:38.809932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:38.810211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:38.810484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:38.812235 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:38.829393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:38.830888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec79f2d-b8bd-443e-80c9-30a0ee17f0ea service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:38.846194 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4349/8755] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:46.961164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:46.961776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:46.961903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:46.963430 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4407/8756] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:37:46.968777 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca338-bb9a-4528-8993-56614d102354 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:46.969217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca338-bb9a-4528-8993-56614d102354 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:46.969342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ca338-bb9a-4528-8993-56614d102354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:46.989165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2c7ca338-bb9a-4528-8993-56614d102354 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:37:46.990428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2c7ca338-bb9a-4528-8993-56614d102354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:47.054047 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4350/8757] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:37:47.074184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:37:47.076135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:37:47.097432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa805d3-51c2-4d89-86cb-fe190293c856 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:37:47.103272 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:37:47.104036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:37:47.104325 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:37:47.104667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:37:47.113463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:37:47.115315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff07779-8c1e-42c0-a785-4e1098aed90b service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:37:47.125165 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4408/8758] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:37:57.045229 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=38 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:57.121071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=29 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:25.094436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf48-e360-4cf6-9906-fa2dbdde96d9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:38:25.095074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf48-e360-4cf6-9906-fa2dbdde96d9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:38:25.095074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf48-e360-4cf6-9906-fa2dbdde96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:38:25.114989 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-45b8bf48-e360-4cf6-9906-fa2dbdde96d9 None None] MFA Rules not processed for user `3a55fa711a6146b5a30c456c33f2c01c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:38:25.116282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-45b8bf48-e360-4cf6-9906-fa2dbdde96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:38:25.123359 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4351/8759] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:38:34.753474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:38:34.754121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:38:34.754121 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:38:34.755575 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4409/8760] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:38:34.760641 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:38:34.761120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:38:34.761266 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:38:34.780010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:38:34.781242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:38:34.790705 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4352/8761] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:38:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:38:34.811973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:38:34.813796 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:38:34.834456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d3a4-92fe-43c0-9eb7-f5976d4ad08e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:38:34.840281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:38:34.840932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:38:34.841221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:38:34.841502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:38:34.851071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:38:34.853667 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:38:34.869928 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4410/8762] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:38:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:38:44.774662 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:44.863292 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:54.187619 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:38:54.201086 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd81b4-2d2e-40cf-ad89-d21462eb5cf0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:38:54.205538 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:38:54.206205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:38:54.206484 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:38:54.206756 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:38:54.208745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:38:54.221530 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:38:54.222932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:38:54.233741 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4353/8763] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:38:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:39:04.227513 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:12.759195 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:12.773896 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfe805-eb85-4bd7-81bd-2640c57e1df4 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:12.780700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6779-9628-4708-8219-9ed176346717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:12.782089 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6779-9628-4708-8219-9ed176346717 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:12.782377 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6779-9628-4708-8219-9ed176346717 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:12.782653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a6779-9628-4708-8219-9ed176346717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:12.784765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-392a6779-9628-4708-8219-9ed176346717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:12.801840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a6779-9628-4708-8219-9ed176346717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:12.803614 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a6779-9628-4708-8219-9ed176346717 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:12.812048 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:12.818399 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4411/8764] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:39:12.824255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727b8dc-cfe1-4689-9b11-594f03a5eb55 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:12.831209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:12.832209 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:12.832493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:12.832772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] PATH_INFO: `/v3/users/3a55fa711a6146b5a30c456c33f2c01c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:12.833975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a55fa711a6146b5a30c456c33f2c01c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:12.836030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:12.885049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a55fa711a6146b5a30c456c33f2c01c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:12.885701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a55fa711a6146b5a30c456c33f2c01c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:12.892959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a55fa711a6146b5a30c456c33f2c01c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:12.893603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a55fa711a6146b5a30c456c33f2c01c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:12.905845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-1a595675-6cb3-42ec-9f1f-08a91ab86f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a55fa711a6146b5a30c456c33f2c01c'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:12.923691 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4354/8765] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:39:12 2022] DELETE /identity/v3/users/3a55fa711a6146b5a30c456c33f2c01c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:39:13.113570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6779-9628-4708-8219-9ed176346717 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.124827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a6779-9628-4708-8219-9ed176346717 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.189981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.190916 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.191198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.191467 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] PATH_INFO: `/v3/projects/6ed5588bf9fd4a94b2cfa302d7cdd02a` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.192890 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed5588bf9fd4a94b2cfa302d7cdd02a)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.194962 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.247054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'request_id': 'req-e12e132e-dea8-4440-a97d-b5014cd4edb6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:13.253274 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'request_id': 'req-e12e132e-dea8-4440-a97d-b5014cd4edb6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:13.259455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'request_id': 'req-e12e132e-dea8-4440-a97d-b5014cd4edb6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:13.275859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] The token cache is being invalidate because project 6ed5588bf9fd4a94b2cfa302d7cdd02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:39:13.276150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:13.276813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-e12e132e-dea8-4440-a97d-b5014cd4edb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:39:13.278417 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4412/8766] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:39:13 2022] DELETE /identity/v3/projects/6ed5588bf9fd4a94b2cfa302d7cdd02a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:39:13.284430 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.284780 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.285042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.307224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:13.308479 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:13.369636 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4355/8767] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:39:13.378302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.378733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.379117 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.400240 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:13.401468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:13.410691 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4413/8768] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:39:13.423188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.433575 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18086bd-1f21-4ba8-a800-fa99c4cc71a7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.439166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.439962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.440241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.440515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.442358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:39:13.443360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.446418 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.462381 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4356/8769] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:39:13.469135 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.483882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03408e-2a33-4fee-bfdf-bd38437da685 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.490349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.491012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.491299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.491631 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.492321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.494234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.524750 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4414/8770] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:39:13 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:39:13.529148 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.540726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118092d-f7dc-451e-980a-b96746513ffb admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.601602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.602681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.603076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.603366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.604412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.607401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.615049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:13.630875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4357/8771] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:39:13 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:39:13.635321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.646726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930df5c-6318-4ba4-91af-da02d636f2df admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.652035 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.652709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.652993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.653275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.654018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.655678 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.667117 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4415/8772] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:39:13.673857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.688809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef85739-cefe-4832-a4dd-2946454f3070 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.694052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.694710 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.694993 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.695271 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.696038 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.697670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8c1-a902-43b5-83b2-d6d6eb6ae8b2 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.708120 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4358/8773] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:39:13.712498 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.722996 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535aa4-cfd5-4f38-8b70-70221496fa5a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.728547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.729439 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.729724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.730001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] PATH_INFO: `/v3/projects/4089cd0379c94abe9a77baa27012aa7c/users/ce8a9c03cdf04d72bbecb875aa275693/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.744891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4089cd0379c94abe9a77baa27012aa7c, user_id=ce8a9c03cdf04d72bbecb875aa275693, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.748036 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.763142 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4416/8774] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:39:13 2022] PUT /identity/v3/projects/4089cd0379c94abe9a77baa27012aa7c/users/ce8a9c03cdf04d72bbecb875aa275693/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:39:13.768928 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127da34-bd96-46eb-b563-0947aab1e934 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.769223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127da34-bd96-46eb-b563-0947aab1e934 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.769511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127da34-bd96-46eb-b563-0947aab1e934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.788782 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9127da34-bd96-46eb-b563-0947aab1e934 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:13.789975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9127da34-bd96-46eb-b563-0947aab1e934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:13.853364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4359/8775] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:39:13.864683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:13.866680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:13.881634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:13.930807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd53c01-ab78-436b-aaa4-d14b8e8fe0fd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:13.934834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:13.935479 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:13.935805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:13.936083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:13.945888 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:13.947372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:13.957200 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4417/8776] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:39:18.203412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597bcb4-9136-4f3e-80d4-a84c661a901b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:18.203412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597bcb4-9136-4f3e-80d4-a84c661a901b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:18.203412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597bcb4-9136-4f3e-80d4-a84c661a901b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:18.232380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2597bcb4-9136-4f3e-80d4-a84c661a901b None None] MFA Rules not processed for user `ce8a9c03cdf04d72bbecb875aa275693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:18.233524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2597bcb4-9136-4f3e-80d4-a84c661a901b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:18.311218 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4360/8777] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:39:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:39:18.325143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:18.326666 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:18.419874 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d08a78-0f03-4ca5-b41c-f44adb4889e4 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:18.427037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:18.427736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:18.428021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:18.428299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:18.436363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:18.438046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:18.447374 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4418/8778] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:39:19.803315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:19.803909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:19.803909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:19.822841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] MFA Rules not processed for user `ce8a9c03cdf04d72bbecb875aa275693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:19.824199 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:19.832254 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4361/8779] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:39:20.146731 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:20.148238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:20.164223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fc2e4-c1a2-4fb1-b592-0af76ad248f7 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:20.167833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:20.168487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:20.168808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:20.169054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:20.170786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:20.183419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:20.184922 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da43c-5bca-4ea7-9d8e-604a71c57343 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:20.196247 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4419/8780] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:39:29.817378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:30.189870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=60 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:32.784283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:32.799359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f32e75-29d3-403c-b0da-1a5de39d0608 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:32.804250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:32.805049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:32.805394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:32.805712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:32.807738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:32.822220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:32.823717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac767b8-41dc-4f39-8ccc-15c9a2dd3ee6 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:32.837346 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4362/8781] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:39:34.696179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:34.696786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:34.696786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:34.698213 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4420/8782] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:39:34.704169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095d8e-8c1b-47e2-823c-4700b776aa71 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:34.704675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095d8e-8c1b-47e2-823c-4700b776aa71 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:34.704768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095d8e-8c1b-47e2-823c-4700b776aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:34.756090 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ea095d8e-8c1b-47e2-823c-4700b776aa71 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:39:34.757400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ea095d8e-8c1b-47e2-823c-4700b776aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:34.819905 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4363/8783] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:39:34.843006 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:39:34.845013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:39:34.866768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4adac3-c65f-4f25-aecb-22a22651afa6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:39:34.873202 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:39:34.873831 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:39:34.874114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:39:34.874396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:39:34.883714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:39:34.885305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:39:34.895681 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4421/8784] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:39:44.810621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=41 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:44.891248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:02.903262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:40:02.903818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:40:02.903946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:40:02.923112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] MFA Rules not processed for user `ce8a9c03cdf04d72bbecb875aa275693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:40:02.924383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:40:02.931209 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4364/8785] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:40:12.917666 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:52.811928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:40:52.826413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c61a-38eb-4754-97b0-c0642f707359 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:40:52.835402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:40:52.836441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:40:52.836779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:40:52.837205 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:40:52.840534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:40:52.861612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:40:52.863220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688aa6d-33d7-439c-ae2e-ba0ce4291ff8 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:40:52.877745 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4422/8786] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:40:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:02.869700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:03.098948 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:03.100704 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:03.121356 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e74e38-8fdb-45eb-928c-402f08435b7e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:03.127896 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:03.128560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:03.128830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:03.129105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:03.131286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:03.147645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:03.149262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2df2-bc93-4404-9417-0bb22cff733b service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:03.162368 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4365/8787] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:06.082338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f555a-0e3f-4a29-a1f2-d4ad44f892cf None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:06.082958 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f555a-0e3f-4a29-a1f2-d4ad44f892cf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:06.083085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f555a-0e3f-4a29-a1f2-d4ad44f892cf None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:06.084440 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4423/8788] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:41:06.089625 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad269-abc0-44b0-96fb-edbb9c0b8a59 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:06.090114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad269-abc0-44b0-96fb-edbb9c0b8a59 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:06.090350 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad269-abc0-44b0-96fb-edbb9c0b8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:06.110071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3c4ad269-abc0-44b0-96fb-edbb9c0b8a59 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:41:06.111863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3c4ad269-abc0-44b0-96fb-edbb9c0b8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:06.120875 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4366/8789] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:41:06.141258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f555a-0e3f-4a29-a1f2-d4ad44f892cf None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:06.160078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f555a-0e3f-4a29-a1f2-d4ad44f892cf None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:06.165642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:06.166288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:06.166570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:06.166845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:06.176013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:06.177585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:06.187606 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4424/8790] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:06.415920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:06.416250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:06.416570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:06.442460 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:41:06.443700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:06.452866 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4367/8791] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:41:06.464699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:06.478313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6cb65-ca62-4ffa-b1da-05e6e33cc754 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:06.484710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:06.485393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:06.485675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:06.485951 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:06.495141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:06.496782 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:06.506784 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4425/8792] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:12.982583 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:12.984359 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:13.005588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad0e5e-f783-472d-bfa5-e965ed8a020a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:13.012282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:13.012968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:13.013249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:13.013522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:13.015640 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:13.035444 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:13.037539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858d31e-c2d8-401f-9c17-dbcfdbf8082c service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:13.052450 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4368/8793] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:15.599941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:15.618069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6725-20c1-4a04-b5ca-8a6d2c8d03c3 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:15.623616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:15.624348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:15.624697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:15.625068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:15.627222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:15.644930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:15.647342 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6d3c-4504-4749-a99d-62b4feebce2b service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:15.663253 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4426/8794] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:21.352207 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:21.352732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:21.352852 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:21.375237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] MFA Rules not processed for user `ce8a9c03cdf04d72bbecb875aa275693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:41:21.376779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:21.384601 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4369/8795] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:41:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:41:22.339291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:22.339785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:22.340085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:22.360434 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:41:22.361949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:22.373154 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4427/8796] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:41:22.385973 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:22.401754 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b6b49-767a-444d-83bd-6b9ca086722f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:22.406819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:22.407473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:22.407789 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:22.408070 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:22.417170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:22.418757 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f5b8-2211-494f-927f-20dc53b9a4d4 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:22.428925 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4370/8797] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:32.355480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=21 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:32.424589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=27 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:33.017550 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:41:33.033468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff0793-6ef7-4428-b473-f7fb256942de None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:41:33.040079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:41:33.040720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:41:33.041230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:41:33.041512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:41:33.043789 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:41:33.059887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:41:33.061495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:41:33.075648 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4428/8798] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:41:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:41:43.068038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:06.146869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d834e-f883-4db1-b010-e2fc1b74b996 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.147567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d834e-f883-4db1-b010-e2fc1b74b996 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.147567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d834e-f883-4db1-b010-e2fc1b74b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.186669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b34d834e-f883-4db1-b010-e2fc1b74b996 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:42:06.187911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b34d834e-f883-4db1-b010-e2fc1b74b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:06.194708 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4371/8799] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jun 4 21:42:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:42:06.201239 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:42:06.210968 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeaee0-2ddf-4f99-9502-4799e3caa6c5 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:42:06.214807 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:42:06.215621 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.215914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.216258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.218060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:06.232031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:42:06.233493 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114b36a-e6b3-4413-a5f8-501cefe33937 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:42:06.245242 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4429/8800] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:42:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:42:06.656053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1abd-98f4-4e07-b191-323aeb2f9c3f None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.656332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1abd-98f4-4e07-b191-323aeb2f9c3f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.656652 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a1abd-98f4-4e07-b191-323aeb2f9c3f None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.658709 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4372/8801] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:42:06.664580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.664924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.665283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.686132 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:42:06.687350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:06.697195 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4430/8802] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:42:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:42:06.719002 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a1abd-98f4-4e07-b191-323aeb2f9c3f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:42:06.739796 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a1abd-98f4-4e07-b191-323aeb2f9c3f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:42:06.745101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:42:06.745766 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.746049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.746326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.754784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:42:06.756447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cfa96-ba27-4743-a35f-c2a5b257de15 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:42:06.766761 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4373/8803] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:42:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:42:06.946253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:42:06.956574 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5307-d4c4-4fe0-9074-00018bbc75aa None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:42:06.961185 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:42:06.961838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:06.962123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:06.962387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:06.964486 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:06.982085 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:42:06.983534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:42:06.998280 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4431/8804] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:42:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:42:16.762436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=15 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:16.990127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=15 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:39.266228 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70c1b-1ea3-4cd6-99a1-229d80eb6ad5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:39.266819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70c1b-1ea3-4cd6-99a1-229d80eb6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:39.266819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70c1b-1ea3-4cd6-99a1-229d80eb6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:39.296953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-abf70c1b-1ea3-4cd6-99a1-229d80eb6ad5 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:42:39.298187 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-abf70c1b-1ea3-4cd6-99a1-229d80eb6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:39.326429 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4374/8805] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Jun 4 21:42:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:42:39.332468 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:42:39.353986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afe603-5a47-49ef-a121-59a3b3923911 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:42:39.362963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:42:39.363683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:39.363965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:39.364966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:39.366178 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:39.405081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:42:39.406594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217eff-c09b-46b3-ab45-ef34d14caeef service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:42:39.422003 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4432/8806] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:42:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:42:41.782940 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:41.783482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:41.783482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:41.801374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] MFA Rules not processed for user `ce8a9c03cdf04d72bbecb875aa275693`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:42:41.802576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:41.810032 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4375/8807] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:42:41.845566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e440a-70fa-4053-89ac-0ef20cf392bf None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:41.846078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e440a-70fa-4053-89ac-0ef20cf392bf None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:41.846078 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e440a-70fa-4053-89ac-0ef20cf392bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:41.896970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-443e440a-70fa-4053-89ac-0ef20cf392bf None None] MFA Rules not processed for user `828a7d4e334d459cb88fc2ba20894623`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:42:41.898232 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-443e440a-70fa-4053-89ac-0ef20cf392bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:41.963046 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4433/8808] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jun 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:42:41.969366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:42:41.979691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fee2dc-5356-4011-afc9-d39a6a6c0241 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:42:41.983703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:42:41.984434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:42:41.984693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:42:41.984971 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:42:41.986873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:42:42.003376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:42:42.004851 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30449fb7-b8c6-4c4c-8c3d-7154d5b3ea5e service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:42:42.018830 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4376/8809] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:42:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:42:51.959555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=58 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:52.012268 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=25 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:34.275768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415256-2f81-48cb-ba56-a56ac171ec0a None None] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:43:34.277381 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415256-2f81-48cb-ba56-a56ac171ec0a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:43:34.277662 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415256-2f81-48cb-ba56-a56ac171ec0a None None] PATH_INFO: `/` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:43:34.279550 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4434/8810] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:43:34.287480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:43:34.288018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:43:34.288249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:43:34.317165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:43:34.318372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:43:34.326916 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4377/8811] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:43:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:43:34.349795 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415256-2f81-48cb-ba56-a56ac171ec0a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:43:34.368812 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415256-2f81-48cb-ba56-a56ac171ec0a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:43:34.375211 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:43:34.376049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:43:34.376334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:43:34.376656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:43:34.390449 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:43:34.393181 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:43:34.409289 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4435/8812] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:43:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:43:44.312673 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=7 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:44.402829 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:00.687031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:00.697015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37057b54-232a-4b3e-bfed-5be8954dd268 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:00.700645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:00.701302 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:00.701588 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:00.701873 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:00.704294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:00.730742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:00.732305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:00.743880 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4378/8813] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:10.737211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=11 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:15.711285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:15.721862 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fcdf-6083-45fc-b217-8911e0ee6786 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:15.726900 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:15.727717 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:15.728063 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:15.728589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:15.740650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:15.742210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:15.761493 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4436/8814] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:17.287838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:17.305657 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1577-efa0-475d-8cf0-1ac5d0a2027c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:17.311057 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:17.311821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:17.312318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:17.312646 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:17.314536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:17.330679 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:17.332339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:17.348787 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4379/8815] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:17.359252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:17.374153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52156579-d53c-4d8e-9868-ddb167f6ce56 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:17.382759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:17.383387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:17.383893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:17.383893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] PATH_INFO: `/v3/users/ce8a9c03cdf04d72bbecb875aa275693` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:17.385091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8a9c03cdf04d72bbecb875aa275693)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:17.387040 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:17.443401 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8a9c03cdf04d72bbecb875aa275693'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.450540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8a9c03cdf04d72bbecb875aa275693'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.451275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8a9c03cdf04d72bbecb875aa275693'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.451910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8a9c03cdf04d72bbecb875aa275693'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.463861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1e3c0b21-53a2-4e61-b334-679f63dd5188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8a9c03cdf04d72bbecb875aa275693'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.477877 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4437/8816] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:44:17 2022] DELETE /identity/v3/users/ce8a9c03cdf04d72bbecb875aa275693 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:17.666034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:17.677779 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd0fef-fb42-4586-9df2-e3282aca30df service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:17.746439 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:17.747692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:17.747978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:17.748259 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] PATH_INFO: `/v3/projects/4089cd0379c94abe9a77baa27012aa7c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:17.749463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4089cd0379c94abe9a77baa27012aa7c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:17.751431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:17.806150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4089cd0379c94abe9a77baa27012aa7c', 'request_id': 'req-96d9c5eb-8a21-4f10-9d90-84f1b580c817'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.814426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4089cd0379c94abe9a77baa27012aa7c', 'request_id': 'req-96d9c5eb-8a21-4f10-9d90-84f1b580c817'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.820440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4089cd0379c94abe9a77baa27012aa7c', 'request_id': 'req-96d9c5eb-8a21-4f10-9d90-84f1b580c817'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.846161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] The token cache is being invalidate because project 4089cd0379c94abe9a77baa27012aa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:44:17.846449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.847117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-96d9c5eb-8a21-4f10-9d90-84f1b580c817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:17.848739 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4380/8817] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:44:17 2022] DELETE /identity/v3/projects/4089cd0379c94abe9a77baa27012aa7c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:17.853885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:17.854177 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:17.854455 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:17.901241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:17.902452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:17.968291 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4438/8818] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:17.976282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:17.976582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:17.976867 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:17.996380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:17.997623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:18.010189 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4381/8819] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:18.014398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.024988 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0727e4-bbea-4578-a2f6-88288816d184 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.030364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.031084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.031828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.031993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.032709 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:44:18.032983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.034705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.047306 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4439/8820] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:44:18.051967 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.061362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068fca-ecb9-42d0-bd2a-5e747e75b466 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.066854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.067540 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.067821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.068100 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.068781 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.070703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.109184 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4382/8821] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:44:18 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:44:18.113692 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.124406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90eb04-a87a-4149-8769-3fc03c7c221e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.150375 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:18.190332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.191005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.191285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.191554 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.192235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.194154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.216590 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4440/8822] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:44:18 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:44:18.221316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.232234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8911-4ddb-4fba-a36f-033e1b94e880 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.238165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.238839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.239125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.239404 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.240177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.241815 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.252680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4383/8823] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:44:18.256800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.267294 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f27786-42b5-4779-9387-a82abd7d672b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.272857 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.273518 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.273794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.274070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.274792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.276441 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d1463-8395-41bf-90a5-12e8a375c586 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.286666 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4441/8824] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:44:18.290743 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.300995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8f947-2bec-453d-8d3e-4648f41d095c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.306049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.306933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.307215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.307492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] PATH_INFO: `/v3/projects/0a78aca073fb4afaa48be967cb19c339/users/c7aa4e4d238241e39839ce9a2f208bfa/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.310626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:18.323872 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a78aca073fb4afaa48be967cb19c339, user_id=c7aa4e4d238241e39839ce9a2f208bfa, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.326735 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.342069 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4384/8825] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:44:18 2022] PUT /identity/v3/projects/0a78aca073fb4afaa48be967cb19c339/users/c7aa4e4d238241e39839ce9a2f208bfa/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:18.347459 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cae4-8d26-47c4-b0ba-b2f062a022a8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.347799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cae4-8d26-47c4-b0ba-b2f062a022a8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.348080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cae4-8d26-47c4-b0ba-b2f062a022a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.366828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9b74cae4-8d26-47c4-b0ba-b2f062a022a8 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:18.368082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b74cae4-8d26-47c4-b0ba-b2f062a022a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:18.429145 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4442/8826] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:18.439201 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:18.441480 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:18.503314 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225a9b0-7389-4887-bacb-dc466d035ce4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:18.506981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:18.507675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:18.508282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:18.508570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:18.518063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:18.519532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83614f-df48-466f-bfef-4a2763bbd693 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:18.529937 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4385/8827] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:19.192019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:19.192330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:19.192593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:19.221083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] MFA Rules not processed for user `c7aa4e4d238241e39839ce9a2f208bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:19.222421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:19.288971 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4443/8828] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:19.356294 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547da6f-e5e5-42bf-ab06-1a55d630fa4f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:19.356859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547da6f-e5e5-42bf-ab06-1a55d630fa4f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:19.356859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547da6f-e5e5-42bf-ab06-1a55d630fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:19.378241 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0547da6f-e5e5-42bf-ab06-1a55d630fa4f None None] MFA Rules not processed for user `c7aa4e4d238241e39839ce9a2f208bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:19.379650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0547da6f-e5e5-42bf-ab06-1a55d630fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:19.386747 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4386/8829] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:19.399523 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:19.401074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:19.436641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:19.478703 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9232969-a79b-440d-92cb-40ce2fce2b13 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:19.485026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:19.485730 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:19.486005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:19.486277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:19.496684 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:19.499074 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:19.512945 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4444/8830] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:29.374372 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:29.506445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=19 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:30.717556 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:30.718094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:30.718094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:30.736648 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] MFA Rules not processed for user `c7aa4e4d238241e39839ce9a2f208bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:30.737974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:30.747380 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4387/8831] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:31.013607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:31.015071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:31.028633 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d593d-38df-4c1f-883f-74c76714a782 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:31.033008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:31.033650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:31.033937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:31.034215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:31.036252 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:31.050116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:31.051634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:31.073226 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4445/8832] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:40.731308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:41.069929 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=10 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:50.404984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:50.418073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48625ca-e7ef-4ab5-8e65-336566020a51 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:50.429536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:50.430429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:50.430709 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:50.430982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] PATH_INFO: `/v3/users/c7aa4e4d238241e39839ce9a2f208bfa` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:50.432447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7aa4e4d238241e39839ce9a2f208bfa)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:50.434468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:50.489410 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7aa4e4d238241e39839ce9a2f208bfa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.490272 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7aa4e4d238241e39839ce9a2f208bfa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.499961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7aa4e4d238241e39839ce9a2f208bfa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.500684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7aa4e4d238241e39839ce9a2f208bfa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.514037 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-9494dc5c-5a1e-495a-af50-15b564831925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7aa4e4d238241e39839ce9a2f208bfa'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.530819 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4388/8833] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:44:50 2022] DELETE /identity/v3/users/c7aa4e4d238241e39839ce9a2f208bfa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:50.719444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:50.731113 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874054d-fe99-49eb-a0f2-17e8b2494f5f service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:50.798892 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:50.799848 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:50.800131 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:50.800414 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] PATH_INFO: `/v3/projects/0a78aca073fb4afaa48be967cb19c339` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:50.801687 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a78aca073fb4afaa48be967cb19c339)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:50.803677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:50.851017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a78aca073fb4afaa48be967cb19c339', 'request_id': 'req-756f28bd-e89c-4a64-857d-83e7e36acef5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.857524 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a78aca073fb4afaa48be967cb19c339', 'request_id': 'req-756f28bd-e89c-4a64-857d-83e7e36acef5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.863610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a78aca073fb4afaa48be967cb19c339', 'request_id': 'req-756f28bd-e89c-4a64-857d-83e7e36acef5'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.881777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] The token cache is being invalidate because project 0a78aca073fb4afaa48be967cb19c339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:44:50.882116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.883012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-756f28bd-e89c-4a64-857d-83e7e36acef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:44:50.885268 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4446/8834] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:44:50 2022] DELETE /identity/v3/projects/0a78aca073fb4afaa48be967cb19c339 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:50.891035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:50.891323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:50.891597 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:50.911658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:50.912906 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:50.977227 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4389/8835] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:50.985724 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:50.986018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:50.986300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.006382 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:51.007637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:51.016210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4447/8836] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:51.020761 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.031193 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7cce7-5509-44ae-b8bc-00acdf2c12de None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.036528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.037184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.037465 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.037739 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.038463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:44:51.038767 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.040413 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.051999 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4390/8837] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:44:51.056428 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.065836 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45bdd8-85b2-4eeb-8e5f-874b305f6632 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.070801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.071451 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.071793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.072119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.072804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.074691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.101959 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4448/8838] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:44:51 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:44:51.106332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.116917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b17c5c-f92d-451c-bf4b-46bf17e87cbf admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.184290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.184965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.185254 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.185535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.186249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.188217 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.194956 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:51.213510 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4391/8839] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:44:51 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:44:51.217893 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.228954 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fae2-0f2a-4619-9859-840c52f6b08a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.234850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.235681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.235965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.236245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.236973 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.238639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.249908 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4449/8840] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:44:51.254145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.265117 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b932-caa4-42eb-ac62-2934c2b36994 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.270557 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.271221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.271877 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.272154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.272884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.274522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c38cc0-f3c9-4c1a-86b8-51f2bc8f2e3d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.285436 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4392/8841] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:44:51.289799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.300791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f182-fd9a-4761-84a5-2576f8d5ae4f admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.306026 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.307553 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.307851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.308133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] PATH_INFO: `/v3/projects/64df55e7e48a453eadc168f497b511c1/users/5e0d017a266e499d8c77ba10ef87c230/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.323778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64df55e7e48a453eadc168f497b511c1, user_id=5e0d017a266e499d8c77ba10ef87c230, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.326454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.342505 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4450/8842] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:44:51 2022] PUT /identity/v3/projects/64df55e7e48a453eadc168f497b511c1/users/5e0d017a266e499d8c77ba10ef87c230/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:44:51.353427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.353689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.353972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.385110 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] MFA Rules not processed for user `5e0d017a266e499d8c77ba10ef87c230`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:44:51.386998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:51.459289 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4393/8843] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:44:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:44:51.470348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:51.472649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:51.514373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:51.544642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0781d0-4b28-4288-938e-3ea873dbd82e admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:51.548626 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:51.549285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:51.549577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:51.549856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:51.558720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:51.560474 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:51.570500 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4451/8844] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:44:56.882214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:44:56.883692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:56.966017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4639ec6-05b1-481b-86e6-1fdc972c8ff3 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:44:56.971844 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:44:56.972518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:44:56.972795 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:44:56.973255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:44:56.975189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:44:56.990469 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:44:56.992135 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8687c-5ef3-4499-b80a-18900dd3ab99 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:44:57.007540 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4394/8845] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:44:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:01.566350 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=14 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:03.065832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.132527 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4712f-5206-47fd-905f-d14a771dd85e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:03.137306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:03.138126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.138412 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.138690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] PATH_INFO: `/v3/users/5e0d017a266e499d8c77ba10ef87c230` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.139975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0d017a266e499d8c77ba10ef87c230)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:03.141898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:03.195056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0d017a266e499d8c77ba10ef87c230'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.201887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0d017a266e499d8c77ba10ef87c230'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.202561 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0d017a266e499d8c77ba10ef87c230'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.203279 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0d017a266e499d8c77ba10ef87c230'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.215952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0d017a266e499d8c77ba10ef87c230'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.236601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4452/8846] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:45:03 2022] DELETE /identity/v3/users/5e0d017a266e499d8c77ba10ef87c230 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:03.241342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.241772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.241904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.260485 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:03.261694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:03.314848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:03.325670 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4395/8847] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:03.335573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.337130 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:03.404859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8bf5b-8aee-4362-8a10-96af1917b944 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:03.408991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:03.409694 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.409978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.410256 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.420881 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:03.422359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9531fa7-576b-4b1f-9060-a651f27de6ff service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:03.433497 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4453/8848] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:03.616561 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.618159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:03.633596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc771-71c6-42f1-85ff-748bafb18d5c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:03.638746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:03.639816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.640102 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.640417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] PATH_INFO: `/v3/projects/64df55e7e48a453eadc168f497b511c1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.641682 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] RBAC: Authorizing `identity:delete_project(project_id=64df55e7e48a453eadc168f497b511c1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:03.643731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:03.697931 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64df55e7e48a453eadc168f497b511c1', 'request_id': 'req-6611e692-5e87-4039-8367-ef889e0084be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.704218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64df55e7e48a453eadc168f497b511c1', 'request_id': 'req-6611e692-5e87-4039-8367-ef889e0084be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.709874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64df55e7e48a453eadc168f497b511c1', 'request_id': 'req-6611e692-5e87-4039-8367-ef889e0084be'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.724918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] The token cache is being invalidate because project 64df55e7e48a453eadc168f497b511c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:45:03.725206 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.725918 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-6611e692-5e87-4039-8367-ef889e0084be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:03.727674 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4396/8849] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:45:03 2022] DELETE /identity/v3/projects/64df55e7e48a453eadc168f497b511c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:03.733960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.734305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.734532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.753517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:03.754758 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:03.773897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:03.824239 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4454/8850] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:03.832081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.832375 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.832650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.852021 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:03.853319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:03.862531 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4397/8851] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:03.867017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.877224 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e9eeb-67ed-4a52-928f-7364e55cea20 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:03.882316 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:03.882971 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.883255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.883541 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.884356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:45:03.884598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:03.886222 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:03.899136 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4455/8852] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:45:03.903979 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.913865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278623-7c6e-450a-8f20-8956c33b7b54 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:03.920282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:03.920942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:03.921224 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:03.921494 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:03.922185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:03.924143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:03.954067 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4398/8853] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:45:03 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:03.958391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:03.969502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e6d-2602-4f3a-93f9-102351e1c7cf admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:04.028349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:04.029014 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.029298 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.029573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.030244 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:04.032208 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:04.054683 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4456/8854] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:45:03 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:04.059740 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:04.071008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4075-b4b5-49e9-8b05-2925f485b702 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:04.076864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:04.077566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.077850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.078125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.078850 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:04.080493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:04.092041 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4399/8855] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:45:04.096478 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:04.106942 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0172c3-a55c-4f27-8996-91695d412b63 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:04.112949 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:04.113603 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.113882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.114153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.114876 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:04.116528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7c4b6-cbd3-48d7-8e76-29705f585339 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:04.127272 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4457/8856] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:45:04.131734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:04.142333 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c5163-33d2-4bdf-a073-a277fc8cda2c admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:04.148500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:04.149377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.149654 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.149913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] PATH_INFO: `/v3/projects/3f4a4f01667d451d819f4d0f416e5399/users/df27b7ed20d84bdab2ab4a84a18f1609/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.164960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4a4f01667d451d819f4d0f416e5399, user_id=df27b7ed20d84bdab2ab4a84a18f1609, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:04.167806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:04.183643 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4400/8857] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:45:04 2022] PUT /identity/v3/projects/3f4a4f01667d451d819f4d0f416e5399/users/df27b7ed20d84bdab2ab4a84a18f1609/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:04.194213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.194511 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.194794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.223722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] MFA Rules not processed for user `df27b7ed20d84bdab2ab4a84a18f1609`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:04.224945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:04.294324 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4458/8858] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:04.306162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:04.308144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:04.366535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f498294-7089-4cdc-91dd-8e06091a4e24 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:04.370589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:04.371245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:04.371542 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:04.371865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:04.380974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:04.382425 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f2bc-259f-4bd7-976f-f08336484f4d service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:04.391650 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4401/8859] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:08.897998 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:08.919084 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:08.966744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a687546-c974-4936-9ca7-360d8aea3dc6 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:08.972003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:08.972877 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:08.973162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:08.973435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] PATH_INFO: `/v3/users/df27b7ed20d84bdab2ab4a84a18f1609` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:08.974656 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df27b7ed20d84bdab2ab4a84a18f1609)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:08.976733 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.031012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df27b7ed20d84bdab2ab4a84a18f1609'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.038016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df27b7ed20d84bdab2ab4a84a18f1609'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.038679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df27b7ed20d84bdab2ab4a84a18f1609'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.039285 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df27b7ed20d84bdab2ab4a84a18f1609'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.053079 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df27b7ed20d84bdab2ab4a84a18f1609'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.068223 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4459/8860] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:45:08 2022] DELETE /identity/v3/users/df27b7ed20d84bdab2ab4a84a18f1609 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:09.072972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.073693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.073693 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.092429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:09.093574 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:09.108264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:09.156834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4402/8861] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:09.166981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.168640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:09.229625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7990-6d68-4796-afaf-6f14a3d3dd29 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.233746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.234398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.234685 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.234966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.244393 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.246049 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2a90a-c13d-464b-b1d6-ee3abe086386 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.255551 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4460/8862] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:09.440687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.442177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:09.456570 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924951c-cad2-4e0c-8b06-d3ed5b053135 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.464730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.465618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.465904 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.466180 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] PATH_INFO: `/v3/projects/3f4a4f01667d451d819f4d0f416e5399` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.467475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4a4f01667d451d819f4d0f416e5399)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.469452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.534832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4a4f01667d451d819f4d0f416e5399', 'request_id': 'req-536e0f00-87ce-4680-9d18-687f389a35ed'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.542522 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4a4f01667d451d819f4d0f416e5399', 'request_id': 'req-536e0f00-87ce-4680-9d18-687f389a35ed'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.548968 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4a4f01667d451d819f4d0f416e5399', 'request_id': 'req-536e0f00-87ce-4680-9d18-687f389a35ed'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.565909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] The token cache is being invalidate because project 3f4a4f01667d451d819f4d0f416e5399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:45:09.566392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.567295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-536e0f00-87ce-4680-9d18-687f389a35ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:45:09.569988 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4403/8863] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:45:09 2022] DELETE /identity/v3/projects/3f4a4f01667d451d819f4d0f416e5399 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:09.577124 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.577415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.577701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.596160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:09.597359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:09.634073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:09.663788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4461/8864] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:09.673563 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.673847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.674131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.695859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:09.697083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:09.706722 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4404/8865] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:09.711411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.721999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec10e-d444-47f3-b123-5a39026fa505 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.727440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.728141 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.728421 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.728698 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.729536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:45:09.729845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.731472 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.743742 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4462/8866] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:45:09.748674 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.758393 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2d99-aaef-4ef3-b6eb-051638ebfe1e None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.764616 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.765339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.765655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.765935 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.766660 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.768626 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.807121 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4405/8867] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:45:09 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:09.811854 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.822834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5169-0293-4c2a-8f0f-47e0aeb55c6a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.888675 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.889276 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.889555 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.889834 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.890519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.892504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.918095 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4463/8868] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:45:09 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:09.923080 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.937834 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0babf42-0ce4-4da1-a44a-3384fb5a7033 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.943734 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.944399 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.944678 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.944952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.945810 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.947429 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.959687 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4406/8869] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:45:09.964149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:09.974920 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b3be6-f47e-45af-afb5-9a78f667fee7 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:09.980599 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:09.981258 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:09.981563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:09.981842 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:09.982596 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:09.984302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe559e-bd71-4450-9370-bcc63018dc9b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:09.995263 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4464/8870] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:45:09.999631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:10.013053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b94024-1082-41c1-ba67-cc824312398a admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:10.022212 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:10.023488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:10.023857 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:10.024252 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] PATH_INFO: `/v3/projects/0664a859e40746a59c5cf6e6c0c6a1b3/users/4a7dbe74559048949cdf5658d15925c6/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:10.041288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0664a859e40746a59c5cf6e6c0c6a1b3, user_id=4a7dbe74559048949cdf5658d15925c6, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:10.044283 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:10.060565 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4407/8871] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:45:09 2022] PUT /identity/v3/projects/0664a859e40746a59c5cf6e6c0c6a1b3/users/4a7dbe74559048949cdf5658d15925c6/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:10.066127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8586bd-76b0-4008-b8ea-cd4e4c80b7dd None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:10.066423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8586bd-76b0-4008-b8ea-cd4e4c80b7dd None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:10.066702 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8586bd-76b0-4008-b8ea-cd4e4c80b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:10.084955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-db8586bd-76b0-4008-b8ea-cd4e4c80b7dd None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:10.086284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-db8586bd-76b0-4008-b8ea-cd4e4c80b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:10.163187 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4465/8872] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:10.176318 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:10.178448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:10.228153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:10.250420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf32e-e416-4fed-b88e-35e171323d35 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:10.256772 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:10.257759 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:10.258120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:10.258487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:10.269238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:10.270675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:10.280969 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4408/8873] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:14.433577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.434039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.434150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.481226 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] MFA Rules not processed for user `4a7dbe74559048949cdf5658d15925c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:14.482484 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:14.527766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:14.565390 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4466/8874] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:14.570231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.580669 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93df9-b831-4d25-90d0-1d2e85db7135 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.586140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.586936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.587288 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.587615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.588332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.591159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.624491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4409/8875] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:45:14 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:14.628832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.640488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb153e1-684f-4e28-9e64-07d090e69e9a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.700620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.701310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.701594 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.701869 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.702575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.704613 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.735467 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4467/8876] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:45:14 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:45:14.736832 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.749981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03ba00-36c4-4a60-ab88-0fa3f3210c80 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.755812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.756592 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.756943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.757284 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.758030 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.759848 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.772686 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4410/8877] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 21:45:14.777706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.788577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d7c4-9c7d-49b0-bc9b-f7b2918f63e1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.793858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.794766 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.795051 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.795330 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] PATH_INFO: `/v3/projects/322c918cc1e74c55939aecf731e19014/users/fb4d565e95b742c5a7555eb4022c845c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.812194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322c918cc1e74c55939aecf731e19014, user_id=fb4d565e95b742c5a7555eb4022c845c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.814884 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.832026 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4468/8878] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:45:14 2022] PUT /identity/v3/projects/322c918cc1e74c55939aecf731e19014/users/fb4d565e95b742c5a7555eb4022c845c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:45:14.836274 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.847033 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c05d3f-a44d-4329-b1d3-ba0ae25e12fa admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.907087 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.907794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.908072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.908341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.909071 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.910697 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaab4d1-ed4e-4f22-b4a6-d8de0879df4d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.923558 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4411/8879] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:45:14.926303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:14.937510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbe32-6e1a-48ac-8791-54088f433e95 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:14.942777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:14.943990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:14.943990 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:14.944248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] PATH_INFO: `/v3/projects/322c918cc1e74c55939aecf731e19014/users/fb4d565e95b742c5a7555eb4022c845c/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:14.946436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=322c918cc1e74c55939aecf731e19014, user_id=fb4d565e95b742c5a7555eb4022c845c, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:14.949635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:14.982070 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4469/8880] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:45:14 2022] PUT /identity/v3/projects/322c918cc1e74c55939aecf731e19014/users/fb4d565e95b742c5a7555eb4022c845c/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:45:19.201169 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4eba0-cc70-4937-9d2a-9c5bff445912 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:19.201663 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4eba0-cc70-4937-9d2a-9c5bff445912 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:19.202035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4eba0-cc70-4937-9d2a-9c5bff445912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:19.230131 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-81f4eba0-cc70-4937-9d2a-9c5bff445912 None None] MFA Rules not processed for user `fb4d565e95b742c5a7555eb4022c845c`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:19.231377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-81f4eba0-cc70-4937-9d2a-9c5bff445912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:19.334945 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4412/8881] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:45:19.370118 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:19.372398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:19.436248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeb618-f173-4629-8275-35a73a42ca6b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:19.439944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:19.440607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:19.440911 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:19.441168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:19.486453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:19.503939 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:19.505391 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9deda-1b2b-4faf-8957-366234982ab1 service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:19.514901 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4470/8882] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:19.636305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:19.636565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:19.636916 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:19.687749 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:19.691992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:19.693982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:19.782056 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4413/8883] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:19.841172 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946720-585b-40b6-addd-9fe09790403c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:19.841576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946720-585b-40b6-addd-9fe09790403c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:19.841924 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946720-585b-40b6-addd-9fe09790403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:19.896878 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0b946720-585b-40b6-addd-9fe09790403c None None] MFA Rules not processed for user `d40d4b6dcab740c39553774b3daed388`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:19.898415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0b946720-585b-40b6-addd-9fe09790403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:19.978142 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4471/8884] 10.222.0.18 () {58 vars in 1039 bytes} [Sat Jun 4 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:19.984819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:20.002887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb69d-a7cb-422f-9679-d3b6a415ec9b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:20.008836 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:20.009650 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:20.010025 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:20.010566 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:20.021721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:20.023428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58976a94-089d-4211-884d-c3394c1f901c service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:20.033769 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4414/8885] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:45:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:45:29.974974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=52 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:30.029582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=35 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:30.181339 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:30.181620 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:30.181899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:30.201852 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] MFA Rules not processed for user `4a7dbe74559048949cdf5658d15925c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:30.203071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:30.212221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4472/8886] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:45:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:32.002053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:32.003237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:32.003814 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:32.023703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:45:32.024952 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:32.033129 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4415/8887] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:45:32.046514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:32.059109 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb9619-5305-46a9-b065-2ff9e2c2aba2 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:32.064150 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:32.064827 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:32.065112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:32.065396 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:32.073851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:32.075542 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:32.084177 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4473/8888] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:45:42.018061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:42.081343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:54.766323 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:54.824731 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cfc24-27d7-4ab3-bb74-129b2cc4dcd6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:54.829074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:54.829765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:54.830361 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:54.830690 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:54.841019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:54.842455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:54.852662 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4416/8889] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:45:57.859540 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:45:57.861149 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:57.962092 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763861-23b7-4428-9a49-f0519d2d08e6 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:45:57.967591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:45:57.968297 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:45:57.968536 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:45:57.968816 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:45:57.970743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:45:57.986508 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:45:57.988300 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:45:58.001788 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4474/8890] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:45:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:46:04.848143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=26 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:07.995238 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=41 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:09.133369 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:46:09.135286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:46:09.154351 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae438a7-f871-42ac-96d4-11ae651056fb service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:46:09.160582 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:46:09.161232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:46:09.161535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:46:09.161846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:46:09.163841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:46:09.179858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:46:09.181719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:46:09.194513 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4417/8891] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:46:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:46:19.187627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:11.566110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:11.567607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:11.733378 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d620f-34c4-40ee-86a9-64ec916e6444 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:11.746246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:11.747522 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:11.748168 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:11.748463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:11.751354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:11.773081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:11.775845 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e46f-18bd-48ab-9e74-ffc86c1dda4e service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:11.807334 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4475/8892] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:17.805001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:17.807396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:17.828903 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203e4b5-c20d-4304-8402-54a325a2d4ac service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:17.834939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:17.835628 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:17.835913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:17.836190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:17.837980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:17.854917 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:17.856717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:17.872736 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4418/8893] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:19.314947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:19.315430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:19.315547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:19.343936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:19.345199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:19.355436 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4476/8894] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:47:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:19.397011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:19.409143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb41e4-01d8-4a0c-9c60-a5b99a4ab9a2 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:19.414840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:19.415493 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:19.415812 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:19.416094 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:19.425244 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:19.426835 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:19.435110 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4419/8895] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:47:26.163691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:26.241901 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01f08c-3508-49f5-b7a0-29e28a36ec60 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:26.258580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:26.259463 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:26.259778 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:26.260056 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] PATH_INFO: `/v3/users/4a7dbe74559048949cdf5658d15925c6` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:26.261326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7dbe74559048949cdf5658d15925c6)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:26.263283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:26.319538 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:26.322425 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7dbe74559048949cdf5658d15925c6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.332578 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7dbe74559048949cdf5658d15925c6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.333349 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7dbe74559048949cdf5658d15925c6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.334024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7dbe74559048949cdf5658d15925c6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.346452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7dbe74559048949cdf5658d15925c6'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.362298 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4477/8896] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:47:26 2022] DELETE /identity/v3/users/4a7dbe74559048949cdf5658d15925c6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:47:26.545854 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:26.558488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2356b-ff34-4a0e-b59d-97091faac400 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:26.622841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:26.623771 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:26.624041 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:26.624392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] PATH_INFO: `/v3/projects/0664a859e40746a59c5cf6e6c0c6a1b3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:26.625598 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0664a859e40746a59c5cf6e6c0c6a1b3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:26.627534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:26.682031 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0664a859e40746a59c5cf6e6c0c6a1b3', 'request_id': 'req-e283b438-b027-475a-9093-c30b184d5534'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.689150 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0664a859e40746a59c5cf6e6c0c6a1b3', 'request_id': 'req-e283b438-b027-475a-9093-c30b184d5534'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.695170 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0664a859e40746a59c5cf6e6c0c6a1b3', 'request_id': 'req-e283b438-b027-475a-9093-c30b184d5534'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.709720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] The token cache is being invalidate because project 0664a859e40746a59c5cf6e6c0c6a1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:47:26.710011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.710623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.712250 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4420/8897] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:47:26 2022] DELETE /identity/v3/projects/0664a859e40746a59c5cf6e6c0c6a1b3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:26.716526 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:26.718101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:26.732489 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67eefe-5825-46a0-861a-df73e3a9aa17 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:26.794537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:26.795423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:26.795739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:26.796020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] PATH_INFO: `/v3/users/fb4d565e95b742c5a7555eb4022c845c` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:26.797303 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4d565e95b742c5a7555eb4022c845c)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:26.799234 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:26.848422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4d565e95b742c5a7555eb4022c845c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.855332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4d565e95b742c5a7555eb4022c845c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.856032 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4d565e95b742c5a7555eb4022c845c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.856672 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4d565e95b742c5a7555eb4022c845c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.870241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-bc1e6dcc-0aa6-4c69-b6fb-d95e008b42eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4d565e95b742c5a7555eb4022c845c'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:26.885905 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4478/8898] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:47:26 2022] DELETE /identity/v3/users/fb4d565e95b742c5a7555eb4022c845c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:27.090095 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.091811 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:27.108753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283b438-b027-475a-9093-c30b184d5534 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.169145 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.170013 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.170295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.170567 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] PATH_INFO: `/v3/projects/322c918cc1e74c55939aecf731e19014` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.171859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=322c918cc1e74c55939aecf731e19014)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.173783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.180264 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:27.221293 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322c918cc1e74c55939aecf731e19014', 'request_id': 'req-4acca535-95c9-4fa2-b326-13b31589cae4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:27.227391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322c918cc1e74c55939aecf731e19014', 'request_id': 'req-4acca535-95c9-4fa2-b326-13b31589cae4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:27.233468 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322c918cc1e74c55939aecf731e19014', 'request_id': 'req-4acca535-95c9-4fa2-b326-13b31589cae4'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:27.248045 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] The token cache is being invalidate because project 322c918cc1e74c55939aecf731e19014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:47:27.248337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:27.249034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-4acca535-95c9-4fa2-b326-13b31589cae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:47:27.250979 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4421/8899] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:47:27 2022] DELETE /identity/v3/projects/322c918cc1e74c55939aecf731e19014 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:27.256372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.256899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.256899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.277432 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:27.278658 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:27.332646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:27.372870 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4479/8900] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:27.381032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.381447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.381982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.402744 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:27.404010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:27.413353 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4422/8901] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:27.417817 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.428985 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41f8a-92ba-4e1e-82e1-47c6c7022521 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.433781 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.434452 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.434740 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.435021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.435794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:47:27.436133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.437865 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.450330 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4480/8902] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:47:27.454816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.464385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8b5d-7d01-4f84-a6e3-411409184176 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.469183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.469838 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.470118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.470420 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.471116 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.473059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.505797 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4423/8903] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:47:27.510107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.520289 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ebe7c-259d-4508-a2c2-3d78e1842ebd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.582720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.583400 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.583715 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.583993 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.584686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.586616 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.609259 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4481/8904] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:47:27.613534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.624719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af68e-bdf4-4443-8a10-c995a0c8f4d4 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.631044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.632089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.632622 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.633089 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.634079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.635970 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.647794 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4424/8905] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:47:27.652312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.663722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950864c-adb2-4aa3-8a29-cc743b3d794b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.669139 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.669809 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.670091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.670405 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.671101 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.673066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55485be-b810-43c0-8169-764055a2bd10 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.683567 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4482/8906] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:47:27.687927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.698118 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b2b7c-51e1-4134-ab57-58394814bcc3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.703177 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.704096 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.704374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.704642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] PATH_INFO: `/v3/projects/54b08e1dce6b4ab496c539019c6ab8da/users/2c33c0ba0b4445189c48dcd50d68f517/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.719758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b08e1dce6b4ab496c539019c6ab8da, user_id=2c33c0ba0b4445189c48dcd50d68f517, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.722392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.740043 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4425/8907] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:47:27 2022] PUT /identity/v3/projects/54b08e1dce6b4ab496c539019c6ab8da/users/2c33c0ba0b4445189c48dcd50d68f517/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:27.755440 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.755889 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.756249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.785745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:27.786948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:27.861387 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4483/8908] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:27.866042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.931052 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6675b-42dd-4391-805c-c54845dae538 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:27.936544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:27.937421 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:27.937746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:27.938032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:27.938732 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:27.940685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:27.970854 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4426/8909] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:47:27.975070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:27.987930 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213badd-c822-4eb3-8ce0-fca994cba8ba None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.024427 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:28.051359 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.052067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.052321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.052597 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.053281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.055207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.076281 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4484/8910] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:47:27 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:47:28.080886 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:28.091446 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63188d32-552a-4530-b28a-d214393ccd34 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.097571 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.098472 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.098884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.099159 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.099919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.101526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.113533 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4427/8911] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:47:28.117907 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:28.129371 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9ea0-79b4-4591-a023-51ece659339d admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.135199 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.136137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.136420 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.136697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] PATH_INFO: `/v3/projects/0533cd4786d446ca99d7c27b98af73ba/users/7c54c2601e9041c3b208662d732f77e1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.154186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0533cd4786d446ca99d7c27b98af73ba, user_id=7c54c2601e9041c3b208662d732f77e1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.157115 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.173424 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4485/8912] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:47:28 2022] PUT /identity/v3/projects/0533cd4786d446ca99d7c27b98af73ba/users/7c54c2601e9041c3b208662d732f77e1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:28.177548 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:28.184315 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:28.188373 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015ba18-d370-4b61-af05-4133da0b720e admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.249998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.250658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.250942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.251215 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.251943 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.253536 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100680e-19cb-4d46-b28a-8ad33cac73e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.263887 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4428/8913] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:47:28.268640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:28.280179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be5d18-ca52-4384-a276-204cd9f8be34 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.285579 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.286500 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.286805 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.287065 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] PATH_INFO: `/v3/projects/0533cd4786d446ca99d7c27b98af73ba/users/7c54c2601e9041c3b208662d732f77e1/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.289097 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0533cd4786d446ca99d7c27b98af73ba, user_id=7c54c2601e9041c3b208662d732f77e1, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.291838 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.303109 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4486/8914] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:47:28 2022] PUT /identity/v3/projects/0533cd4786d446ca99d7c27b98af73ba/users/7c54c2601e9041c3b208662d732f77e1/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:47:28.314112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.314633 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.315129 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.349778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] MFA Rules not processed for user `7c54c2601e9041c3b208662d732f77e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:28.351003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:28.429131 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4429/8915] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:28.444253 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:28.446305 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:28.527814 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09f54b-f53e-46ef-9fbe-5f4612db91c1 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:28.534143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:28.534785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:28.535067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:28.535345 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:28.594186 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:28.595921 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334535dd-a5f3-49e4-9820-c30244404b2c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:28.605632 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4487/8916] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:31.816978 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:31.818524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:31.877568 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6effa66-d963-4c9a-afe6-a1f31be303df None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:31.881397 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:31.882059 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:31.882346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:31.882624 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:31.892342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:31.893874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:31.903904 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4430/8917] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:34.826331 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:34.826767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:34.826885 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:34.845992 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:47:34.847444 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:34.854544 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4488/8918] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:47:35.227535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:35.229526 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:35.241842 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a49-2433-48a9-a97c-6258f14c8cb5 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:35.245703 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:35.246459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:35.246639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:35.247339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:35.249388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:35.262806 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:35.264348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:35.277873 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4431/8919] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:35.694105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:35.695902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:35.732735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:35.811376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341e7d5-1ad7-488c-a95e-c0695dde85e8 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:35.818071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:35.818840 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:35.819123 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:35.819399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:35.821358 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:35.835021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:35.836676 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:35.848344 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4489/8920] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:38.016797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:38.032077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00310-8af5-4afd-9b4c-deb39719dbda service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:38.035924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:38.036586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:38.036869 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:38.037146 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:38.039073 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:38.064218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:38.066791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:38.084430 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4432/8921] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:42.763013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:42.773482 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319baad-ed17-4e0a-b523-5bb5df7dca64 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:42.777944 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:42.778587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:42.778867 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:42.779143 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:42.781245 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:42.797966 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:42.799409 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e29ba6-53b0-40e2-85e5-51ed6c3d0b8c service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:42.813310 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4490/8922] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:43.430797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:47:43.437003 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=100 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:43.447019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99a39-dbd3-43a0-88a4-3f415cbe7a96 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:47:43.452788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:47:43.453440 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:47:43.453723 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:47:43.454005 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:47:43.455926 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:47:43.472120 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:47:43.473768 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:47:43.488877 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4433/8923] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:47:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:47:52.806018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=30 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:53.480614 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:27.774022 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606f19-b4bd-4a9a-8bbe-087d712d3ca3 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:48:27.774607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606f19-b4bd-4a9a-8bbe-087d712d3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:48:27.774607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04606f19-b4bd-4a9a-8bbe-087d712d3ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:48:27.795850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-04606f19-b4bd-4a9a-8bbe-087d712d3ca3 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:48:27.797053 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-04606f19-b4bd-4a9a-8bbe-087d712d3ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:48:27.807380 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4491/8924] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jun 4 21:48:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:48:27.820816 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:48:27.836355 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5d0e-fe59-425b-9ad2-6e826bd1611d service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:48:27.841880 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:48:27.842535 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:48:27.842819 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:48:27.843101 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:48:27.853358 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:48:27.854986 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2710a-d5bb-4684-ace2-4f46fff091be service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:48:27.866047 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4434/8925] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:48:37.789155 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:37.861821 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:38.322728 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:48:38.323015 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:48:38.323291 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:48:38.350379 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:48:38.351635 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:48:38.359079 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4492/8926] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:48:39.113414 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:48:39.114605 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:48:39.114888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:48:39.135083 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:48:39.136621 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:48:39.147443 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4435/8927] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Jun 4 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:48:39.153605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:48:39.168223 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49418215-2961-4695-98c3-b8e7ac455c61 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:48:39.173720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:48:39.174326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:48:39.174606 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:48:39.174880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:48:39.176716 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:48:39.189757 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:48:39.191799 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef14391-2776-4703-b7ce-9198c59f2786 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:48:39.203544 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4493/8928] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:48:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:48:49.129190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.198741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:03.567618 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:49:03.577964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83a861-589e-4228-b7f4-e7cc3dd218a5 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:49:03.582961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:49:03.583115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:49:03.583395 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:49:03.583712 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:49:03.585959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:49:03.602477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:49:03.602477 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:49:03.612763 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4436/8929] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:49:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:49:12.013296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:49:12.013870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:49:12.013870 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:49:12.036704 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:49:12.038413 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:49:12.048848 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4494/8930] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:49:12.080401 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:49:12.096638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85666b-ac48-40d7-950a-cc9579d192a8 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:49:12.104043 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:49:12.104687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:49:12.104980 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:49:12.105245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:49:12.115015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:49:12.116748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ee969-65fd-4621-9449-0d5803362730 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:49:12.127018 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4437/8931] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:49:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:49:22.027952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:22.122861 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=12 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:10.901112 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:50:10.912003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f52f9f-4b39-49a1-a845-9b12041e1b7b None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:50:10.917774 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:50:10.918426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:10.918767 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:10.919164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:10.921362 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:50:10.936882 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:50:10.938499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:50:10.951931 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4495/8932] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:50:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:50:17.039742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aec05-471e-473a-b116-814155e11790 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:17.040291 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aec05-471e-473a-b116-814155e11790 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:17.040383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aec05-471e-473a-b116-814155e11790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:17.059091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-bd0aec05-471e-473a-b116-814155e11790 None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:50:17.060434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-bd0aec05-471e-473a-b116-814155e11790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:50:17.069340 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4438/8933] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:50:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:50:20.241151 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:50:20.253067 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf91965-27d1-44b0-a5ea-bf81f35cc5cb service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:50:20.258039 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:50:20.258768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:20.263640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:20.263640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:20.265220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:50:20.279959 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:50:20.281485 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe209f5-f7a9-4a84-a246-bb0659584810 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:50:20.297735 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4496/8934] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:50:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:50:27.053961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:27.564249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:27.564532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:27.564883 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:27.605937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:50:27.607524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:50:27.626811 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4439/8935] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 21:50:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:50:29.671859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:29.672338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:29.672430 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:29.691158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:50:29.692426 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:50:29.702148 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4497/8936] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:50:29.713856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:50:29.723965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66936662-49d6-4e66-8c4f-19e42c9dedf6 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:50:29.727752 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:50:29.728511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:50:29.728885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:50:29.729338 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:50:29.741076 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:50:29.742603 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:50:29.754313 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4440/8937] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:50:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:50:39.685638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=15 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:39.749985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=15 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:04.256454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:04.266880 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f46e3-1a4a-4671-bc66-251ba4104876 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:04.271677 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:04.275955 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.276246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.276529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.278480 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.293060 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:04.294534 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa08ee-c1dd-4cea-9417-4614bc06dc70 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:04.306484 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4498/8938] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:04.456279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:04.466068 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8047e88-3765-4df5-9681-df3905d1caba service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:04.468024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.468322 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.468605 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.469736 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:04.470382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.470670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.470951 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.472809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.487211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:04.487763 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:04.488871 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc50ab-8d99-42d5-b8af-c57465f26485 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:04.489016 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.500135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4441/8939] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:04.505224 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4499/8940] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Jun 4 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:04.509069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533526-e7eb-42e8-a74c-4f4d2c5d04fa None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.509364 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533526-e7eb-42e8-a74c-4f4d2c5d04fa None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.509644 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5533526-e7eb-42e8-a74c-4f4d2c5d04fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.528298 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c5533526-e7eb-42e8-a74c-4f4d2c5d04fa None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:04.529518 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c5533526-e7eb-42e8-a74c-4f4d2c5d04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.540010 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4442/8941] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:04.550683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:04.561337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ecd1-bcf7-4538-9a09-2c39e57e78ad None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:04.565295 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:04.565943 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.566225 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.566529 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.578212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:04.580102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551cfd-b479-45c9-9d27-483b9a188451 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:04.591588 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4500/8942] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:04.599234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e49df-4921-4211-a3c6-01d1e7aa3bcc None None] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.599234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e49df-4921-4211-a3c6-01d1e7aa3bcc None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.599487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e49df-4921-4211-a3c6-01d1e7aa3bcc None None] PATH_INFO: `/` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.601231 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4443/8943] 10.222.0.18 () {54 vars in 921 bytes} [Sat Jun 4 21:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 21:51:04.609410 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.609701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.609986 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.649665 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:04.650873 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.659732 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4501/8944] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:04.682237 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.682524 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.682841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.702728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:04.703683 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.712892 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4444/8945] 10.222.0.18 () {58 vars in 1057 bytes} [Sat Jun 4 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:04.719021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:04.730122 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12564f-d7d0-4442-bd1e-fbdccc667a22 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:04.735184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:04.735858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.736144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.736423 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.745283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:04.746928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24f6c-a53c-4624-9449-4adaad267735 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:04.757844 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4502/8946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:51:04.936590 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:04.948753 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc585-5482-450c-9333-1857f89ddfb8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:04.953405 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:04.954050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:04.954329 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:04.954600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:04.956572 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:04.975891 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:04.977277 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:04.990953 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4445/8947] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:05.846926 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ea5f-3532-40dc-938c-bb3898c60cbe None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:05.847466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ea5f-3532-40dc-938c-bb3898c60cbe None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:05.847466 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ea5f-3532-40dc-938c-bb3898c60cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:05.868686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-1385ea5f-3532-40dc-938c-bb3898c60cbe None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:05.869936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1385ea5f-3532-40dc-938c-bb3898c60cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:05.877618 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4503/8948] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:05.892154 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:05.902255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e626-3ea3-480e-92be-1b948872ae0b service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:05.906029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:05.906676 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:05.906960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:05.907238 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:05.915412 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:05.916939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:05.924834 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4446/8949] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:15.863184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=33 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:15.921728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=24 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:18.974936 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b826e5-7be0-44f8-bed7-be9a63016cac None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:18.975532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b826e5-7be0-44f8-bed7-be9a63016cac None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:18.978005 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b826e5-7be0-44f8-bed7-be9a63016cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:18.997133 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d7b826e5-7be0-44f8-bed7-be9a63016cac None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:18.998332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d7b826e5-7be0-44f8-bed7-be9a63016cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:19.005105 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4504/8950] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Jun 4 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:51:19.017629 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:19.030910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c513ea-3ca5-43e7-a2cc-ef4dab4085a7 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:19.037576 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:19.038463 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:19.038741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:19.039018 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:19.047044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:19.048498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:19.058726 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4447/8951] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:19.514693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef7f-c722-42a7-935e-0697a255e1c7 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:19.515045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef7f-c722-42a7-935e-0697a255e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:19.515324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cef7f-c722-42a7-935e-0697a255e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:19.536210 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-ac7cef7f-c722-42a7-935e-0697a255e1c7 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:19.537435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-ac7cef7f-c722-42a7-935e-0697a255e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:19.547570 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4505/8952] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:51:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:19.569748 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:19.584632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fb68-ea71-4b89-986c-1ef500f6d61c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:19.592890 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:19.593738 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:19.594182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:19.594473 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:19.604962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:19.606924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:19.619768 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4448/8953] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:26.513249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab951fd-2237-4434-bb1c-de868b185b9d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:26.513775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab951fd-2237-4434-bb1c-de868b185b9d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:26.513775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab951fd-2237-4434-bb1c-de868b185b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:26.536726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dab951fd-2237-4434-bb1c-de868b185b9d None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:26.538004 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dab951fd-2237-4434-bb1c-de868b185b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:26.549221 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4506/8954] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:51:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:26.569534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:26.580878 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b35fa8-5a9b-492b-95c1-e88a2dc7964d service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:26.594185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:26.594882 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:26.595160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:26.595431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:26.605380 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:26.607165 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:26.622519 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4449/8955] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:51:36.530806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=9 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:36.614476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=18 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:56.032091 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6f68-2bc0-40f0-8fc2-415ab55b1595 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:56.032660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6f68-2bc0-40f0-8fc2-415ab55b1595 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:56.032660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f6f68-2bc0-40f0-8fc2-415ab55b1595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:56.052785 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e90f6f68-2bc0-40f0-8fc2-415ab55b1595 None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:51:56.054000 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e90f6f68-2bc0-40f0-8fc2-415ab55b1595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:51:56.065248 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4507/8956] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:51:56.082352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:51:56.094449 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f939f5-3ef8-419d-aa70-ada7604ccee4 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:51:56.100708 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:51:56.101360 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:51:56.101639 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:51:56.101913 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:51:56.113079 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:51:56.115537 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:51:56.126923 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4450/8957] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:52:06.046771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:06.124631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:06.213284 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:52:06.213593 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:52:06.213948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:52:06.236863 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:52:06.238351 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:52:06.248060 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4508/8958] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:52:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:52:16.229899 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:39.904163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:52:39.946462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658e88d-9398-4e85-9908-97195440f687 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:52:39.953173 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:52:39.953830 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:52:39.954114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:52:39.954394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:52:39.963208 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:52:39.964826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f30d7a-bb6c-47ad-b93a-69ad45ec288a service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:52:39.974364 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4451/8959] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:52:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:52:49.970261 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=20 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:33.943860 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:53:33.977761 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e00119-dbe4-4aa8-899c-cf58618cd30a None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:53:33.983519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303844b-4442-4e59-9336-40f109766179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:53:33.984192 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303844b-4442-4e59-9336-40f109766179 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:33.984465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303844b-4442-4e59-9336-40f109766179 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:33.984760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303844b-4442-4e59-9336-40f109766179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:33.996182 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303844b-4442-4e59-9336-40f109766179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:53:33.997850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303844b-4442-4e59-9336-40f109766179 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:53:34.008710 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4509/8960] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:53:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:53:38.673802 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:38.674332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:38.674332 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:38.713843 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:53:38.715091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:53:38.737393 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4452/8961] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:53:38.753751 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303844b-4442-4e59-9336-40f109766179 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:53:38.766582 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303844b-4442-4e59-9336-40f109766179 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:53:38.772639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:53:38.773299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:38.773581 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:38.773886 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:38.783746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:53:38.784999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9fca3-faf2-4846-9c91-6c003f869d1c service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:53:38.795427 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4510/8962] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:53:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:53:41.753149 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:53:41.763428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae301c1-d764-40e3-9b4b-4b9504365c1c None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:53:41.767755 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:53:41.768486 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:41.768884 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:41.769221 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:41.779390 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:53:41.780975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b61d9-5d2f-4ca1-8be3-3752500ac8f8 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:53:41.791458 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4453/8963] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:53:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:53:44.516087 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:44.517046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:44.517573 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:44.536697 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] MFA Rules not processed for user `2c33c0ba0b4445189c48dcd50d68f517`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:53:44.538059 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:53:44.564972 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4511/8964] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:53:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:53:44.890346 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:44.890887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:44.890887 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:44.933765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:53:44.935362 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:53:44.946000 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4454/8965] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:53:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:53:44.964887 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:53:44.977001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b6b13-7635-4d04-bf6c-6778751e85d1 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:53:44.982619 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:53:44.983846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:44.984627 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:44.985055 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:44.995237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:53:44.996775 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:53:45.006671 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4512/8966] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:53:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:53:46.463162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:53:46.477589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617faf5-6721-48c5-9292-763d68be7aca None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:53:46.484265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:53:46.485134 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:53:46.485580 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:53:46.485998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:53:46.496911 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:53:46.499349 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbca8e-e12c-4613-b483-f4257e6d4119 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:53:46.522604 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4455/8967] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:53:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:53:55.002872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=29 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:56.506382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=36 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:17.106352 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:17.120069 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18531-7ec1-4713-acad-8ce04a8e99d2 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:17.125710 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:17.126361 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:17.126643 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:17.126918 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:17.136140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:17.137734 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:17.148557 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4513/8968] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:27.144010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:43.175396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:43.175981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:43.176160 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:43.196670 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] MFA Rules not processed for user `3fecce52ceb3494185ea04b82d652f91`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:43.198019 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:43.207589 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4456/8969] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:54:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:43.224247 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:43.235982 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabba257-fcc8-4409-ab7a-b59b357d7a99 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:43.242780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:43.243756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:43.244231 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:43.244660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:43.256266 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:43.258302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7fb7d-ad77-4d70-9b17-faa4fb598e8b service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:43.272580 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4514/8970] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:43.491185 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:43.570885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a86b2-c1d3-4df2-aabf-38b2b817a721 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:43.575385 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:43.576312 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:43.576894 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:43.577324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] PATH_INFO: `/v3/users/2c33c0ba0b4445189c48dcd50d68f517` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:43.578543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c33c0ba0b4445189c48dcd50d68f517)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:43.580482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:43.636543 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c33c0ba0b4445189c48dcd50d68f517'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:43.637223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c33c0ba0b4445189c48dcd50d68f517'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:43.644504 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c33c0ba0b4445189c48dcd50d68f517'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:43.645166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c33c0ba0b4445189c48dcd50d68f517'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:43.658411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c33c0ba0b4445189c48dcd50d68f517'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:43.674117 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4457/8971] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:54:43 2022] DELETE /identity/v3/users/2c33c0ba0b4445189c48dcd50d68f517 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:43.678908 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:43.679335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:43.679742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:43.719334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:43.720595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:43.781211 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4515/8972] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:54:43.792062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:43.794411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:43.874034 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:43.882909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a2bfc-01d6-4278-ac7f-64714c71fc55 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:43.887409 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:43.888250 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:43.888689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:43.889265 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:43.899539 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:43.901015 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:43.910756 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4458/8973] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:44.104649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:44.106611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:44.122086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb655ec-f95d-49e4-a6c7-c6e73e71ba67 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:44.128024 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:44.128872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:44.129267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:44.129399 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] PATH_INFO: `/v3/projects/54b08e1dce6b4ab496c539019c6ab8da` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:44.130646 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b08e1dce6b4ab496c539019c6ab8da)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:44.132844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:44.183164 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b08e1dce6b4ab496c539019c6ab8da', 'request_id': 'req-31d591d3-55af-409f-99a1-30cd2449c17b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.189369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b08e1dce6b4ab496c539019c6ab8da', 'request_id': 'req-31d591d3-55af-409f-99a1-30cd2449c17b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.194871 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b08e1dce6b4ab496c539019c6ab8da', 'request_id': 'req-31d591d3-55af-409f-99a1-30cd2449c17b'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.209669 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] The token cache is being invalidate because project 54b08e1dce6b4ab496c539019c6ab8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:54:44.209961 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.210641 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.212256 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4516/8974] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:54:44 2022] DELETE /identity/v3/projects/54b08e1dce6b4ab496c539019c6ab8da => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:44.216601 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:44.226960 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807a19-3f4d-47b9-9a72-3b33bc95b572 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:44.294741 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:44.295677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:44.295965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:44.296245 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] PATH_INFO: `/v3/users/7c54c2601e9041c3b208662d732f77e1` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:44.297520 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c54c2601e9041c3b208662d732f77e1)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:44.299454 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:44.357292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c54c2601e9041c3b208662d732f77e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.357990 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c54c2601e9041c3b208662d732f77e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.365775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c54c2601e9041c3b208662d732f77e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.366888 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c54c2601e9041c3b208662d732f77e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.382341 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-8b187006-caba-4368-a1ee-03f2789e4a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c54c2601e9041c3b208662d732f77e1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.400812 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4459/8975] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 21:54:44 2022] DELETE /identity/v3/users/7c54c2601e9041c3b208662d732f77e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:44.722335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:44.724066 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:44.742940 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d591d3-55af-409f-99a1-30cd2449c17b admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:44.810001 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:44.822638 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:44.826637 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:44.827313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:44.827903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] PATH_INFO: `/v3/projects/0533cd4786d446ca99d7c27b98af73ba` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:44.829811 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0533cd4786d446ca99d7c27b98af73ba)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:44.832448 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:44.890308 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0533cd4786d446ca99d7c27b98af73ba', 'request_id': 'req-308f0223-4375-4382-b856-decde6ae10fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.899935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0533cd4786d446ca99d7c27b98af73ba', 'request_id': 'req-308f0223-4375-4382-b856-decde6ae10fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.908088 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0533cd4786d446ca99d7c27b98af73ba', 'request_id': 'req-308f0223-4375-4382-b856-decde6ae10fe'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.926248 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] The token cache is being invalidate because project 0533cd4786d446ca99d7c27b98af73ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 21:54:44.926563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.927693 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-308f0223-4375-4382-b856-decde6ae10fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 21:54:44.930123 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4517/8976] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:54:44 2022] DELETE /identity/v3/projects/0533cd4786d446ca99d7c27b98af73ba => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:44.936417 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:44.936716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:44.936992 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:44.987442 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:44.988742 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:45.040555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:45.057760 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4460/8977] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:45.068806 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.069054 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.069465 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.095969 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:45.097235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:45.106803 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4518/8978] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:45.111665 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.122932 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9390a-d93e-4723-baf0-7aaac220d7f9 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.128402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.129069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.129379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.129655 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] PATH_INFO: `/v3/domains` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.130382 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97804) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 21:54:45.130684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.132431 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.145095 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4461/8979] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 21:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 21:54:45.150442 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.160595 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d7b57-aa6b-4777-942a-22745bb6e954 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.165999 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.166634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.166919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.167200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.167965 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.169978 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.210595 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4519/8980] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:54:45 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:54:45.217638 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.228774 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d408d7-5c6b-4706-abd6-e2be901c3122 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.289457 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.290130 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.290415 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.290687 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.291400 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.293357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.315261 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4462/8981] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:54:45 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:54:45.319839 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.330768 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf199f-457a-4af7-8af9-73ea348c2b30 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.336194 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.336897 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.337179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.337453 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.338338 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.340160 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.350798 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4520/8982] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:54:45.355497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.366658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf5ac-2132-478a-8ea0-8de2a1b3c33d admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.373488 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.374528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.374975 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.375428 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.376691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.379273 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032567-5190-4f01-bddb-bd05fe6d2c18 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.392028 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4463/8983] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:54:45.396843 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.407618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf5eea-61a2-466a-840b-ada6111e1f71 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.412644 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.413584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.413891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.414183 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] PATH_INFO: `/v3/projects/179af47cc6864305ab601ac5edd826ee/users/e94e127dc47a477d848d7ff172109538/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.429429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=179af47cc6864305ab601ac5edd826ee, user_id=e94e127dc47a477d848d7ff172109538, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.432140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.450201 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4521/8984] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:54:45 2022] PUT /identity/v3/projects/179af47cc6864305ab601ac5edd826ee/users/e94e127dc47a477d848d7ff172109538/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:45.456010 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359ff0-c0ee-47a9-8989-650d66e66f3d None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.456308 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359ff0-c0ee-47a9-8989-650d66e66f3d None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.456615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80359ff0-c0ee-47a9-8989-650d66e66f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.476029 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-80359ff0-c0ee-47a9-8989-650d66e66f3d None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:45.477378 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-80359ff0-c0ee-47a9-8989-650d66e66f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:45.545515 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4464/8985] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:45.555947 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:45.557797 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:45.615765 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb398416-17eb-4382-8787-fbdc84dadbcd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:45.619557 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:45.620212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:45.620495 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:45.620772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:45.629793 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:45.631438 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:45.641511 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4522/8986] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:49.863153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:49.863721 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:49.863974 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:49.894826 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] MFA Rules not processed for user `e94e127dc47a477d848d7ff172109538`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:49.897049 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:49.954441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:49.982954 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4465/8987] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:49.984519 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:49.998343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85add-fb62-46b2-b5fe-186cb9870234 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.003746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.004660 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.005083 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.005513 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.006348 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.008577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.020600 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:50.048107 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4523/8988] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 21:54:49 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 21:54:50.049352 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:50.066627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2e1a3-ddd5-4371-a51f-8994f7fba87b None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.134023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.134717 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.135001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.135280 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] PATH_INFO: `/v3/users` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.136023 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.137961 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.160680 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4466/8989] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 21:54:50 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 21:54:50.164705 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:50.175607 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949b1a-a07d-4c6d-9369-9f51d6dfa0e9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.181288 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.182110 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.182445 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.182745 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.183516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.185212 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.196941 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4524/8990] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:54:50.201157 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:50.213839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77beed-59cb-4eca-8e21-8d0d493eb0ec admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.221188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.222490 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.222874 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.223225 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] PATH_INFO: `/v3/projects/ea9278da7a084d8bbc4732059cccc27c/users/a5035a69cc0f48c3814c074983724f3e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.240232 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9278da7a084d8bbc4732059cccc27c, user_id=a5035a69cc0f48c3814c074983724f3e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.242949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.260394 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4467/8991] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:54:50 2022] PUT /identity/v3/projects/ea9278da7a084d8bbc4732059cccc27c/users/a5035a69cc0f48c3814c074983724f3e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 21:54:50.264516 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:50.275228 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b0888-bea1-4426-8216-ada9f798ff65 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.333108 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.333756 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.334346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.334622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.335634 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.337335 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464583f-0a36-434d-8a2b-314a5ae57db6 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.347566 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4525/8992] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 21:54:50.352016 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:50.362500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0171-d63b-4fb0-8117-be2ffc0ada18 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:50.367249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:50.368171 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:50.368453 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:50.368728 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] PATH_INFO: `/v3/projects/ea9278da7a084d8bbc4732059cccc27c/users/a5035a69cc0f48c3814c074983724f3e/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:50.371242 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9278da7a084d8bbc4732059cccc27c, user_id=a5035a69cc0f48c3814c074983724f3e, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:50.373386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:50.384912 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4468/8993] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 21:54:50 2022] PUT /identity/v3/projects/ea9278da7a084d8bbc4732059cccc27c/users/a5035a69cc0f48c3814c074983724f3e/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 21:54:54.804752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018eae-f150-46cd-9eb1-f4e122cbf016 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:54.805249 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018eae-f150-46cd-9eb1-f4e122cbf016 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:54.805779 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018eae-f150-46cd-9eb1-f4e122cbf016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:54.840505 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-0e018eae-f150-46cd-9eb1-f4e122cbf016 None None] MFA Rules not processed for user `a5035a69cc0f48c3814c074983724f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:54.841855 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-0e018eae-f150-46cd-9eb1-f4e122cbf016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:54.930581 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4526/8994] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:54.948746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:54.950863 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:55.041286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68451451-fe76-4e50-be92-ab66114106f3 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:55.049331 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:55.051433 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:55.051946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:55.052391 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:55.102558 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:55.132322 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:55.134411 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac0f6-34ef-4f69-bf7f-b6da320a474f service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:55.144973 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4469/8995] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:56.221612 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:56.222120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:56.222214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:56.240786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] MFA Rules not processed for user `e94e127dc47a477d848d7ff172109538`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:56.242041 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:56.250469 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4527/8996] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:54:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:56.572441 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:56.572946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:56.572946 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:56.592809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:54:56.594930 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:56.648146 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4470/8997] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:54:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:54:56.660140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:56.670752 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e71f0b-0d47-4bfe-ab30-e7ff666e926c None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:56.675082 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:56.676435 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:56.676828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:56.677114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:56.685456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:56.686915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:56.695989 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4528/8998] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:54:57.036579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:54:57.037964 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:57.121531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1145839-656f-4314-bf4e-39ddb934a8ee None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:54:57.126627 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:54:57.127290 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:54:57.127607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:54:57.127889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:54:57.129675 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:54:57.141859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:54:57.143459 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341bc65-39d9-4ba8-8c58-ee28874f7ac5 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:54:57.154615 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4471/8999] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:54:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:55:06.692129 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:07.150263 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=66 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:08.060318 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:55:08.070068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598eefa-5dd4-43bf-a6d3-c9c1d03d362b service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:55:08.074591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:55:08.075233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:55:08.075532 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:55:08.075818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:55:08.085642 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:55:08.087072 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:55:08.097057 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4529/9000] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:55:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:55:18.092935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:04.524422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:04.524953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:04.524953 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:04.582577 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] MFA Rules not processed for user `828a7d4e334d459cb88fc2ba20894623`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:04.583847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:04.657130 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4472/9001] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Jun 4 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:04.663313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:04.673336 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4623a9-191d-46b9-8e0c-29cc6dbb4366 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:04.677804 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:04.678456 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:04.678738 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:04.679020 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:04.680891 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:04.702903 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:04.704392 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:04.715418 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4530/9002] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:04.979020 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:04.989730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3bcb-c17d-4fb6-bf4c-20178287f3a8 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:04.993920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:04.994579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:04.994949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:04.995234 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:04.997475 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:05.012152 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:05.013600 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6107-249d-4959-8bcb-3caf853de0ea service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:05.024785 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4473/9003] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:05.608144 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:05.618030 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996516-0e4e-4eac-a065-84d71de092bb service glance] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:05.622337 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:05.623003 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:05.623281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:05.623559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:05.625502 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:05.635801 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:05.637198 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:05.645955 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4531/9004] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:15.019962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=44 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:15.641945 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=15 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:17.434492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:17.435498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:17.435498 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:17.485919 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:17.487147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:17.556109 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4474/9005] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:57:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:17.605047 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:17.606640 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:17.703314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa48a35-14d5-485f-926e-d87e3dba8bd9 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:17.708725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:17.709376 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:17.709653 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:17.709928 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:17.718589 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:17.720220 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7395f3-5fcc-47ea-9e00-c1abda8342c2 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:17.728234 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4532/9006] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:57:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:57:20.144560 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:20.176219 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf2528-4813-4b50-8e3f-fbbcf9c7ac76 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:20.182075 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:20.182773 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:20.183063 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:20.183347 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:20.185856 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:20.222394 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:20.224262 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:20.267775 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4475/9007] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:57:27.725031 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=41 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:30.245692 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=55 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:30.359116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505898d2-9b9c-45e1-9a38-68d588a7ce7c None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:30.359701 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505898d2-9b9c-45e1-9a38-68d588a7ce7c None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:30.359858 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505898d2-9b9c-45e1-9a38-68d588a7ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:30.390403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-505898d2-9b9c-45e1-9a38-68d588a7ce7c None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:30.391700 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-505898d2-9b9c-45e1-9a38-68d588a7ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:30.402844 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4533/9008] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:30.415163 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:30.424231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab2002-8e97-416e-9715-bad947f4e793 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:30.427949 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828a7d4e334d459cb88fc2ba20894623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:30.428699 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:30.429053 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:30.429402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:30.440620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:30.442060 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:30.454055 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4476/9009] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:30.516983 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:30.517286 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:30.517585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:30.536158 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] MFA Rules not processed for user `6afed72705e6494c9ce5272b328e416b`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:30.537332 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:30.543982 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4534/9010] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:30.555011 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:30.565377 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372b702-468a-4c90-8cec-dbb19d75a914 service glance] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:30.569251 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:30.569923 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:30.570204 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:30.570483 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:30.578544 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:30.580035 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:30.588365 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4477/9011] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:30.670114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:30.671776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:30.682794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be202ad4-5ae9-43bb-8b60-4865bcaa7d25 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:30.687828 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:30.688483 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:30.688772 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:30.689080 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:30.691214 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:30.709353 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:30.710791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:30.724888 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4535/9012] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:31.684797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:31.693432 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23099dd-a753-4926-8ea7-f88382cb9b2a service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:31.697190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:31.697828 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:31.698105 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:31.698376 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:31.700357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:31.710746 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:31.712211 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23725f5-ac94-498a-9b07-37fb2d97aa1e service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:31.720963 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4478/9013] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 21:57:32.624306 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:32.625803 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:32.663604 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c736e9-9edf-4e87-a7d4-93983e123a27 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:32.672832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:32.673746 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:32.674034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:32.674464 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:32.676429 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:32.690570 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:32.692941 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:32.709609 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4536/9014] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:57:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:57:33.414065 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c0b1-0b60-4915-beba-f2a070d2f1c3 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:33.414547 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c0b1-0b60-4915-beba-f2a070d2f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:33.414684 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c0b1-0b60-4915-beba-f2a070d2f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:33.434069 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-ae41c0b1-0b60-4915-beba-f2a070d2f1c3 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:33.435478 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-ae41c0b1-0b60-4915-beba-f2a070d2f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:33.444510 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4479/9015] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 21:57:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:33.458625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:33.470137 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ad664-581f-46b2-96f2-f64e42bdde6c service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:33.475683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:33.476343 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:33.476628 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:33.476904 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:33.485415 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:33.487012 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:33.495764 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4537/9016] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:57:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:57:43.428366 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=21 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:43.492760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=28 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:47.669909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:47.670436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:47.670436 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:47.690982 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:57:47.692316 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:57:47.701394 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4480/9017] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 21:57:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 21:57:47.715946 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:57:47.727790 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7ec4-1593-4af7-9ed7-43acf1ac4d37 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:57:47.734314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:57:47.734960 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:57:47.735215 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:57:47.735535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:57:47.746313 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:57:47.747948 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:57:47.757185 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4538/9018] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 21:57:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 21:57:57.684927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:57.753387 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:08.168301 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:59:08.182764 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a6fb-abdc-4e82-b43d-eae563e7b119 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:59:08.188587 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:59:08.189455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:59:08.189745 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:59:08.190024 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:59:08.191897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:08.204984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:59:08.206596 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db5422-93bb-4870-ad5f-d7c690c3db8c service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:59:08.217611 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4481/9019] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:59:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:59:10.772514 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:59:10.801034 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a30abe-b86a-4ea5-ad60-cbc6571ae48a service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:59:10.808019 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:59:10.808819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:59:10.809153 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:59:10.809584 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:59:10.811780 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:10.824962 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:59:10.825528 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:59:10.825809 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:59:10.838501 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:59:10.840162 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:59:10.843892 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] MFA Rules not processed for user `e94e127dc47a477d848d7ff172109538`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 21:59:10.845179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:10.850415 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4539/9020] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:59:10.852320 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4482/9021] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 21:59:13.757819 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:59:13.771792 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069dd52-b479-4cd0-ae00-ceab2e715e37 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:59:13.777864 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:59:13.778866 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:59:13.779250 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:59:13.779690 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:59:13.782802 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:13.793875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:59:13.795321 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:59:13.804367 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4540/9022] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:59:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:59:19.053783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 21:59:19.055476 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:19.071286 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0403edb-0d15-45b6-bb66-10c5c12a1cc7 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 21:59:19.077078 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 21:59:19.077933 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 21:59:19.078285 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 21:59:19.078623 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 21:59:19.080636 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 21:59:19.093231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 21:59:19.094827 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8164925-3c39-4f6a-8d93-b29c62515153 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 21:59:19.112198 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4483/9023] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 21:59:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 21:59:23.800696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=21 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:29.107845 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=15 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:33.932794 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:01:33.946846 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f98b9e-dc5c-417e-860a-20ca81b08f08 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:01:33.952972 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:01:33.953617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:01:33.953910 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:01:33.954184 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:01:33.963046 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:01:33.964686 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:01:33.974019 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4541/9024] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:01:43.969759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:49.612115 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:01:49.612620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:01:49.612719 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:01:49.652190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] MFA Rules not processed for user `1d53786e35f04229b4fdb375d5141b99`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:01:49.653336 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:01:49.664165 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4484/9025] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Jun 4 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:01:49.674575 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:01:49.684544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a30d19-7c92-4f4c-9c90-b77f6857e8ce service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:01:49.688630 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:01:49.689281 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:01:49.689567 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:01:49.689844 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:01:49.700571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:01:49.702008 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:01:49.713085 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4542/9026] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:01:49.775794 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:01:49.788236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe196e-4c7e-4c2e-8792-a6533a2d323a None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:01:49.793532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:01:49.794181 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:01:49.794462 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:01:49.794726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:01:49.796554 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:01:49.808422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:01:49.810179 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:01:49.820491 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4485/9027] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:01:59.708282 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:59.816040 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=15 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:02:11.554504 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:02:11.564267 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23807f20-10d9-4207-a9aa-1b0d543b7e72 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:02:11.568622 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:02:11.569280 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:02:11.569563 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:02:11.569841 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:02:11.578251 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:02:11.579791 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:02:11.587816 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4543/9028] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:02:21.584611 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:27.139093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:27.171114 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43ea9-cb0e-44aa-8318-69a77bc4555b service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:27.177046 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:27.177707 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:27.177995 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:27.178282 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:27.188342 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:27.189972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:27.201754 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4486/9029] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:27.334021 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:27.349861 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5898024-8929-4fca-bde9-155fa73c64f6 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:27.353648 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:27.354296 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:27.354577 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:27.354849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:27.367639 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:27.369189 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:27.383054 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4544/9030] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:28.562434 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:28.577447 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ba8a2-695f-4418-9b20-989fdf9cd605 service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:28.582032 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:28.582691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:28.582985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:28.583236 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:28.598685 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:28.600227 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:28.613401 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4487/9031] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:31.205680 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:31.215800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034330c-a68d-402e-b1ca-5ade302bd7f5 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:31.220833 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:31.222549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:31.222549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:31.222549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:31.294411 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:31.296725 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:31.316811 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4545/9032] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:34.630452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:34.665984 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d4e44-689b-4708-bb09-bb68c8823429 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:34.672216 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:34.672941 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:34.673184 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:34.673720 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:34.675885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:34.691124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:34.692788 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:34.722471 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4488/9033] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 22:03:38.078902 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:38.107744 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a7bb8-7730-4190-859a-f314f178854e service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:38.112699 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:38.113571 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:38.113850 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:38.114127 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] PATH_INFO: `/v3/users/e94e127dc47a477d848d7ff172109538` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:38.115388 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94e127dc47a477d848d7ff172109538)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:38.117356 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:38.168759 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94e127dc47a477d848d7ff172109538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.178383 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94e127dc47a477d848d7ff172109538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.179450 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94e127dc47a477d848d7ff172109538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.180528 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94e127dc47a477d848d7ff172109538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.200146 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94e127dc47a477d848d7ff172109538'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.216810 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4546/9034] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 22:03:38 2022] DELETE /identity/v3/users/e94e127dc47a477d848d7ff172109538 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:38.404081 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:38.416392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a177-6113-469f-95a0-be22ba4ad311 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:38.478958 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:38.479899 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:38.480189 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:38.480467 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] PATH_INFO: `/v3/projects/179af47cc6864305ab601ac5edd826ee` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:38.481658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179af47cc6864305ab601ac5edd826ee)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:38.483770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:38.533909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179af47cc6864305ab601ac5edd826ee', 'request_id': 'req-69baeb94-4c9d-41d8-897b-314c13363bf7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.540091 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179af47cc6864305ab601ac5edd826ee', 'request_id': 'req-69baeb94-4c9d-41d8-897b-314c13363bf7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.545531 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179af47cc6864305ab601ac5edd826ee', 'request_id': 'req-69baeb94-4c9d-41d8-897b-314c13363bf7'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.561383 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] The token cache is being invalidate because project 179af47cc6864305ab601ac5edd826ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 22:03:38.561668 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.562319 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.563975 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4489/9035] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 22:03:38 2022] DELETE /identity/v3/projects/179af47cc6864305ab601ac5edd826ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:38.568262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:38.569856 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:38.583081 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7091a-6d45-4834-beec-d25760e1374a admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:38.599537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:38.641735 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:38.642629 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:38.642917 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:38.643201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] PATH_INFO: `/v3/users/a5035a69cc0f48c3814c074983724f3e` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:38.644492 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5035a69cc0f48c3814c074983724f3e)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:38.646777 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:38.699499 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5035a69cc0f48c3814c074983724f3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.707315 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5035a69cc0f48c3814c074983724f3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.708038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5035a69cc0f48c3814c074983724f3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.708657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5035a69cc0f48c3814c074983724f3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.721569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-fc6c571d-69a6-4087-a310-26046e28ebe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5035a69cc0f48c3814c074983724f3e'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:38.736923 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4547/9036] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 22:03:38 2022] DELETE /identity/v3/users/a5035a69cc0f48c3814c074983724f3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:38.922800 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:38.924305 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:38.949357 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baeb94-4c9d-41d8-897b-314c13363bf7 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:38.958384 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:39.019532 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.020760 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.021042 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.021317 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] PATH_INFO: `/v3/projects/ea9278da7a084d8bbc4732059cccc27c` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.022615 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9278da7a084d8bbc4732059cccc27c)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.024579 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.075379 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9278da7a084d8bbc4732059cccc27c', 'request_id': 'req-fecd7939-3edb-4840-abb9-510a390c8dc1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:39.081889 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9278da7a084d8bbc4732059cccc27c', 'request_id': 'req-fecd7939-3edb-4840-abb9-510a390c8dc1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:39.088140 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9278da7a084d8bbc4732059cccc27c', 'request_id': 'req-fecd7939-3edb-4840-abb9-510a390c8dc1'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:39.103787 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] The token cache is being invalidate because project ea9278da7a084d8bbc4732059cccc27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97804) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 22:03:39.104004 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:39.104758 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-fecd7939-3edb-4840-abb9-510a390c8dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:03:39.106439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4490/9037] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 22:03:38 2022] DELETE /identity/v3/projects/ea9278da7a084d8bbc4732059cccc27c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:39.111822 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.112324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.112437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.143290 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:39.144544 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:39.207990 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4548/9038] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:39.216153 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.216437 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.216765 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.235783 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:39.236981 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:39.245559 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4491/9039] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:39.249847 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.260230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7324c39-20f5-4e3d-8973-6b387aecfc62 None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.265609 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.266255 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.266537 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.266818 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] PATH_INFO: `/v3/domains` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.267530 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97803) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 22:03:39.267859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.269454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.283601 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4549/9040] 10.222.0.18 () {58 vars in 1152 bytes} [Sat Jun 4 22:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 22:03:39.288093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.298133 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38949-36a4-45db-8905-f1ac8af6bea0 None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.304847 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.305515 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.305797 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.306072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.306817 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.308793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.344135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4492/9041] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 22:03:39 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 22:03:39.345549 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.356314 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58543b-9a43-41bf-a40a-f1af84a397ad admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.369114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:39.421436 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.422165 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.422471 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.422743 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.423437 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.425422 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.452393 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4550/9042] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 22:03:39 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 22:03:39.453677 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.464455 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dfc9b-f470-420c-b5e3-bd627fd49977 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.470190 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.470841 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.471144 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.471402 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.472172 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.473784 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.485344 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4493/9043] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 22:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 22:03:39.489813 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.500517 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48427b-b823-41a8-8793-9706b3f8cbcd admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.505679 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.506334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.506617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.506913 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.507671 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.509283 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235428a1-b862-4aab-b76b-188c70a15b72 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.520331 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4551/9044] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 22:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 22:03:39.524831 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.536119 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97df05-fc43-40ea-8c28-1e7dfd0af756 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.541824 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.542716 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.542998 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.543275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] PATH_INFO: `/v3/projects/7eee26c390db416093331b3e47785088/users/71a2b3f1161b41f2b10b7367deeb7d5d/roles/14868dac29204ecd9ad19d6590b5b153` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.559104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eee26c390db416093331b3e47785088, user_id=71a2b3f1161b41f2b10b7367deeb7d5d, role_id=14868dac29204ecd9ad19d6590b5b153)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.561859 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.577893 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4494/9045] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 22:03:39 2022] PUT /identity/v3/projects/7eee26c390db416093331b3e47785088/users/71a2b3f1161b41f2b10b7367deeb7d5d/roles/14868dac29204ecd9ad19d6590b5b153 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:39.583064 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a10e-cbe4-44e2-9971-9b03599f72c0 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.583369 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a10e-cbe4-44e2-9971-9b03599f72c0 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.583691 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87a10e-cbe4-44e2-9971-9b03599f72c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.601771 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-7d87a10e-cbe4-44e2-9971-9b03599f72c0 None None] MFA Rules not processed for user `6a435d18d74943c3a8e7cee442315d79`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:39.603045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-7d87a10e-cbe4-44e2-9971-9b03599f72c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:39.664772 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4552/9046] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:39.674840 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:39.676698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:39.718143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:39.746651 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41f107-308d-4cdc-833d-92895b3ac3e0 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:39.750681 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:39.751337 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:39.751661 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:39.751944 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:39.761448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:39.762900 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:39.773115 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4495/9047] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:43.760107 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:43.760610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:43.760610 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:43.788712 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] MFA Rules not processed for user `71a2b3f1161b41f2b10b7367deeb7d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:43.789915 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:43.865209 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4553/9048] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:43.868701 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:43.882202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981754-7a14-4f3b-b7c3-87195a5b3361 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:43.887220 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:43.887937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:43.888223 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:43.888642 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:43.889348 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:43.891386 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:43.922409 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4496/9049] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Jun 4 22:03:43 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 22:03:43.926221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:43.938176 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43a681-df50-480d-b6ac-61854630aa5e None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:43.971706 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:44.015995 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:44.016681 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:44.016967 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:44.017246 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] PATH_INFO: `/v3/users` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:44.017956 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:44.020510 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:44.049432 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4554/9050] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Jun 4 22:03:43 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 22:03:44.050972 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:44.062593 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7f2eb-27d0-43a9-b250-8b79c9a2ca28 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:44.067589 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:44.068902 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:44.069202 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:44.069388 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:44.070324 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:44.071938 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:44.084411 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4497/9051] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 22:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 22:03:44.088407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:44.105179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b250-5d4f-4426-8494-1c33c7af5693 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:44.110552 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:44.111683 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:44.111975 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:44.112235 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] PATH_INFO: `/v3/projects/a9b00c8e9a8f4141921d53c3540f5082/users/718af910225e486090338ed6972fe6e3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:44.129293 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b00c8e9a8f4141921d53c3540f5082, user_id=718af910225e486090338ed6972fe6e3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:44.132169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:44.149302 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4555/9052] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 22:03:44 2022] PUT /identity/v3/projects/a9b00c8e9a8f4141921d53c3540f5082/users/718af910225e486090338ed6972fe6e3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 22:03:44.153139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:44.166124 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b27f-f9cd-4751-9f49-a7d8ccc06dc1 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:44.230044 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:44.230276 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:44.230565 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:44.230846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] PATH_INFO: `/v3/roles` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:44.231700 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:44.233942 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3cdc5-dfb6-4ec4-b673-bb26e630621e admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:44.244651 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4498/9053] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 22:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 22:03:44.249073 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:44.259935 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bffe-a3f9-4058-b022-cc320aa735d0 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:44.265402 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:44.266320 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:44.266654 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:44.266937 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] PATH_INFO: `/v3/projects/a9b00c8e9a8f4141921d53c3540f5082/users/718af910225e486090338ed6972fe6e3/roles/6cf06574abcf4310a389a3111ad8c511` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:44.269045 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b00c8e9a8f4141921d53c3540f5082, user_id=718af910225e486090338ed6972fe6e3, role_id=6cf06574abcf4310a389a3111ad8c511)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:44.272169 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:44.283438 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4556/9054] 10.222.0.18 () {60 vars in 1482 bytes} [Sat Jun 4 22:03:44 2022] PUT /identity/v3/projects/a9b00c8e9a8f4141921d53c3540f5082/users/718af910225e486090338ed6972fe6e3/roles/6cf06574abcf4310a389a3111ad8c511 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:03:49.228500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade638a-f895-4528-af34-f4d6d5b4ecd0 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:49.229072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade638a-f895-4528-af34-f4d6d5b4ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:49.229072 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade638a-f895-4528-af34-f4d6d5b4ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:49.264909 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-fade638a-f895-4528-af34-f4d6d5b4ecd0 None None] MFA Rules not processed for user `718af910225e486090338ed6972fe6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:49.266125 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fade638a-f895-4528-af34-f4d6d5b4ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:49.350720 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4499/9055] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:49.368566 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:49.370636 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:49.463919 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040b284-2f75-4832-a545-e8593a098e3c admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:49.470114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:49.470786 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:49.471106 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:49.471385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:49.531657 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:49.533324 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:49.542333 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4557/9056] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:50.635607 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:50.636112 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:50.636452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:50.657392 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] MFA Rules not processed for user `71a2b3f1161b41f2b10b7367deeb7d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:03:50.658631 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:50.666791 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4500/9057] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:03:51.339364 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:51.341326 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:51.367726 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:51.431116 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18116b64-a70d-4f59-a01d-53ef73f98556 service nova] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:51.436070 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:51.436722 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:51.437010 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:51.437346 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:51.439140 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:51.451312 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:51.453114 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:51.463295 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4558/9058] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:57.871602 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:57.873218 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:57.893791 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f01761-6a95-4c34-9182-633b0d00755f None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:57.900061 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:57.900730 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:57.901017 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:57.901311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:57.903363 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:03:57.916694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:57.918311 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:57.924501 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:57.930439 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4501/9059] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:03:59.867200 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:03:59.934503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59542d73-84a2-4757-961f-5228425bbd1a service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:03:59.939262 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:03:59.939932 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:03:59.940213 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:03:59.940487 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:03:59.950368 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:03:59.951849 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:03:59.961839 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4559/9060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:04:09.957625 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=51 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:15.825927 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:04:15.838586 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8ab2a-be65-441a-b925-a2acfe2861ca service nova] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:04:15.845205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:04:15.845858 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:04:15.846164 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:04:15.846426 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:04:15.848456 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:04:15.860879 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:04:15.862500 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740096a-8a2c-46f3-9a79-78e86a875870 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:04:15.873524 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4502/9061] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:04:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:04:22.082403 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:04:22.084111 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:04:22.099875 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f1a1-ab07-4331-aa11-ce793b391161 service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:04:22.106714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:04:22.107851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:04:22.107851 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:04:22.108086 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:04:22.110125 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:04:22.123357 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:04:22.125013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:04:22.135739 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4560/9062] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:04:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:04:25.869553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:32.131237 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:02.063427 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befa691-d861-4b42-a508-f1ee0d1be06f None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:02.063959 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befa691-d861-4b42-a508-f1ee0d1be06f None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:02.064077 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befa691-d861-4b42-a508-f1ee0d1be06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:02.082255 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-7befa691-d861-4b42-a508-f1ee0d1be06f None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:06:02.083461 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-7befa691-d861-4b42-a508-f1ee0d1be06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:02.148503 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4503/9063] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 22:06:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:06:02.213580 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:06:02.215859 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:02.295650 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a11f3-6859-4751-9b65-2f7a2df1b033 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:06:02.301551 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:06:02.302203 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:02.302488 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:02.302764 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:02.312120 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:06:02.313974 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:06:02.322452 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4561/9064] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 22:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 22:06:11.715139 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8029-1c8c-4ddf-b68b-46900125d426 None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:11.715689 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8029-1c8c-4ddf-b68b-46900125d426 None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:11.715786 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8029-1c8c-4ddf-b68b-46900125d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:11.734922 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-34cd8029-1c8c-4ddf-b68b-46900125d426 None None] MFA Rules not processed for user `71a2b3f1161b41f2b10b7367deeb7d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:06:11.736174 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-34cd8029-1c8c-4ddf-b68b-46900125d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:11.743308 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4504/9065] 10.222.0.18 () {58 vars in 957 bytes} [Sat Jun 4 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:06:12.089233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:06:12.110739 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a7d9-2657-4943-823b-54d7e69f8a4a service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:06:12.115230 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:06:12.115914 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:12.116196 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:12.116470 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:12.118742 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:12.144385 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:06:12.146154 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:06:12.154748 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4562/9066] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:06:13.941658 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] REQUEST_METHOD: `POST` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:13.942183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:13.942183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:13.961231 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.auth.core [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97804) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:06:13.962481 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:13.970703 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4505/9067] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 22:06:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:06:13.982981 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:06:13.996587 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9700a-7867-4e8f-adde-8561f1833c0a service neutron] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:06:14.001963 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:06:14.002617 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:14.002898 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:14.003171 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:14.012018 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:06:14.013670 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:06:14.022865 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4563/9068] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 22:06:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 22:06:22.638645 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:06:22.649279 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d07ba4-802d-402a-b3a1-41040ead29db None None] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:06:22.653798 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:06:22.654445 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:22.654726 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:22.655008 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:22.657214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:22.667093 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:06:22.668698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:06:22.676882 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4506/9069] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:06:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:06:23.449473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:06:23.468720 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6116601-ebb1-4721-818e-d1112e7104a9 service swift] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:06:23.481002 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d53786e35f04229b4fdb375d5141b99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:06:23.481682 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:06:23.481964 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:06:23.482241 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:06:23.484800 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:06:23.499068 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:06:23.501102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25796de2-4fc1-41ad-8873-cc3ad3b6bf9d service nova] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:06:23.515188 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4564/9070] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:06:32.673330 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=37 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:33.510649 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=59 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:07:19.541396 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:07:19.543104 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:07:19.554525 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f319d1-6955-42df-a926-844a2848ef1c service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:07:19.559182 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6afed72705e6494c9ce5272b328e416b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:07:19.559860 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:07:19.560143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:07:19.560422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:07:19.562452 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:07:19.573062 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:07:19.574511 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:07:19.583395 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4507/9071] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:07:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:07:29.579555 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=6 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:05.672013 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260609-eed7-4f73-a950-7c1059bb2287 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:05.672565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260609-eed7-4f73-a950-7c1059bb2287 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:05.672565 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260609-eed7-4f73-a950-7c1059bb2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:05.742334 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-51260609-eed7-4f73-a950-7c1059bb2287 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:08:05.743696 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-51260609-eed7-4f73-a950-7c1059bb2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:05.768229 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4565/9072] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Jun 4 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:08:05.810534 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:05.832839 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80117-1bdd-47d7-9342-254fb3e06b18 service neutron] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:05.838295 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:05.838937 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:05.839205 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:05.839482 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:05.848166 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:05.850161 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:05.858367 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4508/9073] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 22:08:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 22:08:14.717569 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ee0-8b06-4ed5-9f59-d4b63910b792 None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:14.718105 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ee0-8b06-4ed5-9f59-d4b63910b792 None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:14.718201 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8302ee0-8b06-4ed5-9f59-d4b63910b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:14.743406 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-c8302ee0-8b06-4ed5-9f59-d4b63910b792 None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:08:14.744695 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-c8302ee0-8b06-4ed5-9f59-d4b63910b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:14.754496 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4566/9074] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 22:08:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:08:14.769553 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:14.784353 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25520f-164c-4faa-914b-c6f29cfbadc9 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:14.790591 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:14.791275 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:14.791585 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:14.791868 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:14.801617 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:14.803214 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:14.812135 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4509/9075] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 22:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 22:08:20.077535 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] REQUEST_METHOD: `POST` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:20.078009 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:20.078119 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:20.097038 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.auth.core [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] MFA Rules not processed for user `03b02ac92ea443e3b329758bc367972e`. Rule list: `[]` (Enabled: `True`). {{(pid=97803) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 22:08:20.098229 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:20.106736 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4567/9076] 10.222.0.18 () {58 vars in 967 bytes} [Sat Jun 4 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 22:08:20.119108 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:20.130074 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d3f6e-8187-43d5-9ec4-3f789e20cf7b service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:20.135846 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd40d4b6dcab740c39553774b3daed388', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:20.136620 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:20.136910 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:20.137188 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:20.146249 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:20.148466 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:20.157489 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4510/9077] 10.222.0.18 () {60 vars in 1384 bytes} [Sat Jun 4 22:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 22:08:28.962714 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:28.981957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a831-6714-4e18-a51e-e70a0076217d None None] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:28.987398 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:28.988157 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:28.988443 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:28.988741 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:28.990525 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:29.003233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:29.005277 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:29.019447 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4568/9078] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:08:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:08:30.153865 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=22 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:32.058939 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:32.137448 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330ae07-2fe4-41f9-b1a8-c4aa50f06c56 service swift] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:32.142698 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:32.143694 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:32.143985 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:32.144292 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] PATH_INFO: `/v3/users/71a2b3f1161b41f2b10b7367deeb7d5d` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:32.145936 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a2b3f1161b41f2b10b7367deeb7d5d)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:32.148143 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:32.203345 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a2b3f1161b41f2b10b7367deeb7d5d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.204162 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a2b3f1161b41f2b10b7367deeb7d5d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.211793 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a2b3f1161b41f2b10b7367deeb7d5d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.212422 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a2b3f1161b41f2b10b7367deeb7d5d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.224965 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a2b3f1161b41f2b10b7367deeb7d5d'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.240557 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4511/9079] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 22:08:32 2022] DELETE /identity/v3/users/71a2b3f1161b41f2b10b7367deeb7d5d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:08:32.429275 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:32.440512 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bef48-e6b3-40d3-8d16-98f9a7c296cb service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:32.504576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:32.505454 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:32.505736 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:32.506017 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] PATH_INFO: `/v3/projects/7eee26c390db416093331b3e47785088` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:32.507310 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eee26c390db416093331b3e47785088)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:32.509302 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:32.560970 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eee26c390db416093331b3e47785088', 'request_id': 'req-df626519-1645-4ef0-93fa-1f499f28bbb9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.567372 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eee26c390db416093331b3e47785088', 'request_id': 'req-df626519-1645-4ef0-93fa-1f499f28bbb9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.574209 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eee26c390db416093331b3e47785088', 'request_id': 'req-df626519-1645-4ef0-93fa-1f499f28bbb9'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.600815 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:32.605102 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] The token cache is being invalidate because project 7eee26c390db416093331b3e47785088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 22:08:32.605776 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.606591 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.608429 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4569/9080] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 22:08:32 2022] DELETE /identity/v3/projects/7eee26c390db416093331b3e47785088 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:08:32.612920 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:32.614370 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:32.628934 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6d3f-afeb-479b-91d2-4e8544a641c6 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:32.699210 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:32.700497 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:32.700885 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:32.701297 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] PATH_INFO: `/v3/users/718af910225e486090338ed6972fe6e3` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:32.703335 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718af910225e486090338ed6972fe6e3)` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:32.706367 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:32.722775 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:32.762151 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718af910225e486090338ed6972fe6e3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.762924 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718af910225e486090338ed6972fe6e3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.770492 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718af910225e486090338ed6972fe6e3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.771487 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718af910225e486090338ed6972fe6e3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.783737 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.notifications [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718af910225e486090338ed6972fe6e3'} {{(pid=97804) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:32.798633 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4512/9081] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 22:08:32 2022] DELETE /identity/v3/users/718af910225e486090338ed6972fe6e3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 22:08:32.997197 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:08:32.998808 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:08:33.012407 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df626519-1645-4ef0-93fa-1f499f28bbb9 admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:08:33.090419 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a435d18d74943c3a8e7cee442315d79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '598115c278dc4440816e2bfd4030f050', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:08:33.091299 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:08:33.091618 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:08:33.091895 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] PATH_INFO: `/v3/projects/a9b00c8e9a8f4141921d53c3540f5082` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:08:33.093207 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b00c8e9a8f4141921d53c3540f5082)` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:08:33.095233 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:08:33.145952 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b00c8e9a8f4141921d53c3540f5082', 'request_id': 'req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:33.152576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b00c8e9a8f4141921d53c3540f5082', 'request_id': 'req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:33.158363 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b00c8e9a8f4141921d53c3540f5082', 'request_id': 'req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc'} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:33.172732 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] The token cache is being invalidate because project a9b00c8e9a8f4141921d53c3540f5082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97803) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 22:08:33.172957 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:33.173598 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.notifications [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97803) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 22:08:33.175210 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4570/9082] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 22:08:32 2022] DELETE /identity/v3/projects/a9b00c8e9a8f4141921d53c3540f5082 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 22:08:42.795106 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:43.170104 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:09:19.819097 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:09:19.820897 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:09:19.927808 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1c8e-cccc-4454-a6e8-bf9c8b9ca755 admin admin] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:09:19.990339 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:09:19.991001 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:09:19.991289 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:09:19.991604 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:09:19.993691 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:09:20.006183 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:09:20.007818 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:09:20.018363 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4513/9083] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:09:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:09:28.028328 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:09:28.030126 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:09:28.046503 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e71d0-8905-4baa-ae2a-1b70812b99bc admin admin] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:09:28.053354 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:09:28.054179 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:09:28.054473 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:09:28.054760 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:09:28.056872 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.fernet_utils [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97803) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:09:28.069547 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:09:28.071221 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:09:28.081874 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4571/9084] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:09:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:09:30.014028 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=67 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:09:38.077585 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=6 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:14:25.799147 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] Authenticating user token {{(pid=97804) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:14:25.800778 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.fernet_utils [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97804) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 22:14:25.866632 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c2b9-b8b9-48f7-975a-e737e65ab630 service placement] Validating token access rules against request {{(pid=97804) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:14:25.871864 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97804) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:14:25.872770 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] REQUEST_METHOD: `GET` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:14:25.873050 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] SCRIPT_NAME: `/identity` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:14:25.873326 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97804) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:14:25.881895 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:14:25.883550 ncdv-master-1 devstack@keystone.service[97804]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bf8ae-9fbf-4d48-b0d2-d062f43324f3 service placement] RBAC: Authorization granted {{(pid=97804) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:14:25.893325 ncdv-master-1 devstack@keystone.service[97804]: [pid: 97804|app: 0|req: 4514/9085] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:14:33.071037 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] Authenticating user token {{(pid=97803) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 22:14:33.117260 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c322b-2485-41d8-8e00-7c3965b86f94 service placement] Validating token access rules against request {{(pid=97803) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 22:14:33.124576 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fecce52ceb3494185ea04b82d652f91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36edf7db2659419aa39f259141009a4a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97803) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 22:14:33.125270 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] REQUEST_METHOD: `GET` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 22:14:33.125559 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] SCRIPT_NAME: `/identity` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 22:14:33.125832 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97803) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 22:14:33.135373 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 22:14:33.136991 ncdv-master-1 devstack@keystone.service[97803]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e2116-b2d8-4ac8-99d5-8298a0e3d959 service placement] RBAC: Authorization granted {{(pid=97803) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 22:14:33.147958 ncdv-master-1 devstack@keystone.service[97803]: [pid: 97803|app: 0|req: 4572/9086] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Jun 4 22:14:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 22:14:35.889374 ncdv-master-1 devstack@keystone.service[97804]: DEBUG dbcounter [-] [97804] Writing DB stats keystone:SELECT=28 {{(pid=97804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:14:43.143071 ncdv-master-1 devstack@keystone.service[97803]: DEBUG dbcounter [-] [97803] Writing DB stats keystone:SELECT=20 {{(pid=97803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}